2024-05-10T04:35:52.708 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-10T04:35:52.708 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} --archive /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570 --name pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi --verbose --owner scheduled_pdonnell@teuthology -- /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/orig.config.yaml 2024-05-10T04:35:52.755 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T04:35:52.841 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570 branch: wip-pdonnell-testing-20240509.171335-reef-debug description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} email: pdonnell@redhat.com first_in_suite: false job_id: '7700570' kclient-workload: sequential: - kclient: - client.1 - workunit: clients: client.1: - suites/dbench.sh kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240509.171335-reef-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 50174015a7e79f951b988949abe236791f52d4da ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 50174015a7e79f951b988949abe236791f52d4da selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240509.171335-reef-debug sha1: 50174015a7e79f951b988949abe236791f52d4da owner: scheduled_pdonnell@teuthology priority: 65 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 4933 sha1: 50174015a7e79f951b988949abe236791f52d4da sleep_before_teardown: 0 subset: 420/512 suite: fs suite_branch: wip-pdonnell-testing-20240509.171335-reef-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 50174015a7e79f951b988949abe236791f52d4da syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi047.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW9cGFsHnarNmMU49jrgZ/sshT7WippJne/1sbUukOOQqcHD7NwdZio5eu0zQnnXIo6QESpXGjj2RvKGTYu3l4= smithi117.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDX6FdGxF46ZrwVeinvC+mTyMYIFC/cd+3YZb/rfhPgYx5HwDplQBLjZpiMFJjhIMcXpasD9ZBCdwulGADlN1X0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - parallel: - user-workload - kclient-workload teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-10_02:33:39 tube: smithi user: pdonnell user-workload: sequential: - ceph-fuse: - client.0 - workunit: clients: client.0: - suites/iozone.sh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-10T04:35:52.841 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa; will attempt to use it 2024-05-10T04:35:52.842 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa/tasks 2024-05-10T04:35:52.842 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-10T04:35:52.844 INFO:teuthology.task.internal:Checking packages... 2024-05-10T04:35:52.868 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '50174015a7e79f951b988949abe236791f52d4da' 2024-05-10T04:35:52.868 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-10T04:35:52.869 INFO:teuthology.packaging:ref: None 2024-05-10T04:35:52.869 INFO:teuthology.packaging:tag: None 2024-05-10T04:35:52.869 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T04:35:52.869 INFO:teuthology.packaging:sha1: 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:35:52.869 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T04:35:53.012 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1330.g50174015 2024-05-10T04:35:53.014 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-10T04:35:53.019 INFO:teuthology.task.internal:no buildpackages task found 2024-05-10T04:35:53.019 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-10T04:35:53.024 INFO:teuthology.task.internal:Saving configuration 2024-05-10T04:35:53.041 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-10T04:35:53.046 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-10T04:35:53.072 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi047.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 04:30:53.399190', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW9cGFsHnarNmMU49jrgZ/sshT7WippJne/1sbUukOOQqcHD7NwdZio5eu0zQnnXIo6QESpXGjj2RvKGTYu3l4='} 2024-05-10T04:35:53.088 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi117.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-10 04:30:53.401292', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDX6FdGxF46ZrwVeinvC+mTyMYIFC/cd+3YZb/rfhPgYx5HwDplQBLjZpiMFJjhIMcXpasD9ZBCdwulGADlN1X0='} 2024-05-10T04:35:53.088 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-10T04:35:53.094 INFO:teuthology.task.internal:roles: ubuntu@smithi047.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-10T04:35:53.094 INFO:teuthology.task.internal:roles: ubuntu@smithi117.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-05-10T04:35:53.094 INFO:teuthology.run_tasks:Running task console_log... 2024-05-10T04:35:53.158 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd644a220d0>, signals=[15]) 2024-05-10T04:35:53.159 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-10T04:35:53.165 INFO:teuthology.task.internal:Opening connections... 2024-05-10T04:35:53.165 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:35:53.167 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:35:53.242 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T04:35:53.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:35:53.316 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-10T04:35:53.321 DEBUG:teuthology.orchestra.run.smithi047:> uname -m 2024-05-10T04:35:53.344 INFO:teuthology.orchestra.run.smithi047.stdout:x86_64 2024-05-10T04:35:53.345 DEBUG:teuthology.orchestra.run.smithi047:> cat /etc/os-release 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:NAME="CentOS Stream" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION="8" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:ID="centos" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:ID_LIKE="rhel fedora" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:VERSION_ID="8" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:PLATFORM_ID="platform:el8" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:PRETTY_NAME="CentOS Stream 8" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:ANSI_COLOR="0;31" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-05-10T04:35:53.407 INFO:teuthology.orchestra.run.smithi047.stdout:HOME_URL="https://centos.org/" 2024-05-10T04:35:53.408 INFO:teuthology.orchestra.run.smithi047.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T04:35:53.408 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T04:35:53.408 INFO:teuthology.orchestra.run.smithi047.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T04:35:53.408 INFO:teuthology.lock.ops:Updating smithi047.front.sepia.ceph.com on lock server 2024-05-10T04:35:53.430 DEBUG:teuthology.orchestra.run.smithi117:> uname -m 2024-05-10T04:35:53.451 INFO:teuthology.orchestra.run.smithi117.stdout:x86_64 2024-05-10T04:35:53.452 DEBUG:teuthology.orchestra.run.smithi117:> cat /etc/os-release 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:NAME="CentOS Stream" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION="8" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:ID="centos" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:ID_LIKE="rhel fedora" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:VERSION_ID="8" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:PLATFORM_ID="platform:el8" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:PRETTY_NAME="CentOS Stream 8" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:ANSI_COLOR="0;31" 2024-05-10T04:35:53.512 INFO:teuthology.orchestra.run.smithi117.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-05-10T04:35:53.513 INFO:teuthology.orchestra.run.smithi117.stdout:HOME_URL="https://centos.org/" 2024-05-10T04:35:53.513 INFO:teuthology.orchestra.run.smithi117.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-10T04:35:53.513 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-05-10T04:35:53.513 INFO:teuthology.orchestra.run.smithi117.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-10T04:35:53.513 INFO:teuthology.lock.ops:Updating smithi117.front.sepia.ceph.com on lock server 2024-05-10T04:35:53.530 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-10T04:35:53.542 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-10T04:35:53.547 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-10T04:35:53.547 DEBUG:teuthology.orchestra.run.smithi047:> test '!' -e /home/ubuntu/cephtest 2024-05-10T04:35:53.551 DEBUG:teuthology.orchestra.run.smithi117:> test '!' -e /home/ubuntu/cephtest 2024-05-10T04:35:53.570 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-10T04:35:53.579 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-10T04:35:53.579 DEBUG:teuthology.orchestra.run.smithi047:> test -z $(ls -A /var/lib/ceph) 2024-05-10T04:35:53.612 DEBUG:teuthology.orchestra.run.smithi117:> test -z $(ls -A /var/lib/ceph) 2024-05-10T04:35:53.646 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-10T04:35:53.700 INFO:teuthology.run_tasks:Running task kernel... 2024-05-10T04:35:53.732 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-05-10T04:35:53.732 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-05-10T04:35:53.732 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-05-10T04:35:53.733 DEBUG:teuthology.orchestra.run.smithi047:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T04:35:53.733 DEBUG:teuthology.orchestra.run.smithi117:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-10T04:35:53.751 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:35:53.752 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-05-10T04:35:53.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:35:53.755 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2024-05-10T04:35:53.923 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:35:53.923 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-10T04:35:53.923 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-10T04:35:53.946 INFO:teuthology.orchestra.run.smithi047.stdout:4.18.0-489.el8.x86_64 2024-05-10T04:35:53.946 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:35:53.946 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-10T04:35:53.946 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum upgrade -y linux-firmware 2024-05-10T04:35:53.985 DEBUG:teuthology.task.kernel:sha1 for client.1 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:35:53.985 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-10T04:35:53.985 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-05-10T04:35:54.004 INFO:teuthology.orchestra.run.smithi117.stdout:4.18.0-489.el8.x86_64 2024-05-10T04:35:54.005 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:35:54.005 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-10T04:35:54.005 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum upgrade -y linux-firmware 2024-05-10T04:35:58.711 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - AppStream 14 MB/s | 28 MB 00:02 2024-05-10T04:35:58.823 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - AppStream 12 MB/s | 28 MB 00:02 2024-05-10T04:36:06.094 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - BaseOS 4.3 MB/s | 10 MB 00:02 2024-05-10T04:36:06.365 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - BaseOS 4.6 MB/s | 10 MB 00:02 2024-05-10T04:36:08.086 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2024-05-10T04:36:08.445 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - Extras common packages 30 kB/s | 7.7 kB 00:00 2024-05-10T04:36:08.448 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-05-10T04:36:08.722 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-05-10T04:36:08.933 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-05-10T04:36:09.176 INFO:teuthology.orchestra.run.smithi047.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-05-10T04:36:10.313 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 13 MB/s | 14 MB 00:01 2024-05-10T04:36:10.566 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 14 MB 00:01 2024-05-10T04:36:14.005 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 671 kB/s | 24 kB 00:00 2024-05-10T04:36:14.026 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 415 kB/s | 24 kB 00:00 2024-05-10T04:36:17.153 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-05-10T04:36:17.154 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-05-10T04:36:17.154 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repo Size 2024-05-10T04:36:17.154 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-05-10T04:36:17.154 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout:================================================================================ 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 1 Package 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 355 M 2024-05-10T04:36:17.155 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-05-10T04:36:17.500 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-10T04:36:17.500 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-05-10T04:36:17.500 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repo Size 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout: linux-firmware noarch 20240111-121.gitb3132c18.el8 baseos 355 M 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout:================================================================================ 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 1 Package 2024-05-10T04:36:17.501 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:36:17.502 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 355 M 2024-05-10T04:36:17.502 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-05-10T04:36:27.494 INFO:teuthology.orchestra.run.smithi047.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 36 MB/s | 355 MB 00:09 2024-05-10T04:36:27.495 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:36:27.495 INFO:teuthology.orchestra.run.smithi047.stdout:Total 35 MB/s | 355 MB 00:09 2024-05-10T04:36:29.705 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-05-10T04:36:29.775 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-05-10T04:36:29.775 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-05-10T04:36:32.109 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-05-10T04:36:32.146 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-05-10T04:36:35.928 INFO:teuthology.orchestra.run.smithi117.stdout:linux-firmware-20240111-121.gitb3132c18.el8.noa 19 MB/s | 355 MB 00:18 2024-05-10T04:36:35.929 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:36:35.929 INFO:teuthology.orchestra.run.smithi117.stdout:Total 19 MB/s | 355 MB 00:18 2024-05-10T04:36:38.030 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-05-10T04:36:38.103 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-05-10T04:36:38.103 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-05-10T04:36:40.299 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-05-10T04:36:40.324 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-05-10T04:36:56.318 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-05-10T04:36:56.641 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:36:56.863 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:36:57.111 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:36:57.112 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:36:57.584 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:36:57.584 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:36:57.584 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-05-10T04:36:57.584 INFO:teuthology.orchestra.run.smithi047.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-05-10T04:36:57.584 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:36:57.584 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-10T04:36:57.769 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-10T04:36:57.770 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:36:57.911 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-05-10T04:36:57.911 DEBUG:teuthology.orchestra.run.smithi047:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-05-10T04:36:57.914 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi047.front.sepia.ceph.com to complete... 2024-05-10T04:37:03.321 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-05-10T04:37:03.696 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:37:03.942 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:37:04.210 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:37:04.210 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : linux-firmware-20240111-121.gitb3132c18.el8.noarch 1/2 2024-05-10T04:37:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2024-05-10T04:37:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:37:04.693 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-05-10T04:37:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: linux-firmware-20240111-121.gitb3132c18.el8.noarch 2024-05-10T04:37:04.693 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:37:04.693 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-05-10T04:37:04.915 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-10T04:37:04.915 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-10T04:37:05.063 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ 2024-05-10T04:37:05.063 DEBUG:teuthology.orchestra.run.smithi117:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/ --input-file=- 2024-05-10T04:37:05.066 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi117.front.sepia.ceph.com to complete... 2024-05-10T04:37:17.709 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10 04:37:17 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-10T04:37:17.709 INFO:teuthology.orchestra.run.smithi047.stderr:FINISHED --2024-05-10 04:37:17-- 2024-05-10T04:37:17.709 INFO:teuthology.orchestra.run.smithi047.stderr:Total wall clock time: 20s 2024-05-10T04:37:17.709 INFO:teuthology.orchestra.run.smithi047.stderr:Downloaded: 1 files, 405M in 19s (21.1 MB/s) 2024-05-10T04:37:17.712 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-10T04:37:17.712 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-10T04:37:19.636 INFO:teuthology.orchestra.run.smithi047.stdout:Verifying... ######################################## 2024-05-10T04:37:19.682 INFO:teuthology.orchestra.run.smithi047.stdout:Preparing... ######################################## 2024-05-10T04:37:19.798 INFO:teuthology.orchestra.run.smithi047.stdout:Updating / installing... 2024-05-10T04:37:26.447 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10 04:37:26 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/8/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [425099368/425099368] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-10T04:37:26.447 INFO:teuthology.orchestra.run.smithi117.stderr:FINISHED --2024-05-10 04:37:26-- 2024-05-10T04:37:26.447 INFO:teuthology.orchestra.run.smithi117.stderr:Total wall clock time: 21s 2024-05-10T04:37:26.447 INFO:teuthology.orchestra.run.smithi117.stderr:Downloaded: 1 files, 405M in 21s (19.5 MB/s) 2024-05-10T04:37:26.450 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.1... 2024-05-10T04:37:26.450 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-10T04:37:28.258 INFO:teuthology.orchestra.run.smithi117.stdout:Verifying... ######################################## 2024-05-10T04:37:28.303 INFO:teuthology.orchestra.run.smithi117.stdout:Preparing... ######################################## 2024-05-10T04:37:28.412 INFO:teuthology.orchestra.run.smithi117.stdout:Updating / installing... 2024-05-10T04:38:05.282 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-10T04:38:09.305 INFO:teuthology.orchestra.run.smithi047.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:38:10.959 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-10T04:38:13.621 INFO:teuthology.orchestra.run.smithi117.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-05-10T04:38:30.024 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi047.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-10T04:38:30.025 DEBUG:teuthology.orchestra.run.smithi047:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-10T04:38:30.085 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.085 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.085 INFO:teuthology.orchestra.run.smithi047.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-10T04:38:30.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-10T04:38:30.085 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-10T04:38:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-10T04:38:30.087 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-10T04:38:30.088 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-10T04:38:30.089 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-10T04:38:30.090 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-10T04:38:30.091 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-10T04:38:30.092 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-10T04:38:30.093 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-10T04:38:30.094 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-10T04:38:30.095 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-10T04:38:30.096 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-10T04:38:30.097 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-10T04:38:30.098 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-10T04:38:30.099 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-10T04:38:30.100 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-10T04:38:30.101 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-10T04:38:30.102 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-10T04:38:30.103 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-10T04:38:30.104 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-10T04:38:30.105 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-10T04:38:30.106 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-10T04:38:30.107 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-10T04:38:30.108 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-10T04:38:30.109 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-10T04:38:30.110 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-10T04:38:30.111 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-10T04:38:30.112 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-10T04:38:30.113 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-10T04:38:30.114 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-10T04:38:30.115 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-10T04:38:30.116 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-10T04:38:30.117 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-10T04:38:30.118 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-10T04:38:30.119 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-10T04:38:30.120 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-10T04:38:30.121 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-10T04:38:30.122 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-10T04:38:30.123 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-10T04:38:30.124 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-10T04:38:30.125 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-10T04:38:30.126 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-10T04:38:30.127 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-10T04:38:30.128 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-10T04:38:30.129 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-10T04:38:30.130 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-10T04:38:30.131 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-10T04:38:30.132 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-10T04:38:30.133 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-10T04:38:30.134 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-10T04:38:30.135 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-10T04:38:30.136 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-10T04:38:30.137 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-10T04:38:30.138 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-10T04:38:30.139 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-10T04:38:30.140 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-10T04:38:30.141 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-10T04:38:30.142 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-10T04:38:30.143 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-10T04:38:30.144 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-10T04:38:30.145 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-10T04:38:30.146 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-10T04:38:30.147 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-10T04:38:30.148 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-10T04:38:30.149 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-10T04:38:30.150 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-10T04:38:30.151 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-10T04:38:30.152 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-10T04:38:30.153 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-10T04:38:30.154 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-10T04:38:30.155 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-10T04:38:30.156 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-10T04:38:30.157 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-10T04:38:30.158 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-10T04:38:30.159 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-10T04:38:30.160 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-10T04:38:30.161 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-10T04:38:30.162 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-10T04:38:30.163 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-10T04:38:30.164 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-10T04:38:30.165 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-10T04:38:30.166 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-10T04:38:30.167 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-10T04:38:30.168 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-10T04:38:30.169 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-10T04:38:30.170 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-10T04:38:30.171 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-10T04:38:30.172 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-10T04:38:30.173 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-10T04:38:30.174 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-10T04:38:30.175 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-10T04:38:30.176 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-10T04:38:30.177 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-10T04:38:30.178 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-10T04:38:30.179 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-10T04:38:30.180 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-10T04:38:30.181 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-10T04:38:30.182 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-10T04:38:30.183 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-10T04:38:30.184 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-10T04:38:30.185 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-10T04:38:30.186 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-10T04:38:30.187 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-10T04:38:30.188 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-10T04:38:30.189 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-10T04:38:30.190 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-10T04:38:30.191 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-10T04:38:30.192 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-10T04:38:30.193 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-10T04:38:30.194 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-10T04:38:30.195 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-10T04:38:30.196 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-10T04:38:30.197 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-10T04:38:30.198 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-10T04:38:30.199 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-10T04:38:30.200 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-10T04:38:30.201 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-10T04:38:30.202 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-10T04:38:30.203 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-10T04:38:30.204 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-10T04:38:30.205 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-10T04:38:30.206 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-10T04:38:30.207 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-10T04:38:30.208 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-10T04:38:30.209 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-10T04:38:30.210 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-10T04:38:30.211 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-10T04:38:30.212 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-10T04:38:30.213 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-10T04:38:30.214 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-10T04:38:30.215 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-10T04:38:30.216 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-10T04:38:30.217 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-10T04:38:30.218 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-10T04:38:30.219 INFO:teuthology.orchestra.run.smithi047.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:38:30.223 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.223 DEBUG:teuthology.orchestra.run.smithi047:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-10T04:38:30.251 INFO:teuthology.orchestra.run.smithi047.stdout:postinstall scriptlet (using /bin/sh): 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout:for file in vmlinuz System.map config; do 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: fi 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout:done 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:38:30.252 INFO:teuthology.orchestra.run.smithi047.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.253 INFO:teuthology.orchestra.run.smithi047.stdout:fi 2024-05-10T04:38:30.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo rpm -qi grub2-tools 2024-05-10T04:38:30.330 INFO:teuthology.orchestra.run.smithi047.stdout:Name : grub2-tools 2024-05-10T04:38:30.330 INFO:teuthology.orchestra.run.smithi047.stdout:Epoch : 1 2024-05-10T04:38:30.330 INFO:teuthology.orchestra.run.smithi047.stdout:Version : 2.02 2024-05-10T04:38:30.330 INFO:teuthology.orchestra.run.smithi047.stdout:Release : 129.el8 2024-05-10T04:38:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:Architecture: x86_64 2024-05-10T04:38:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-05-10T04:38:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:Group : System Environment/Base 2024-05-10T04:38:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:Size : 9265586 2024-05-10T04:38:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:License : GPLv3+ 2024-05-10T04:38:30.331 INFO:teuthology.orchestra.run.smithi047.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-05-10T04:38:30.332 INFO:teuthology.orchestra.run.smithi047.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-05-10T04:38:30.332 INFO:teuthology.orchestra.run.smithi047.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-05-10T04:38:30.332 INFO:teuthology.orchestra.run.smithi047.stdout:Build Host : kbuilder.bsys.centos.org 2024-05-10T04:38:30.332 INFO:teuthology.orchestra.run.smithi047.stdout:Relocations : (not relocatable) 2024-05-10T04:38:30.332 INFO:teuthology.orchestra.run.smithi047.stdout:Packager : CentOS BuildSystem 2024-05-10T04:38:30.332 INFO:teuthology.orchestra.run.smithi047.stdout:Vendor : CentOS 2024-05-10T04:38:30.333 INFO:teuthology.orchestra.run.smithi047.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T04:38:30.333 INFO:teuthology.orchestra.run.smithi047.stdout:Summary : Support tools for GRUB. 2024-05-10T04:38:30.333 INFO:teuthology.orchestra.run.smithi047.stdout:Description : 2024-05-10T04:38:30.333 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:38:30.333 INFO:teuthology.orchestra.run.smithi047.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T04:38:30.333 INFO:teuthology.orchestra.run.smithi047.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T04:38:30.334 INFO:teuthology.orchestra.run.smithi047.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T04:38:30.334 INFO:teuthology.orchestra.run.smithi047.stdout:hardware devices. 2024-05-10T04:38:30.335 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:38:30.335 INFO:teuthology.orchestra.run.smithi047.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T04:38:30.336 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T04:38:30.336 INFO:teuthology.task.kernel:Updating grub on smithi047 to boot 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:30.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T04:38:33.792 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi117.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-10T04:38:33.792 DEBUG:teuthology.orchestra.run.smithi117:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-10T04:38:33.853 INFO:teuthology.orchestra.run.smithi117.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-10T04:38:33.854 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-10T04:38:33.855 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-10T04:38:33.856 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-10T04:38:33.857 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-10T04:38:33.858 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-10T04:38:33.859 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-10T04:38:33.860 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-10T04:38:33.861 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-10T04:38:33.862 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-10T04:38:33.863 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-10T04:38:33.864 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-10T04:38:33.865 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-10T04:38:33.866 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-10T04:38:33.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-10T04:38:33.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-10T04:38:33.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-10T04:38:33.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-10T04:38:33.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-10T04:38:33.867 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-10T04:38:33.868 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-10T04:38:33.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-10T04:38:33.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-10T04:38:33.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-10T04:38:33.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-10T04:38:33.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-10T04:38:33.869 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-10T04:38:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-10T04:38:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-10T04:38:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-10T04:38:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-10T04:38:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-10T04:38:33.870 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-10T04:38:33.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-10T04:38:33.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-10T04:38:33.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-10T04:38:33.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-10T04:38:33.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-10T04:38:33.871 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-10T04:38:33.872 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-10T04:38:33.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-10T04:38:33.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-10T04:38:33.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-10T04:38:33.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-10T04:38:33.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-10T04:38:33.873 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-10T04:38:33.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-10T04:38:33.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-10T04:38:33.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-10T04:38:33.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-10T04:38:33.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-10T04:38:33.874 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-10T04:38:33.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-10T04:38:33.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-10T04:38:33.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-10T04:38:33.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-10T04:38:33.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-10T04:38:33.875 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-10T04:38:33.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-10T04:38:33.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-10T04:38:33.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-10T04:38:33.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-10T04:38:33.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-10T04:38:33.876 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-10T04:38:33.877 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-10T04:38:33.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-10T04:38:33.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-10T04:38:33.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-10T04:38:33.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-10T04:38:33.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-10T04:38:33.878 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-10T04:38:33.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-10T04:38:33.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-10T04:38:33.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-10T04:38:33.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-10T04:38:33.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-10T04:38:33.879 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-10T04:38:33.880 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-10T04:38:33.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-10T04:38:33.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-10T04:38:33.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-10T04:38:33.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-10T04:38:33.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-10T04:38:33.881 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-10T04:38:33.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-10T04:38:33.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-10T04:38:33.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-10T04:38:33.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-10T04:38:33.882 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-10T04:38:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-10T04:38:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-10T04:38:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-10T04:38:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-10T04:38:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-10T04:38:33.883 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-10T04:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-10T04:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-10T04:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-10T04:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-10T04:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-10T04:38:33.884 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-10T04:38:33.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-10T04:38:33.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-10T04:38:33.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-10T04:38:33.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-10T04:38:33.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-10T04:38:33.885 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-10T04:38:33.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-10T04:38:33.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-10T04:38:33.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-10T04:38:33.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-10T04:38:33.886 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-10T04:38:33.887 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-10T04:38:33.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-10T04:38:33.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-10T04:38:33.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-10T04:38:33.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-10T04:38:33.888 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-10T04:38:33.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-10T04:38:33.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-10T04:38:33.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-10T04:38:33.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-10T04:38:33.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-10T04:38:33.889 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-10T04:38:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-10T04:38:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-10T04:38:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-10T04:38:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-10T04:38:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-10T04:38:33.890 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-10T04:38:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-10T04:38:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-10T04:38:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-10T04:38:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-10T04:38:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-10T04:38:33.891 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-10T04:38:33.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-10T04:38:33.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-10T04:38:33.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-10T04:38:33.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-10T04:38:33.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-10T04:38:33.892 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-10T04:38:33.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-10T04:38:33.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-10T04:38:33.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-10T04:38:33.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-10T04:38:33.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-10T04:38:33.893 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-10T04:38:33.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-10T04:38:33.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-10T04:38:33.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-10T04:38:33.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-10T04:38:33.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-10T04:38:33.894 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-10T04:38:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-10T04:38:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-10T04:38:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-10T04:38:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-10T04:38:33.895 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-10T04:38:33.896 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-10T04:38:33.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-10T04:38:33.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-10T04:38:33.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-10T04:38:33.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-10T04:38:33.897 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-10T04:38:33.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-10T04:38:33.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-10T04:38:33.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-10T04:38:33.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-10T04:38:33.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-10T04:38:33.898 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-10T04:38:33.899 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-10T04:38:33.900 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-10T04:38:33.901 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-10T04:38:33.902 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-10T04:38:33.903 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-10T04:38:33.904 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-10T04:38:33.905 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-10T04:38:33.906 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-10T04:38:33.907 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-10T04:38:33.908 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-10T04:38:33.909 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-10T04:38:33.910 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-10T04:38:33.911 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-10T04:38:33.912 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-10T04:38:33.913 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-10T04:38:33.914 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-10T04:38:33.915 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-10T04:38:33.916 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-10T04:38:33.917 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-10T04:38:33.918 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-10T04:38:33.919 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-10T04:38:33.920 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-10T04:38:33.921 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-10T04:38:33.922 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-10T04:38:33.923 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-10T04:38:33.924 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-10T04:38:33.925 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-10T04:38:33.926 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-10T04:38:33.927 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-10T04:38:33.928 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-10T04:38:33.929 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-10T04:38:33.930 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-10T04:38:33.931 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-10T04:38:33.932 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-10T04:38:33.933 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-10T04:38:33.934 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-10T04:38:33.935 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-10T04:38:33.936 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-10T04:38:33.937 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-10T04:38:33.938 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-10T04:38:33.938 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-10T04:38:33.938 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-10T04:38:33.938 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-10T04:38:33.938 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-10T04:38:33.938 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-10T04:38:33.939 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-10T04:38:33.939 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-10T04:38:33.939 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-10T04:38:33.939 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-10T04:38:33.939 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-10T04:38:33.939 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-10T04:38:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-10T04:38:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-10T04:38:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-10T04:38:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-10T04:38:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-10T04:38:33.940 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-10T04:38:33.941 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-10T04:38:33.942 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-10T04:38:33.942 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-10T04:38:33.942 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-10T04:38:33.942 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-10T04:38:33.942 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-10T04:38:33.942 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-10T04:38:33.943 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-10T04:38:33.943 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-10T04:38:33.943 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-10T04:38:33.943 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-10T04:38:33.943 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-10T04:38:33.943 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-10T04:38:33.944 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-10T04:38:33.945 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-10T04:38:33.946 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-10T04:38:33.946 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-10T04:38:33.946 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-10T04:38:33.946 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-10T04:38:33.946 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-10T04:38:33.947 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-10T04:38:33.948 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-10T04:38:33.948 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-10T04:38:33.948 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-10T04:38:33.948 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-10T04:38:33.948 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-10T04:38:33.948 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-10T04:38:33.949 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-10T04:38:33.949 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-10T04:38:33.949 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-10T04:38:33.949 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-10T04:38:33.949 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-10T04:38:33.950 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-10T04:38:33.950 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-10T04:38:33.950 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-10T04:38:33.950 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-10T04:38:33.950 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-10T04:38:33.950 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-10T04:38:33.951 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-10T04:38:33.951 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-10T04:38:33.951 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-10T04:38:33.951 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-10T04:38:33.951 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-10T04:38:33.951 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-10T04:38:33.952 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-10T04:38:33.952 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-10T04:38:33.952 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-10T04:38:33.952 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-10T04:38:33.952 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-10T04:38:33.952 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-10T04:38:33.953 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-10T04:38:33.954 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-10T04:38:33.954 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-10T04:38:33.954 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-10T04:38:33.954 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-10T04:38:33.954 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-10T04:38:33.955 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-10T04:38:33.956 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-10T04:38:33.956 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-10T04:38:33.956 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-10T04:38:33.956 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-10T04:38:33.956 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-10T04:38:33.956 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-10T04:38:33.957 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-10T04:38:33.957 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-10T04:38:33.957 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-10T04:38:33.957 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-10T04:38:33.957 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-10T04:38:33.957 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-10T04:38:33.958 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-10T04:38:33.958 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-10T04:38:33.958 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-10T04:38:33.958 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-10T04:38:33.958 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-10T04:38:33.958 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-10T04:38:33.959 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-10T04:38:33.959 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-10T04:38:33.959 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-10T04:38:33.959 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-10T04:38:33.959 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-10T04:38:33.959 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-10T04:38:33.960 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-10T04:38:33.960 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-10T04:38:33.960 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-10T04:38:33.960 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-10T04:38:33.960 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-10T04:38:33.960 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-10T04:38:33.961 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-10T04:38:33.962 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-10T04:38:33.963 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-10T04:38:33.964 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-10T04:38:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-10T04:38:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-10T04:38:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-10T04:38:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-10T04:38:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-10T04:38:33.965 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-10T04:38:33.966 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-10T04:38:33.967 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-10T04:38:33.968 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-10T04:38:33.969 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-10T04:38:33.970 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-10T04:38:33.974 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-10T04:38:33.974 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-10T04:38:33.974 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-10T04:38:33.974 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-10T04:38:33.974 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-10T04:38:33.974 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-10T04:38:33.975 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-10T04:38:33.976 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-10T04:38:33.977 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-10T04:38:33.978 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-10T04:38:33.978 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-10T04:38:33.978 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-10T04:38:33.978 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-10T04:38:33.978 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-10T04:38:33.979 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-10T04:38:33.979 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-10T04:38:33.979 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-10T04:38:33.979 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-10T04:38:33.979 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-10T04:38:33.979 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-10T04:38:33.980 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-10T04:38:33.980 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-10T04:38:33.980 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-10T04:38:33.980 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-10T04:38:33.980 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-10T04:38:33.980 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-10T04:38:33.981 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-10T04:38:33.981 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-10T04:38:33.981 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-10T04:38:33.981 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-10T04:38:33.981 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-10T04:38:33.981 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-10T04:38:33.982 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-10T04:38:33.983 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-10T04:38:33.984 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-10T04:38:33.985 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-10T04:38:33.986 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-10T04:38:33.987 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-10T04:38:33.988 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-10T04:38:33.989 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-10T04:38:33.990 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-10T04:38:33.991 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-10T04:38:33.992 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-10T04:38:33.993 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-10T04:38:33.994 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-10T04:38:33.995 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-10T04:38:33.996 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-10T04:38:33.997 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-10T04:38:33.998 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-10T04:38:33.999 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-10T04:38:34.000 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-10T04:38:34.001 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-10T04:38:34.002 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-10T04:38:34.003 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-10T04:38:34.004 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-10T04:38:34.005 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-10T04:38:34.006 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-10T04:38:34.007 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-10T04:38:34.008 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-10T04:38:34.009 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-10T04:38:34.010 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-10T04:38:34.011 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-10T04:38:34.012 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-10T04:38:34.013 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-10T04:38:34.014 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-10T04:38:34.015 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-10T04:38:34.016 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-10T04:38:34.017 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-10T04:38:34.018 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-10T04:38:34.019 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-10T04:38:34.020 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-10T04:38:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-10T04:38:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-10T04:38:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-10T04:38:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-10T04:38:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-10T04:38:34.021 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-10T04:38:34.022 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-10T04:38:34.023 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-10T04:38:34.024 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-10T04:38:34.025 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-10T04:38:34.026 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-10T04:38:34.027 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-10T04:38:34.028 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-10T04:38:34.029 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-10T04:38:34.030 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-10T04:38:34.031 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-10T04:38:34.032 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-10T04:38:34.033 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-10T04:38:34.034 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-10T04:38:34.035 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-10T04:38:34.036 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-10T04:38:34.037 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-10T04:38:34.038 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-10T04:38:34.039 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-10T04:38:34.040 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-10T04:38:34.041 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-10T04:38:34.041 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-10T04:38:34.041 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-10T04:38:34.041 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-10T04:38:34.041 INFO:teuthology.orchestra.run.smithi117.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:38:34.044 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:34.045 DEBUG:teuthology.orchestra.run.smithi117:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-10T04:38:34.070 INFO:teuthology.orchestra.run.smithi117.stdout:postinstall scriptlet (using /bin/sh): 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:for file in vmlinuz System.map config; do 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: fi 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:done 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-05-10T04:38:34.071 INFO:teuthology.orchestra.run.smithi117.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-10T04:38:34.072 INFO:teuthology.orchestra.run.smithi117.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:34.072 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-05-10T04:38:34.072 INFO:teuthology.orchestra.run.smithi117.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-10T04:38:34.072 INFO:teuthology.orchestra.run.smithi117.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-10T04:38:34.072 INFO:teuthology.orchestra.run.smithi117.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:34.072 INFO:teuthology.orchestra.run.smithi117.stdout:fi 2024-05-10T04:38:34.073 DEBUG:teuthology.orchestra.run.smithi117:> sudo rpm -qi grub2-tools 2024-05-10T04:38:34.149 INFO:teuthology.orchestra.run.smithi117.stdout:Name : grub2-tools 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Epoch : 1 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Version : 2.02 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Release : 129.el8 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Architecture: x86_64 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Group : System Environment/Base 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Size : 9265586 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:License : GPLv3+ 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-05-10T04:38:34.150 INFO:teuthology.orchestra.run.smithi117.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:Build Host : kbuilder.bsys.centos.org 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:Relocations : (not relocatable) 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:Packager : CentOS BuildSystem 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:Vendor : CentOS 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:Summary : Support tools for GRUB. 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:Description : 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:hardware devices. 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:38:34.151 INFO:teuthology.orchestra.run.smithi117.stdout:This subpackage provides tools for support of all platforms. 2024-05-10T04:38:34.152 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-10T04:38:34.152 INFO:teuthology.task.kernel:Updating grub on smithi117 to boot 6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:34.153 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-10T04:38:35.180 INFO:teuthology.orchestra.run.smithi047.stderr:Generating grub configuration file ... 2024-05-10T04:38:37.381 INFO:teuthology.orchestra.run.smithi047.stderr:done 2024-05-10T04:38:37.383 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-10T04:38:37.406 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.6yxOyGBwBk 2024-05-10T04:38:37.407 DEBUG:teuthology.orchestra.run.smithi047:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.6yxOyGBwBk 2024-05-10T04:38:37.482 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.6yxOyGBwBk 2024-05-10T04:38:37.653 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.6yxOyGBwBk is 6KB 2024-05-10T04:38:37.678 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.6yxOyGBwBk 2024-05-10T04:38:37.696 DEBUG:teuthology.orchestra.run.smithi047:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T04:38:37.770 INFO:teuthology.orchestra.run.smithi047.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-05-10T04:38:37.770 INFO:teuthology.orchestra.run.smithi047.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-05-10T04:38:37.771 INFO:teuthology.orchestra.run.smithi047.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-05-10T04:38:37.771 INFO:teuthology.orchestra.run.smithi047.stdout:a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112.conf 2024-05-10T04:38:37.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:37.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo shutdown -r now 2024-05-10T04:38:40.139 INFO:teuthology.orchestra.run.smithi117.stderr:Generating grub configuration file ... 2024-05-10T04:38:42.158 INFO:teuthology.orchestra.run.smithi117.stderr:done 2024-05-10T04:38:42.161 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-10T04:38:42.197 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.fI3aetRikx 2024-05-10T04:38:42.197 DEBUG:teuthology.orchestra.run.smithi117:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.fI3aetRikx 2024-05-10T04:38:42.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.fI3aetRikx 2024-05-10T04:38:42.419 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.fI3aetRikx is 6KB 2024-05-10T04:38:42.467 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.fI3aetRikx 2024-05-10T04:38:42.485 DEBUG:teuthology.orchestra.run.smithi117:> sudo /bin/ls /boot/loader/entries || true 2024-05-10T04:38:42.558 INFO:teuthology.orchestra.run.smithi117.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-05-10T04:38:42.558 INFO:teuthology.orchestra.run.smithi117.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-05-10T04:38:42.558 INFO:teuthology.orchestra.run.smithi117.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-05-10T04:38:42.558 INFO:teuthology.orchestra.run.smithi117.stdout:a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112.conf 2024-05-10T04:38:42.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.9.0-rc3-g806ec36b2112 2024-05-10T04:38:42.752 DEBUG:teuthology.orchestra.run.smithi117:> sudo shutdown -r now 2024-05-10T04:39:07.938 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-10T04:39:08.101 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-10T04:39:08.101 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:39:12.758 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-05-10T04:39:12.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-10T04:39:12.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:39:26.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-05-10T04:39:31.102 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-05-10T04:39:35.502 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-10T04:39:35.503 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:39:38.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.47 2024-05-10T04:39:40.105 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-10T04:39:40.106 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:39:43.166 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.117 2024-05-10T04:39:50.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-10T04:39:50.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:39:55.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-10T04:39:55.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:40:22.408 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-10T04:40:22.944 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-10T04:40:22.945 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-10T04:40:22.945 DEBUG:teuthology.orchestra.run.smithi047:> uname -r 2024-05-10T04:40:22.987 INFO:teuthology.orchestra.run.smithi047.stdout:6.9.0-rc3-g806ec36b2112 2024-05-10T04:40:22.988 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-10T04:40:22.988 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T04:40:22.988 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T04:40:23.989 DEBUG:teuthology.parallel:result is None 2024-05-10T04:40:27.101 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-05-10T04:40:27.603 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-10T04:40:27.603 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.9.0-rc3-g806ec36b2112"... 2024-05-10T04:40:27.603 DEBUG:teuthology.orchestra.run.smithi117:> uname -r 2024-05-10T04:40:27.646 INFO:teuthology.orchestra.run.smithi117.stdout:6.9.0-rc3-g806ec36b2112 2024-05-10T04:40:27.646 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-10T04:40:27.646 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-10T04:40:27.646 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-10T04:40:28.647 DEBUG:teuthology.parallel:result is None 2024-05-10T04:40:28.647 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-10T04:40:28.655 INFO:teuthology.task.internal:Creating test directory... 2024-05-10T04:40:28.655 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T04:40:28.661 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-10T04:40:28.708 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-10T04:40:28.719 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-10T04:40:28.724 INFO:teuthology.task.internal:Creating archive directory... 2024-05-10T04:40:28.725 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T04:40:28.728 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-10T04:40:28.801 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-10T04:40:28.807 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-10T04:40:28.808 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T04:40:28.811 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-10T04:40:28.948 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:40:28.958 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:40:28.977 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:40:28.994 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-10T04:40:28.997 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-10T04:40:29.004 INFO:teuthology.task.internal:Configuring sudo... 2024-05-10T04:40:29.005 DEBUG:teuthology.orchestra.run.smithi047:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T04:40:29.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-10T04:40:29.078 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-10T04:40:29.088 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-10T04:40:29.088 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T04:40:29.092 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-10T04:40:29.137 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:40:29.246 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:40:29.322 DEBUG:teuthology.orchestra.run.smithi047:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:40:29.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:40:29.461 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:40:29.461 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T04:40:29.527 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:40:29.606 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-10T04:40:29.697 DEBUG:teuthology.orchestra.run.smithi117:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:40:29.769 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-10T04:40:29.854 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:40:29.854 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-10T04:40:29.920 DEBUG:teuthology.orchestra.run.smithi047:> sudo service rsyslog restart 2024-05-10T04:40:29.924 DEBUG:teuthology.orchestra.run.smithi117:> sudo service rsyslog restart 2024-05-10T04:40:30.034 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:40:30.104 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T04:40:30.483 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-10T04:40:30.491 INFO:teuthology.task.internal:Starting timer... 2024-05-10T04:40:30.491 INFO:teuthology.run_tasks:Running task pcp... 2024-05-10T04:40:30.501 INFO:teuthology.run_tasks:Running task selinux... 2024-05-10T04:40:30.509 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-05-10T04:40:30.510 DEBUG:teuthology.orchestra.run.smithi047:> sudo service auditd rotate 2024-05-10T04:40:30.621 INFO:teuthology.orchestra.run.smithi047.stdout:Rotating logs: 2024-05-10T04:40:30.625 DEBUG:teuthology.orchestra.run.smithi117:> sudo service auditd rotate 2024-05-10T04:40:30.741 INFO:teuthology.orchestra.run.smithi117.stdout:Rotating logs: 2024-05-10T04:40:30.745 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-10T04:40:30.745 DEBUG:teuthology.orchestra.run.smithi047:> /usr/sbin/getenforce 2024-05-10T04:40:30.800 INFO:teuthology.orchestra.run.smithi047.stdout:Permissive 2024-05-10T04:40:30.801 DEBUG:teuthology.orchestra.run.smithi117:> /usr/sbin/getenforce 2024-05-10T04:40:30.860 INFO:teuthology.orchestra.run.smithi117.stdout:Permissive 2024-05-10T04:40:30.860 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi047.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi117.front.sepia.ceph.com': 'permissive'} 2024-05-10T04:40:30.861 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:40:30.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:40:30.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T04:40:30.995 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:40:30.996 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-10T04:40:30.996 DEBUG:teuthology.orchestra.run.smithi047:> sudo /usr/sbin/setenforce permissive 2024-05-10T04:40:31.061 DEBUG:teuthology.orchestra.run.smithi117:> sudo /usr/sbin/setenforce permissive 2024-05-10T04:40:31.127 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-10T04:40:31.137 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-10T04:40:31.153 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-10T04:40:31.154 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi047.front.sepia.ceph.com,smithi117.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-10T04:47:53.790 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi047.front.sepia.ceph.com'), Remote(name='ubuntu@smithi117.front.sepia.ceph.com')] 2024-05-10T04:47:53.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-10T04:47:53.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi047.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:47:53.885 DEBUG:teuthology.orchestra.run.smithi047:> true 2024-05-10T04:47:54.006 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi047.front.sepia.ceph.com' 2024-05-10T04:47:54.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-10T04:47:54.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi117.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-10T04:47:54.103 DEBUG:teuthology.orchestra.run.smithi117:> true 2024-05-10T04:47:54.223 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi117.front.sepia.ceph.com' 2024-05-10T04:47:54.224 INFO:teuthology.run_tasks:Running task clock... 2024-05-10T04:47:54.234 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-10T04:47:54.234 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T04:47:54.235 DEBUG:teuthology.orchestra.run.smithi047:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:47:54.239 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-10T04:47:54.239 DEBUG:teuthology.orchestra.run.smithi117:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T04:47:54.311 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T04:47:54.312 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-10T04:47:54.342 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T04:47:54.346 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-10T04:47:54.438 INFO:teuthology.orchestra.run.smithi047.stderr:sudo: ntpd: command not found 2024-05-10T04:47:54.441 INFO:teuthology.orchestra.run.smithi117.stderr:sudo: ntpd: command not found 2024-05-10T04:47:54.465 INFO:teuthology.orchestra.run.smithi047.stdout:506 Cannot talk to daemon 2024-05-10T04:47:54.467 INFO:teuthology.orchestra.run.smithi117.stdout:506 Cannot talk to daemon 2024-05-10T04:47:54.496 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T04:47:54.498 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-10T04:47:54.528 INFO:teuthology.orchestra.run.smithi047.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T04:47:54.529 INFO:teuthology.orchestra.run.smithi117.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-10T04:47:54.608 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2024-05-10T04:47:54.616 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:47:54.616 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-05-10T04:47:54.616 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.616 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.616 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.616 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.621 INFO:teuthology.orchestra.run.smithi047.stderr:bash: ntpq: command not found 2024-05-10T04:47:54.629 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T04:47:54.629 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-10T04:47:54.629 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.629 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.629 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.629 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T04:47:54.630 INFO:teuthology.run_tasks:Running task install... 2024-05-10T04:47:54.641 DEBUG:teuthology.task.install:project ceph 2024-05-10T04:47:54.641 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}} 2024-05-10T04:47:54.641 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'} 2024-05-10T04:47:54.641 INFO:teuthology.task.install:Using flavor: default 2024-05-10T04:47:54.647 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-10T04:47:54.647 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-05-10T04:47:54.647 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T04:47:54.648 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:47:54.650 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'tag': None, 'wait_for_package': False} 2024-05-10T04:47:54.650 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:47:54.794 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T04:47:54.794 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T04:47:54.807 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/ 2024-05-10T04:47:54.807 INFO:teuthology.task.install.rpm:Package version is 18.2.2-1330.g50174015 2024-05-10T04:47:55.120 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T04:47:55.120 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:47:55.120 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T04:47:55.191 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T04:47:55.191 DEBUG:teuthology.orchestra.run.smithi047:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T04:47:55.193 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240509.171335-reef-debug/50174015a7e79f951b988949abe236791f52d4da/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-10T04:47:55.194 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:47:55.194 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-10T04:47:55.261 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-10T04:47:55.262 DEBUG:teuthology.orchestra.run.smithi117:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/50174015a7e79f951b988949abe236791f52d4da/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-10T04:47:55.300 DEBUG:teuthology.orchestra.run.smithi047:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T04:47:55.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-10T04:47:55.391 DEBUG:teuthology.orchestra.run.smithi047:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T04:47:55.460 INFO:teuthology.orchestra.run.smithi047.stdout:check_obsoletes = 1 2024-05-10T04:47:55.461 DEBUG:teuthology.orchestra.run.smithi117:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-10T04:47:55.463 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum clean all 2024-05-10T04:47:55.527 INFO:teuthology.orchestra.run.smithi117.stdout:check_obsoletes = 1 2024-05-10T04:47:55.530 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum clean all 2024-05-10T04:47:55.824 INFO:teuthology.orchestra.run.smithi047.stdout:76 files removed 2024-05-10T04:47:55.861 DEBUG:teuthology.orchestra.run.smithi047:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T04:47:55.871 INFO:teuthology.orchestra.run.smithi117.stdout:76 files removed 2024-05-10T04:47:55.910 DEBUG:teuthology.orchestra.run.smithi117:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-10T04:47:57.076 INFO:teuthology.orchestra.run.smithi117.stdout:ceph packages for x86_64 132 kB/s | 80 kB 00:00 2024-05-10T04:47:57.106 INFO:teuthology.orchestra.run.smithi047.stdout:ceph packages for x86_64 122 kB/s | 80 kB 00:00 2024-05-10T04:47:57.618 INFO:teuthology.orchestra.run.smithi117.stdout:ceph noarch packages 23 kB/s | 11 kB 00:00 2024-05-10T04:47:57.656 INFO:teuthology.orchestra.run.smithi047.stdout:ceph noarch packages 22 kB/s | 11 kB 00:00 2024-05-10T04:47:58.243 INFO:teuthology.orchestra.run.smithi117.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2024-05-10T04:47:58.329 INFO:teuthology.orchestra.run.smithi047.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2024-05-10T04:48:00.360 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - AppStream 13 MB/s | 28 MB 00:02 2024-05-10T04:48:00.482 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - AppStream 13 MB/s | 28 MB 00:02 2024-05-10T04:48:07.901 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - BaseOS 5.0 MB/s | 10 MB 00:02 2024-05-10T04:48:09.324 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - BaseOS 3.4 MB/s | 10 MB 00:03 2024-05-10T04:48:10.077 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - Extras 37 kB/s | 18 kB 00:00 2024-05-10T04:48:10.627 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.7 kB 00:00 2024-05-10T04:48:11.617 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - Extras 38 kB/s | 18 kB 00:00 2024-05-10T04:48:12.053 INFO:teuthology.orchestra.run.smithi117.stdout:CentOS Stream 8 - PowerTools 3.7 MB/s | 5.0 MB 00:01 2024-05-10T04:48:12.084 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - Extras common packages 22 kB/s | 7.7 kB 00:00 2024-05-10T04:48:13.343 INFO:teuthology.orchestra.run.smithi117.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2024-05-10T04:48:13.844 INFO:teuthology.orchestra.run.smithi047.stdout:CentOS Stream 8 - PowerTools 3.0 MB/s | 5.0 MB 00:01 2024-05-10T04:48:14.848 INFO:teuthology.orchestra.run.smithi117.stdout:Extra Packages for Enterprise Linux 9.6 MB/s | 14 MB 00:01 2024-05-10T04:48:15.095 INFO:teuthology.orchestra.run.smithi047.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-05-10T04:48:16.879 INFO:teuthology.orchestra.run.smithi047.stdout:Extra Packages for Enterprise Linux 8.1 MB/s | 14 MB 00:01 2024-05-10T04:48:18.968 INFO:teuthology.orchestra.run.smithi117.stdout:lab-extras 307 kB/s | 24 kB 00:00 2024-05-10T04:48:21.271 INFO:teuthology.orchestra.run.smithi047.stdout:lab-extras 625 kB/s | 24 kB 00:00 2024-05-10T04:48:22.706 INFO:teuthology.orchestra.run.smithi117.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:48:22.706 INFO:teuthology.orchestra.run.smithi117.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:48:22.716 INFO:teuthology.orchestra.run.smithi117.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-05-10T04:48:22.716 INFO:teuthology.orchestra.run.smithi117.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-05-10T04:48:22.717 INFO:teuthology.orchestra.run.smithi117.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-05-10T04:48:22.718 INFO:teuthology.orchestra.run.smithi117.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:48:22.719 INFO:teuthology.orchestra.run.smithi117.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:48:22.721 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T04:48:22.722 INFO:teuthology.orchestra.run.smithi117.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T04:48:22.804 INFO:teuthology.orchestra.run.smithi117.stdout:Dependencies resolved. 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout: Package Arch Version Repository Size 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout:Installing: 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T04:48:22.828 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T04:48:22.829 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T04:48:22.830 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T04:48:22.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T04:48:22.831 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T04:48:22.831 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T04:48:22.831 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T04:48:22.831 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrading: 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-05-10T04:48:22.834 INFO:teuthology.orchestra.run.smithi117.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-05-10T04:48:22.835 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout:Installing dependencies: 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-05-10T04:48:22.836 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T04:48:22.837 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T04:48:22.838 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-05-10T04:48:22.839 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T04:48:22.840 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T04:48:22.841 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout:Enabling module streams: 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql 10 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:48:22.842 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction Summary 2024-05-10T04:48:22.843 INFO:teuthology.orchestra.run.smithi117.stdout:============================================================================================ 2024-05-10T04:48:22.843 INFO:teuthology.orchestra.run.smithi117.stdout:Install 129 Packages 2024-05-10T04:48:22.843 INFO:teuthology.orchestra.run.smithi117.stdout:Upgrade 24 Packages 2024-05-10T04:48:22.843 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:48:22.843 INFO:teuthology.orchestra.run.smithi117.stdout:Total download size: 227 M 2024-05-10T04:48:22.843 INFO:teuthology.orchestra.run.smithi117.stdout:Downloading Packages: 2024-05-10T04:48:23.748 INFO:teuthology.orchestra.run.smithi117.stdout:(1/153): ceph-18.2.2-1330.g50174015.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2024-05-10T04:48:24.515 INFO:teuthology.orchestra.run.smithi117.stdout:(2/153): ceph-fuse-18.2.2-1330.g50174015.el8.x8 1.1 MB/s | 829 kB 00:00 2024-05-10T04:48:24.740 INFO:teuthology.orchestra.run.smithi117.stdout:(3/153): ceph-immutable-object-cache-18.2.2-133 699 kB/s | 157 kB 00:00 2024-05-10T04:48:25.317 INFO:teuthology.orchestra.run.smithi047.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:48:25.318 INFO:teuthology.orchestra.run.smithi047.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2024-05-10T04:48:25.328 INFO:teuthology.orchestra.run.smithi047.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2024-05-10T04:48:25.329 INFO:teuthology.orchestra.run.smithi047.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2024-05-10T04:48:25.330 INFO:teuthology.orchestra.run.smithi047.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2024-05-10T04:48:25.330 INFO:teuthology.orchestra.run.smithi047.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2024-05-10T04:48:25.332 INFO:teuthology.orchestra.run.smithi047.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2024-05-10T04:48:25.334 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2024-05-10T04:48:25.335 INFO:teuthology.orchestra.run.smithi047.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2024-05-10T04:48:25.423 INFO:teuthology.orchestra.run.smithi047.stdout:Dependencies resolved. 2024-05-10T04:48:25.456 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================================ 2024-05-10T04:48:25.456 INFO:teuthology.orchestra.run.smithi047.stdout: Package Arch Version Repository Size 2024-05-10T04:48:25.456 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================================ 2024-05-10T04:48:25.456 INFO:teuthology.orchestra.run.smithi047.stdout:Installing: 2024-05-10T04:48:25.456 INFO:teuthology.orchestra.run.smithi047.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2024-05-10T04:48:25.456 INFO:teuthology.orchestra.run.smithi047.stdout: ceph x86_64 2:18.2.2-1330.g50174015.el8 ceph 6.4 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.7 M 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 829 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-1330.g50174015.el8 ceph 157 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr x86_64 2:18.2.2-1330.g50174015.el8 ceph 1.5 M 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 138 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 3.5 M 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 7.4 M 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 49 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 14 M 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test x86_64 2:18.2.2-1330.g50174015.el8 ceph 49 M 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 263 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 173 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 246 k 2024-05-10T04:48:25.457 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 18 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel x86_64 0.190-2.el8 baseos 62 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 31 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 756 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel x86_64 2.32.1-46.el8 baseos 100 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel x86_64 1:1.1.1k-12.el8 baseos 3.2 M 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql x86_64 10.23-2.module_el8+572+929c87ac appstream 1.6 M 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib x86_64 10.23-2.module_el8+572+929c87ac appstream 901 k 2024-05-10T04:48:25.458 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server x86_64 10.23-2.module_el8+572+929c87ac appstream 5.1 M 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs x86_64 2:18.2.2-1330.g50174015.el8 ceph 197 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados x86_64 2:18.2.2-1330.g50174015.el8 ceph 371 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 364 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw x86_64 2:18.2.2-1330.g50174015.el8 ceph 107 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse x86_64 2:18.2.2-1330.g50174015.el8 ceph 91 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.3 M 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd x86_64 2:18.2.2-1330.g50174015.el8 ceph 179 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrading: 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager x86_64 1:1.40.16-15.el8 baseos 2.3 M 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm x86_64 1:1.40.16-15.el8 baseos 1.9 M 2024-05-10T04:48:25.459 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team x86_64 1:1.40.16-15.el8 baseos 161 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui x86_64 1:1.40.16-15.el8 baseos 356 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: acl x86_64 2.2.53-3.el8 baseos 83 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client x86_64 0.190-2.el8 baseos 77 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf x86_64 0.190-2.el8 baseos 233 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs x86_64 0.190-2.el8 baseos 305 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: iproute x86_64 6.2.0-5.el8 baseos 854 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: libacl x86_64 2.2.53-3.el8 baseos 35 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-devel x86_64 2.2.53-3.el8 baseos 85 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid x86_64 2.32.1-46.el8 baseos 221 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk x86_64 2.32.1-46.el8 baseos 254 k 2024-05-10T04:48:25.460 INFO:teuthology.orchestra.run.smithi047.stdout: libmount x86_64 2.32.1-46.el8 baseos 237 k 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: librados2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 3.5 M 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols x86_64 2.32.1-46.el8 baseos 180 k 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid x86_64 2.32.1-46.el8 baseos 99 k 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: openssl x86_64 1:1.1.1k-12.el8 baseos 738 k 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs x86_64 1:1.1.1k-12.el8 baseos 1.5 M 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux x86_64 2.32.1-46.el8 baseos 2.6 M 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user x86_64 2.32.1-46.el8 baseos 103 k 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump x86_64 3.1.8-7.el8 baseos 334 k 2024-05-10T04:48:25.461 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout:Installing dependencies: 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: automake noarch 1.16.1-8.el8 appstream 740 k 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 23 M 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 24 k 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds x86_64 2:18.2.2-1330.g50174015.el8 ceph 2.2 M 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 246 k 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon x86_64 2:18.2.2-1330.g50174015.el8 ceph 5.1 M 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd x86_64 2:18.2.2-1330.g50174015.el8 ceph 19 M 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts noarch 2:18.2.2-1330.g50174015.el8 ceph-noarch 16 k 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux x86_64 2:18.2.2-1330.g50174015.el8 ceph 24 k 2024-05-10T04:48:25.462 INFO:teuthology.orchestra.run.smithi047.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite x86_64 2:18.2.2-1330.g50174015.el8 ceph 139 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran x86_64 8.5.0-22.el8 baseos 645 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2024-05-10T04:48:25.463 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath x86_64 8.5.0-22.el8 baseos 172 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1 x86_64 2:18.2.2-1330.g50174015.el8 ceph 461 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2 x86_64 2:18.2.2-1330.g50174015.el8 ceph 7.2 M 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-05-10T04:48:25.464 INFO:teuthology.orchestra.run.smithi047.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-05-10T04:48:25.465 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse x86_64 2:18.2.2-1330.g50174015.el8 ceph 45 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common x86_64 2:18.2.2-1330.g50174015.el8 ceph 129 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-05-10T04:48:25.466 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging noarch 16.8-9.el8 powertools 48 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-05-10T04:48:25.467 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-05-10T04:48:25.468 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout:Enabling module streams: 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql 10 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction Summary 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout:============================================================================================ 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout:Install 129 Packages 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout:Upgrade 24 Packages 2024-05-10T04:48:25.469 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:48:25.470 INFO:teuthology.orchestra.run.smithi047.stdout:Total download size: 227 M 2024-05-10T04:48:25.470 INFO:teuthology.orchestra.run.smithi047.stdout:Downloading Packages: 2024-05-10T04:48:26.448 INFO:teuthology.orchestra.run.smithi047.stdout:(1/153): ceph-18.2.2-1330.g50174015.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2024-05-10T04:48:26.757 INFO:teuthology.orchestra.run.smithi117.stdout:(4/153): ceph-mds-18.2.2-1330.g50174015.el8.x86 1.1 MB/s | 2.2 MB 00:02 2024-05-10T04:48:27.839 INFO:teuthology.orchestra.run.smithi047.stdout:(2/153): ceph-fuse-18.2.2-1330.g50174015.el8.x8 596 kB/s | 829 kB 00:01 2024-05-10T04:48:28.089 INFO:teuthology.orchestra.run.smithi047.stdout:(3/153): ceph-immutable-object-cache-18.2.2-133 629 kB/s | 157 kB 00:00 2024-05-10T04:48:28.090 INFO:teuthology.orchestra.run.smithi117.stdout:(5/153): ceph-mgr-18.2.2-1330.g50174015.el8.x86 1.1 MB/s | 1.5 MB 00:01 2024-05-10T04:48:29.923 INFO:teuthology.orchestra.run.smithi117.stdout:(6/153): ceph-base-18.2.2-1330.g50174015.el8.x8 911 kB/s | 5.7 MB 00:06 2024-05-10T04:48:30.731 INFO:teuthology.orchestra.run.smithi047.stdout:(4/153): ceph-mds-18.2.2-1330.g50174015.el8.x86 838 kB/s | 2.2 MB 00:02 2024-05-10T04:48:31.340 INFO:teuthology.orchestra.run.smithi117.stdout:(7/153): ceph-mon-18.2.2-1330.g50174015.el8.x86 1.6 MB/s | 5.1 MB 00:03 2024-05-10T04:48:32.156 INFO:teuthology.orchestra.run.smithi047.stdout:(5/153): ceph-mgr-18.2.2-1330.g50174015.el8.x86 1.1 MB/s | 1.5 MB 00:01 2024-05-10T04:48:32.682 INFO:teuthology.orchestra.run.smithi047.stdout:(6/153): ceph-base-18.2.2-1330.g50174015.el8.x8 884 kB/s | 5.7 MB 00:06 2024-05-10T04:48:36.015 INFO:teuthology.orchestra.run.smithi047.stdout:(7/153): ceph-mon-18.2.2-1330.g50174015.el8.x86 1.3 MB/s | 5.1 MB 00:03 2024-05-10T04:48:36.131 INFO:teuthology.orchestra.run.smithi117.stdout:(8/153): ceph-common-18.2.2-1330.g50174015.el8. 1.8 MB/s | 23 MB 00:12 2024-05-10T04:48:36.215 INFO:teuthology.orchestra.run.smithi117.stdout:(9/153): ceph-selinux-18.2.2-1330.g50174015.el8 294 kB/s | 24 kB 00:00 2024-05-10T04:48:36.648 INFO:teuthology.orchestra.run.smithi117.stdout:(10/153): ceph-radosgw-18.2.2-1330.g50174015.el 2.7 MB/s | 14 MB 00:05 2024-05-10T04:48:36.750 INFO:teuthology.orchestra.run.smithi117.stdout:(11/153): cephfs-mirror-18.2.2-1330.g50174015.e 2.4 MB/s | 246 kB 00:00 2024-05-10T04:48:36.824 INFO:teuthology.orchestra.run.smithi117.stdout:(12/153): libcephfs-devel-18.2.2-1330.g50174015 413 kB/s | 31 kB 00:00 2024-05-10T04:48:37.083 INFO:teuthology.orchestra.run.smithi117.stdout:(13/153): libcephfs2-18.2.2-1330.g50174015.el8. 2.9 MB/s | 756 kB 00:00 2024-05-10T04:48:37.175 INFO:teuthology.orchestra.run.smithi117.stdout:(14/153): libcephsqlite-18.2.2-1330.g50174015.e 1.5 MB/s | 139 kB 00:00 2024-05-10T04:48:37.291 INFO:teuthology.orchestra.run.smithi117.stdout:(15/153): librados-devel-18.2.2-1330.g50174015. 1.2 MB/s | 139 kB 00:00 2024-05-10T04:48:37.458 INFO:teuthology.orchestra.run.smithi117.stdout:(16/153): libradosstriper1-18.2.2-1330.g5017401 2.7 MB/s | 461 kB 00:00 2024-05-10T04:48:39.117 INFO:teuthology.orchestra.run.smithi117.stdout:(17/153): librgw2-18.2.2-1330.g50174015.el8.x86 4.4 MB/s | 7.2 MB 00:01 2024-05-10T04:48:39.184 INFO:teuthology.orchestra.run.smithi117.stdout:(18/153): python3-ceph-argparse-18.2.2-1330.g50 673 kB/s | 45 kB 00:00 2024-05-10T04:48:39.267 INFO:teuthology.orchestra.run.smithi117.stdout:(19/153): python3-ceph-common-18.2.2-1330.g5017 1.5 MB/s | 129 kB 00:00 2024-05-10T04:48:39.342 INFO:teuthology.orchestra.run.smithi117.stdout:(20/153): python3-cephfs-18.2.2-1330.g50174015. 2.6 MB/s | 197 kB 00:00 2024-05-10T04:48:39.742 INFO:teuthology.orchestra.run.smithi117.stdout:(21/153): python3-rados-18.2.2-1330.g50174015.e 930 kB/s | 371 kB 00:00 2024-05-10T04:48:39.909 INFO:teuthology.orchestra.run.smithi117.stdout:(22/153): python3-rbd-18.2.2-1330.g50174015.el8 2.1 MB/s | 364 kB 00:00 2024-05-10T04:48:40.018 INFO:teuthology.orchestra.run.smithi117.stdout:(23/153): python3-rgw-18.2.2-1330.g50174015.el8 987 kB/s | 107 kB 00:00 2024-05-10T04:48:40.110 INFO:teuthology.orchestra.run.smithi117.stdout:(24/153): rbd-fuse-18.2.2-1330.g50174015.el8.x8 1.0 MB/s | 91 kB 00:00 2024-05-10T04:48:40.602 INFO:teuthology.orchestra.run.smithi117.stdout:(25/153): ceph-osd-18.2.2-1330.g50174015.el8.x8 1.8 MB/s | 19 MB 00:10 2024-05-10T04:48:40.736 INFO:teuthology.orchestra.run.smithi117.stdout:(26/153): rbd-nbd-18.2.2-1330.g50174015.el8.x86 1.3 MB/s | 179 kB 00:00 2024-05-10T04:48:40.803 INFO:teuthology.orchestra.run.smithi117.stdout:(27/153): ceph-grafana-dashboards-18.2.2-1330.g 365 kB/s | 24 kB 00:00 2024-05-10T04:48:40.936 INFO:teuthology.orchestra.run.smithi117.stdout:(28/153): ceph-mgr-cephadm-18.2.2-1330.g5017401 1.0 MB/s | 138 kB 00:00 2024-05-10T04:48:41.036 INFO:teuthology.orchestra.run.smithi117.stdout:(29/153): rbd-mirror-18.2.2-1330.g50174015.el8. 3.6 MB/s | 3.3 MB 00:00 2024-05-10T04:48:41.648 INFO:teuthology.orchestra.run.smithi047.stdout:(8/153): ceph-common-18.2.2-1330.g50174015.el8. 1.5 MB/s | 23 MB 00:15 2024-05-10T04:48:41.848 INFO:teuthology.orchestra.run.smithi047.stdout:(9/153): ceph-radosgw-18.2.2-1330.g50174015.el8 2.5 MB/s | 14 MB 00:05 2024-05-10T04:48:41.875 INFO:teuthology.orchestra.run.smithi047.stdout:(10/153): ceph-selinux-18.2.2-1330.g50174015.el 108 kB/s | 24 kB 00:00 2024-05-10T04:48:41.995 INFO:teuthology.orchestra.run.smithi117.stdout:(30/153): ceph-mgr-dashboard-18.2.2-1330.g50174 3.3 MB/s | 3.5 MB 00:01 2024-05-10T04:48:42.032 INFO:teuthology.orchestra.run.smithi047.stdout:(11/153): cephfs-mirror-18.2.2-1330.g50174015.e 1.5 MB/s | 246 kB 00:00 2024-05-10T04:48:42.121 INFO:teuthology.orchestra.run.smithi117.stdout:(31/153): ceph-mgr-modules-core-18.2.2-1330.g50 1.9 MB/s | 246 kB 00:00 2024-05-10T04:48:42.124 INFO:teuthology.orchestra.run.smithi047.stdout:(12/153): libcephfs-devel-18.2.2-1330.g50174015 338 kB/s | 31 kB 00:00 2024-05-10T04:48:42.188 INFO:teuthology.orchestra.run.smithi117.stdout:(32/153): ceph-mgr-rook-18.2.2-1330.g50174015.e 740 kB/s | 49 kB 00:00 2024-05-10T04:48:42.263 INFO:teuthology.orchestra.run.smithi117.stdout:(33/153): ceph-prometheus-alerts-18.2.2-1330.g5 217 kB/s | 16 kB 00:00 2024-05-10T04:48:42.396 INFO:teuthology.orchestra.run.smithi117.stdout:(34/153): ceph-volume-18.2.2-1330.g50174015.el8 1.9 MB/s | 263 kB 00:00 2024-05-10T04:48:42.409 INFO:teuthology.orchestra.run.smithi047.stdout:(13/153): libcephfs2-18.2.2-1330.g50174015.el8. 2.6 MB/s | 756 kB 00:00 2024-05-10T04:48:42.481 INFO:teuthology.orchestra.run.smithi117.stdout:(35/153): ceph-mgr-diskprediction-local-18.2.2- 5.1 MB/s | 7.4 MB 00:01 2024-05-10T04:48:42.491 INFO:teuthology.orchestra.run.smithi047.stdout:(14/153): libcephsqlite-18.2.2-1330.g50174015.e 1.6 MB/s | 139 kB 00:00 2024-05-10T04:48:42.522 INFO:teuthology.orchestra.run.smithi117.stdout:(36/153): cephadm-18.2.2-1330.g50174015.el8.noa 1.3 MB/s | 173 kB 00:00 2024-05-10T04:48:42.548 INFO:teuthology.orchestra.run.smithi117.stdout:(37/153): cephfs-top-18.2.2-1330.g50174015.el8. 271 kB/s | 18 kB 00:00 2024-05-10T04:48:42.567 INFO:teuthology.orchestra.run.smithi047.stdout:(15/153): librados-devel-18.2.2-1330.g50174015. 1.8 MB/s | 139 kB 00:00 2024-05-10T04:48:42.750 INFO:teuthology.orchestra.run.smithi047.stdout:(16/153): libradosstriper1-18.2.2-1330.g5017401 2.5 MB/s | 461 kB 00:00 2024-05-10T04:48:43.247 INFO:teuthology.orchestra.run.smithi117.stdout:(38/153): bison-3.0.4-10.el8.x86_64.rpm 984 kB/s | 688 kB 00:00 2024-05-10T04:48:43.281 INFO:teuthology.orchestra.run.smithi117.stdout:(39/153): automake-1.16.1-8.el8.noarch.rpm 975 kB/s | 740 kB 00:00 2024-05-10T04:48:43.381 INFO:teuthology.orchestra.run.smithi117.stdout:(40/153): flex-2.6.1-9.el8.x86_64.rpm 2.3 MB/s | 320 kB 00:00 2024-05-10T04:48:43.406 INFO:teuthology.orchestra.run.smithi117.stdout:(41/153): jq-1.6-8.el8.x86_64.rpm 1.6 MB/s | 203 kB 00:00 2024-05-10T04:48:43.501 INFO:teuthology.orchestra.run.smithi047.stdout:(17/153): ceph-osd-18.2.2-1330.g50174015.el8.x8 1.7 MB/s | 19 MB 00:10 2024-05-10T04:48:43.507 INFO:teuthology.orchestra.run.smithi117.stdout:(42/153): libpq-13.5-1.el8.x86_64.rpm 1.5 MB/s | 198 kB 00:00 2024-05-10T04:48:43.565 INFO:teuthology.orchestra.run.smithi117.stdout:(43/153): librdkafka-1.6.1-1.el8.x86_64.rpm 4.2 MB/s | 677 kB 00:00 2024-05-10T04:48:43.567 INFO:teuthology.orchestra.run.smithi047.stdout:(18/153): python3-ceph-argparse-18.2.2-1330.g50 674 kB/s | 45 kB 00:00 2024-05-10T04:48:43.643 INFO:teuthology.orchestra.run.smithi047.stdout:(19/153): python3-ceph-common-18.2.2-1330.g5017 1.7 MB/s | 129 kB 00:00 2024-05-10T04:48:43.674 INFO:teuthology.orchestra.run.smithi117.stdout:(44/153): libtool-2.4.6-25.el8.x86_64.rpm 4.2 MB/s | 709 kB 00:00 2024-05-10T04:48:43.699 INFO:teuthology.orchestra.run.smithi117.stdout:(45/153): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.9 MB/s | 259 kB 00:00 2024-05-10T04:48:43.785 INFO:teuthology.orchestra.run.smithi047.stdout:(20/153): python3-cephfs-18.2.2-1330.g50174015. 1.4 MB/s | 197 kB 00:00 2024-05-10T04:48:43.791 INFO:teuthology.orchestra.run.smithi117.stdout:(46/153): oniguruma-6.8.2-3.el8.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-05-10T04:48:43.985 INFO:teuthology.orchestra.run.smithi047.stdout:(21/153): python3-rados-18.2.2-1330.g50174015.e 1.8 MB/s | 371 kB 00:00 2024-05-10T04:48:44.075 INFO:teuthology.orchestra.run.smithi117.stdout:(47/153): openblas-0.3.15-4.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2024-05-10T04:48:44.185 INFO:teuthology.orchestra.run.smithi047.stdout:(22/153): python3-rbd-18.2.2-1330.g50174015.el8 1.8 MB/s | 364 kB 00:00 2024-05-10T04:48:44.217 INFO:teuthology.orchestra.run.smithi117.stdout:(48/153): openblas-threads-0.3.15-4.el8.x86_64. 11 MB/s | 4.9 MB 00:00 2024-05-10T04:48:44.267 INFO:teuthology.orchestra.run.smithi117.stdout:(49/153): postgresql-10.23-2.module_el8+572+929 8.2 MB/s | 1.6 MB 00:00 2024-05-10T04:48:44.277 INFO:teuthology.orchestra.run.smithi047.stdout:(23/153): python3-rgw-18.2.2-1330.g50174015.el8 1.1 MB/s | 107 kB 00:00 2024-05-10T04:48:44.367 INFO:teuthology.orchestra.run.smithi117.stdout:(50/153): postgresql-contrib-10.23-2.module_el8 5.9 MB/s | 901 kB 00:00 2024-05-10T04:48:44.378 INFO:teuthology.orchestra.run.smithi047.stdout:(24/153): rbd-fuse-18.2.2-1330.g50174015.el8.x8 918 kB/s | 91 kB 00:00 2024-05-10T04:48:44.734 INFO:teuthology.orchestra.run.smithi117.stdout:(51/153): postgresql-server-10.23-2.module_el8+ 11 MB/s | 5.1 MB 00:00 2024-05-10T04:48:44.801 INFO:teuthology.orchestra.run.smithi117.stdout:(52/153): python3-babel-2.5.1-7.el8.noarch.rpm 11 MB/s | 4.8 MB 00:00 2024-05-10T04:48:44.868 INFO:teuthology.orchestra.run.smithi117.stdout:(53/153): python3-jinja2-2.10.1-4.el8.noarch.rp 4.2 MB/s | 578 kB 00:00 2024-05-10T04:48:44.911 INFO:teuthology.orchestra.run.smithi047.stdout:(25/153): librgw2-18.2.2-1330.g50174015.el8.x86 3.3 MB/s | 7.2 MB 00:02 2024-05-10T04:48:44.918 INFO:teuthology.orchestra.run.smithi117.stdout:(54/153): python3-jsonpatch-1.21-2.el8.noarch.r 227 kB/s | 27 kB 00:00 2024-05-10T04:48:44.985 INFO:teuthology.orchestra.run.smithi117.stdout:(55/153): python3-jsonpointer-1.10-11.el8.noarc 171 kB/s | 20 kB 00:00 2024-05-10T04:48:45.044 INFO:teuthology.orchestra.run.smithi117.stdout:(56/153): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-05-10T04:48:45.061 INFO:teuthology.orchestra.run.smithi047.stdout:(26/153): rbd-nbd-18.2.2-1330.g50174015.el8.x86 1.2 MB/s | 179 kB 00:00 2024-05-10T04:48:45.102 INFO:teuthology.orchestra.run.smithi117.stdout:(57/153): python3-markupsafe-0.23-19.el8.x86_64 331 kB/s | 39 kB 00:00 2024-05-10T04:48:45.128 INFO:teuthology.orchestra.run.smithi047.stdout:(27/153): ceph-grafana-dashboards-18.2.2-1330.g 366 kB/s | 24 kB 00:00 2024-05-10T04:48:45.228 INFO:teuthology.orchestra.run.smithi047.stdout:(28/153): ceph-mgr-cephadm-18.2.2-1330.g5017401 1.4 MB/s | 138 kB 00:00 2024-05-10T04:48:45.253 INFO:teuthology.orchestra.run.smithi117.stdout:(58/153): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.5 MB/s | 225 kB 00:00 2024-05-10T04:48:45.478 INFO:teuthology.orchestra.run.smithi117.stdout:(59/153): python3-numpy-1.14.3-10.el8.x86_64.rp 8.6 MB/s | 3.7 MB 00:00 2024-05-10T04:48:45.503 INFO:teuthology.orchestra.run.smithi117.stdout:(60/153): python3-prettytable-0.7.2-14.el8.noar 175 kB/s | 44 kB 00:00 2024-05-10T04:48:45.604 INFO:teuthology.orchestra.run.smithi117.stdout:(61/153): python3-pyOpenSSL-19.0.0-1.el8.noarch 827 kB/s | 103 kB 00:00 2024-05-10T04:48:45.629 INFO:teuthology.orchestra.run.smithi117.stdout:(62/153): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.0 MB/s | 126 kB 00:00 2024-05-10T04:48:45.738 INFO:teuthology.orchestra.run.smithi117.stdout:(63/153): python3-pyasn1-modules-0.3.7-6.el8.no 823 kB/s | 110 kB 00:00 2024-05-10T04:48:45.763 INFO:teuthology.orchestra.run.smithi117.stdout:(64/153): python3-pytz-2017.2-11.el8.noarch.rpm 427 kB/s | 57 kB 00:00 2024-05-10T04:48:45.812 INFO:teuthology.orchestra.run.smithi047.stdout:(29/153): rbd-mirror-18.2.2-1330.g50174015.el8. 2.3 MB/s | 3.3 MB 00:01 2024-05-10T04:48:45.880 INFO:teuthology.orchestra.run.smithi117.stdout:(65/153): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2024-05-10T04:48:45.988 INFO:teuthology.orchestra.run.smithi117.stdout:(66/153): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2024-05-10T04:48:46.097 INFO:teuthology.orchestra.run.smithi117.stdout:(67/153): uuid-1.6.2-43.el8.x86_64.rpm 592 kB/s | 64 kB 00:00 2024-05-10T04:48:46.206 INFO:teuthology.orchestra.run.smithi117.stdout:(68/153): xmlstarlet-1.6.1-20.el8.x86_64.rpm 652 kB/s | 71 kB 00:00 2024-05-10T04:48:46.390 INFO:teuthology.orchestra.run.smithi117.stdout:(69/153): python3-scipy-1.0.0-21.module_el8+762 22 MB/s | 14 MB 00:00 2024-05-10T04:48:46.404 INFO:teuthology.orchestra.run.smithi047.stdout:(30/153): ceph-mgr-dashboard-18.2.2-1330.g50174 3.0 MB/s | 3.5 MB 00:01 2024-05-10T04:48:46.415 INFO:teuthology.orchestra.run.smithi117.stdout:(70/153): elfutils-libelf-devel-0.190-2.el8.x86 298 kB/s | 62 kB 00:00 2024-05-10T04:48:46.465 INFO:teuthology.orchestra.run.smithi117.stdout:(71/153): keyutils-libs-devel-1.5.10-9.el8.x86_ 968 kB/s | 48 kB 00:00 2024-05-10T04:48:46.490 INFO:teuthology.orchestra.run.smithi117.stdout:(72/153): fuse-2.9.7-19.el8.x86_64.rpm 831 kB/s | 83 kB 00:00 2024-05-10T04:48:46.524 INFO:teuthology.orchestra.run.smithi117.stdout:(73/153): libaio-devel-0.3.112-1.el8.x86_64.rpm 564 kB/s | 19 kB 00:00 2024-05-10T04:48:46.529 INFO:teuthology.orchestra.run.smithi047.stdout:(31/153): ceph-mgr-modules-core-18.2.2-1330.g50 1.9 MB/s | 246 kB 00:00 2024-05-10T04:48:46.557 INFO:teuthology.orchestra.run.smithi117.stdout:(74/153): libcom_err-devel-1.45.6-5.el8.x86_64. 1.1 MB/s | 39 kB 00:00 2024-05-10T04:48:46.583 INFO:teuthology.orchestra.run.smithi117.stdout:(75/153): krb5-devel-1.18.2-22.el8.x86_64.rpm 4.7 MB/s | 561 kB 00:00 2024-05-10T04:48:46.596 INFO:teuthology.orchestra.run.smithi047.stdout:(32/153): ceph-mgr-rook-18.2.2-1330.g50174015.e 740 kB/s | 49 kB 00:00 2024-05-10T04:48:46.633 INFO:teuthology.orchestra.run.smithi117.stdout:(76/153): libquadmath-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2024-05-10T04:48:46.658 INFO:teuthology.orchestra.run.smithi117.stdout:(77/153): libgfortran-8.5.0-22.el8.x86_64.rpm 6.3 MB/s | 645 kB 00:00 2024-05-10T04:48:46.663 INFO:teuthology.orchestra.run.smithi047.stdout:(33/153): ceph-prometheus-alerts-18.2.2-1330.g5 245 kB/s | 16 kB 00:00 2024-05-10T04:48:46.683 INFO:teuthology.orchestra.run.smithi117.stdout:(78/153): librabbitmq-0.9.0-5.el8.x86_64.rpm 938 kB/s | 47 kB 00:00 2024-05-10T04:48:46.709 INFO:teuthology.orchestra.run.smithi117.stdout:(79/153): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-05-10T04:48:46.734 INFO:teuthology.orchestra.run.smithi117.stdout:(80/153): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-05-10T04:48:46.759 INFO:teuthology.orchestra.run.smithi117.stdout:(81/153): libuuid-devel-2.32.1-46.el8.x86_64.rp 2.0 MB/s | 100 kB 00:00 2024-05-10T04:48:46.785 INFO:teuthology.orchestra.run.smithi117.stdout:(82/153): libverto-devel-0.3.2-2.el8.x86_64.rpm 360 kB/s | 18 kB 00:00 2024-05-10T04:48:46.788 INFO:teuthology.orchestra.run.smithi047.stdout:(34/153): ceph-volume-18.2.2-1330.g50174015.el8 2.1 MB/s | 263 kB 00:00 2024-05-10T04:48:46.810 INFO:teuthology.orchestra.run.smithi117.stdout:(83/153): libzstd-devel-1.4.4-1.el8.x86_64.rpm 871 kB/s | 44 kB 00:00 2024-05-10T04:48:46.860 INFO:teuthology.orchestra.run.smithi117.stdout:(84/153): pcre2-devel-10.32-3.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2024-05-10T04:48:46.864 INFO:teuthology.orchestra.run.smithi047.stdout:(35/153): cephadm-18.2.2-1330.g50174015.el8.noa 2.3 MB/s | 173 kB 00:00 2024-05-10T04:48:46.902 INFO:teuthology.orchestra.run.smithi117.stdout:(85/153): pcre2-utf16-10.32-3.el8.x86_64.rpm 5.4 MB/s | 229 kB 00:00 2024-05-10T04:48:46.931 INFO:teuthology.orchestra.run.smithi047.stdout:(36/153): cephfs-top-18.2.2-1330.g50174015.el8. 272 kB/s | 18 kB 00:00 2024-05-10T04:48:46.944 INFO:teuthology.orchestra.run.smithi117.stdout:(86/153): pcre2-utf32-10.32-3.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2024-05-10T04:48:47.020 INFO:teuthology.orchestra.run.smithi117.stdout:(87/153): python3-cffi-1.11.5-6.el8.x86_64.rpm 3.2 MB/s | 249 kB 00:00 2024-05-10T04:48:47.078 INFO:teuthology.orchestra.run.smithi117.stdout:(88/153): python3-cryptography-3.2.1-7.el8.x86_ 11 MB/s | 641 kB 00:00 2024-05-10T04:48:47.145 INFO:teuthology.orchestra.run.smithi117.stdout:(89/153): python3-jwt-1.6.1-2.el8.noarch.rpm 641 kB/s | 43 kB 00:00 2024-05-10T04:48:47.206 INFO:teuthology.orchestra.run.smithi117.stdout:(90/153): openssl-devel-1.1.1k-12.el8.x86_64.rp 7.6 MB/s | 3.2 MB 00:00 2024-05-10T04:48:47.229 INFO:teuthology.orchestra.run.smithi117.stdout:(91/153): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2024-05-10T04:48:47.254 INFO:teuthology.orchestra.run.smithi117.stdout:(92/153): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2024-05-10T04:48:47.279 INFO:teuthology.orchestra.run.smithi117.stdout:(93/153): python3-requests-oauthlib-1.0.0-1.el8 854 kB/s | 43 kB 00:00 2024-05-10T04:48:47.305 INFO:teuthology.orchestra.run.smithi117.stdout:(94/153): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 1.4 MB/s | 74 kB 00:00 2024-05-10T04:48:47.330 INFO:teuthology.orchestra.run.smithi117.stdout:(95/153): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-05-10T04:48:47.414 INFO:teuthology.orchestra.run.smithi117.stdout:(96/153): python3-packaging-16.8-9.el8.noarch.r 443 kB/s | 48 kB 00:00 2024-05-10T04:48:47.464 INFO:teuthology.orchestra.run.smithi117.stdout:(97/153): gperftools-libs-2.7-9.el8.x86_64.rpm 2.2 MB/s | 306 kB 00:00 2024-05-10T04:48:47.490 INFO:teuthology.orchestra.run.smithi117.stdout:(98/153): liboath-2.6.2-3.el8.x86_64.rpm 781 kB/s | 59 kB 00:00 2024-05-10T04:48:47.515 INFO:teuthology.orchestra.run.smithi117.stdout:(99/153): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-05-10T04:48:47.549 INFO:teuthology.orchestra.run.smithi117.stdout:(100/153): python3-bcrypt-3.1.6-2.el8.1.x86_64. 1.3 MB/s | 44 kB 00:00 2024-05-10T04:48:47.582 INFO:teuthology.orchestra.run.smithi117.stdout:(101/153): python3-asyncssh-2.7.0-2.el8.noarch. 5.1 MB/s | 476 kB 00:00 2024-05-10T04:48:47.608 INFO:teuthology.orchestra.run.smithi117.stdout:(102/153): python3-beautifulsoup4-4.6.3-2.el8.1 3.1 MB/s | 185 kB 00:00 2024-05-10T04:48:47.633 INFO:teuthology.orchestra.run.smithi117.stdout:(103/153): python3-cachetools-3.1.1-4.el8.noarc 659 kB/s | 33 kB 00:00 2024-05-10T04:48:47.648 INFO:teuthology.orchestra.run.smithi047.stdout:(37/153): automake-1.16.1-8.el8.noarch.rpm 1.0 MB/s | 740 kB 00:00 2024-05-10T04:48:47.658 INFO:teuthology.orchestra.run.smithi117.stdout:(104/153): python3-certifi-2018.10.15-7.el8.noa 326 kB/s | 16 kB 00:00 2024-05-10T04:48:47.683 INFO:teuthology.orchestra.run.smithi117.stdout:(105/153): python3-cheroot-8.5.2-1.el8.noarch.r 3.4 MB/s | 173 kB 00:00 2024-05-10T04:48:47.717 INFO:teuthology.orchestra.run.smithi117.stdout:(106/153): python3-cherrypy-18.4.0-1.el8.noarch 6.4 MB/s | 384 kB 00:00 2024-05-10T04:48:47.742 INFO:teuthology.orchestra.run.smithi117.stdout:(107/153): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2024-05-10T04:48:47.768 INFO:teuthology.orchestra.run.smithi117.stdout:(108/153): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-05-10T04:48:47.793 INFO:teuthology.orchestra.run.smithi117.stdout:(109/153): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2024-05-10T04:48:47.819 INFO:teuthology.orchestra.run.smithi047.stdout:(38/153): ceph-mgr-diskprediction-local-18.2.2- 3.7 MB/s | 7.4 MB 00:02 2024-05-10T04:48:47.826 INFO:teuthology.orchestra.run.smithi117.stdout:(110/153): python3-logutils-0.3.5-11.el8.noarch 1.4 MB/s | 49 kB 00:00 2024-05-10T04:48:47.849 INFO:teuthology.orchestra.run.smithi047.stdout:(39/153): bison-3.0.4-10.el8.x86_64.rpm 3.4 MB/s | 688 kB 00:00 2024-05-10T04:48:47.869 INFO:teuthology.orchestra.run.smithi117.stdout:(111/153): python3-kubernetes-11.0.0-6.el8.noar 12 MB/s | 1.2 MB 00:00 2024-05-10T04:48:47.894 INFO:teuthology.orchestra.run.smithi117.stdout:(112/153): python3-more-itertools-7.2.0-3.el8.n 879 kB/s | 59 kB 00:00 2024-05-10T04:48:47.911 INFO:teuthology.orchestra.run.smithi117.stdout:(113/153): python3-natsort-7.1.1-2.el8.noarch.r 1.4 MB/s | 60 kB 00:00 2024-05-10T04:48:47.936 INFO:teuthology.orchestra.run.smithi117.stdout:(114/153): python3-pecan-1.3.2-9.el8.noarch.rpm 6.7 MB/s | 283 kB 00:00 2024-05-10T04:48:47.961 INFO:teuthology.orchestra.run.smithi117.stdout:(115/153): python3-portend-2.6-1.el8.noarch.rpm 311 kB/s | 16 kB 00:00 2024-05-10T04:48:47.978 INFO:teuthology.orchestra.run.smithi117.stdout:(116/153): python3-repoze-lru-0.7-6.el8.noarch. 808 kB/s | 34 kB 00:00 2024-05-10T04:48:47.999 INFO:teuthology.orchestra.run.smithi047.stdout:(40/153): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-05-10T04:48:48.003 INFO:teuthology.orchestra.run.smithi117.stdout:(117/153): python3-routes-2.4.1-12.el8.noarch.r 4.6 MB/s | 196 kB 00:00 2024-05-10T04:48:48.029 INFO:teuthology.orchestra.run.smithi117.stdout:(118/153): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2024-05-10T04:48:48.054 INFO:teuthology.orchestra.run.smithi117.stdout:(119/153): python3-simplegeneric-0.8.1-17.el8.n 374 kB/s | 19 kB 00:00 2024-05-10T04:48:48.079 INFO:teuthology.orchestra.run.smithi117.stdout:(120/153): python3-singledispatch-3.4.0.3-18.el 479 kB/s | 24 kB 00:00 2024-05-10T04:48:48.105 INFO:teuthology.orchestra.run.smithi117.stdout:(121/153): python3-tempora-1.14.1-5.el8.noarch. 582 kB/s | 29 kB 00:00 2024-05-10T04:48:48.116 INFO:teuthology.orchestra.run.smithi047.stdout:(41/153): libpq-13.5-1.el8.x86_64.rpm 1.7 MB/s | 198 kB 00:00 2024-05-10T04:48:48.130 INFO:teuthology.orchestra.run.smithi117.stdout:(122/153): python3-trustme-0.6.0-4.el8.noarch.r 548 kB/s | 27 kB 00:00 2024-05-10T04:48:48.291 INFO:teuthology.orchestra.run.smithi047.stdout:(42/153): librdkafka-1.6.1-1.el8.x86_64.rpm 3.8 MB/s | 677 kB 00:00 2024-05-10T04:48:48.425 INFO:teuthology.orchestra.run.smithi047.stdout:(43/153): flex-2.6.1-9.el8.x86_64.rpm 525 kB/s | 320 kB 00:00 2024-05-10T04:48:48.458 INFO:teuthology.orchestra.run.smithi047.stdout:(44/153): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2024-05-10T04:48:48.584 INFO:teuthology.orchestra.run.smithi047.stdout:(45/153): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-05-10T04:48:48.605 INFO:teuthology.orchestra.run.smithi117.stdout:(123/153): ceph-test-18.2.2-1330.g50174015.el8. 4.0 MB/s | 49 MB 00:12 2024-05-10T04:48:48.618 INFO:teuthology.orchestra.run.smithi047.stdout:(46/153): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.3 MB/s | 259 kB 00:00 2024-05-10T04:48:48.630 INFO:teuthology.orchestra.run.smithi117.stdout:(124/153): python3-waitress-1.4.3-1.el8.noarch. 486 kB/s | 255 kB 00:00 2024-05-10T04:48:48.664 INFO:teuthology.orchestra.run.smithi117.stdout:(125/153): python3-webob-1.8.5-1.el8.1.noarch.r 470 kB/s | 251 kB 00:00 2024-05-10T04:48:48.690 INFO:teuthology.orchestra.run.smithi117.stdout:(126/153): python3-websocket-client-0.56.0-5.el 735 kB/s | 61 kB 00:00 2024-05-10T04:48:48.715 INFO:teuthology.orchestra.run.smithi117.stdout:(127/153): python3-webtest-2.0.33-1.el8.noarch. 1.0 MB/s | 85 kB 00:00 2024-05-10T04:48:48.740 INFO:teuthology.orchestra.run.smithi117.stdout:(128/153): python3-zc-lockfile-2.0-2.el8.noarch 305 kB/s | 23 kB 00:00 2024-05-10T04:48:48.968 INFO:teuthology.orchestra.run.smithi047.stdout:(47/153): openblas-0.3.15-4.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2024-05-10T04:48:48.973 INFO:teuthology.orchestra.run.smithi117.stdout:(129/153): thrift-0.13.0-2.el8.x86_64.rpm 6.1 MB/s | 1.7 MB 00:00 2024-05-10T04:48:49.160 INFO:teuthology.orchestra.run.smithi047.stdout:(48/153): postgresql-10.23-2.module_el8+572+929 8.2 MB/s | 1.6 MB 00:00 2024-05-10T04:48:49.182 INFO:teuthology.orchestra.run.smithi117.stdout:(130/153): librados2-18.2.2-1330.g50174015.el8. 8.0 MB/s | 3.5 MB 00:00 2024-05-10T04:48:49.235 INFO:teuthology.orchestra.run.smithi047.stdout:(49/153): openblas-threads-0.3.15-4.el8.x86_64. 7.9 MB/s | 4.9 MB 00:00 2024-05-10T04:48:49.310 INFO:teuthology.orchestra.run.smithi047.stdout:(50/153): postgresql-contrib-10.23-2.module_el8 5.9 MB/s | 901 kB 00:00 2024-05-10T04:48:49.358 INFO:teuthology.orchestra.run.smithi117.stdout:(131/153): librbd1-18.2.2-1330.g50174015.el8.x8 5.7 MB/s | 3.5 MB 00:00 2024-05-10T04:48:49.441 INFO:teuthology.orchestra.run.smithi117.stdout:(132/153): NetworkManager-1.40.16-15.el8.x86_64 4.9 MB/s | 2.3 MB 00:00 2024-05-10T04:48:49.541 INFO:teuthology.orchestra.run.smithi117.stdout:(133/153): NetworkManager-tui-1.40.16-15.el8.x8 3.5 MB/s | 356 kB 00:00 2024-05-10T04:48:49.600 INFO:teuthology.orchestra.run.smithi117.stdout:(134/153): NetworkManager-libnm-1.40.16-15.el8. 4.6 MB/s | 1.9 MB 00:00 2024-05-10T04:48:49.625 INFO:teuthology.orchestra.run.smithi117.stdout:(135/153): acl-2.2.53-3.el8.x86_64.rpm 989 kB/s | 83 kB 00:00 2024-05-10T04:48:49.636 INFO:teuthology.orchestra.run.smithi047.stdout:(51/153): postgresql-server-10.23-2.module_el8+ 13 MB/s | 5.1 MB 00:00 2024-05-10T04:48:49.650 INFO:teuthology.orchestra.run.smithi117.stdout:(136/153): NetworkManager-team-1.40.16-15.el8.x 550 kB/s | 161 kB 00:00 2024-05-10T04:48:49.676 INFO:teuthology.orchestra.run.smithi117.stdout:(137/153): elfutils-debuginfod-client-0.190-2.e 1.0 MB/s | 77 kB 00:00 2024-05-10T04:48:49.701 INFO:teuthology.orchestra.run.smithi117.stdout:(138/153): elfutils-libelf-0.190-2.el8.x86_64.r 3.0 MB/s | 233 kB 00:00 2024-05-10T04:48:49.734 INFO:teuthology.orchestra.run.smithi117.stdout:(139/153): elfutils-libs-0.190-2.el8.x86_64.rpm 3.6 MB/s | 305 kB 00:00 2024-05-10T04:48:49.768 INFO:teuthology.orchestra.run.smithi117.stdout:(140/153): libacl-2.2.53-3.el8.x86_64.rpm 523 kB/s | 35 kB 00:00 2024-05-10T04:48:49.786 INFO:teuthology.orchestra.run.smithi047.stdout:(52/153): python3-jinja2-2.10.1-4.el8.noarch.rp 3.8 MB/s | 578 kB 00:00 2024-05-10T04:48:49.802 INFO:teuthology.orchestra.run.smithi117.stdout:(141/153): libacl-devel-2.2.53-3.el8.x86_64.rpm 1.2 MB/s | 85 kB 00:00 2024-05-10T04:48:49.836 INFO:teuthology.orchestra.run.smithi117.stdout:(142/153): iproute-6.2.0-5.el8.x86_64.rpm 5.2 MB/s | 854 kB 00:00 2024-05-10T04:48:49.861 INFO:teuthology.orchestra.run.smithi117.stdout:(143/153): libblkid-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 221 kB 00:00 2024-05-10T04:48:49.894 INFO:teuthology.orchestra.run.smithi047.stdout:(53/153): python3-babel-2.5.1-7.el8.noarch.rpm 8.2 MB/s | 4.8 MB 00:00 2024-05-10T04:48:49.920 INFO:teuthology.orchestra.run.smithi047.stdout:(54/153): python3-jsonpatch-1.21-2.el8.noarch.r 199 kB/s | 27 kB 00:00 2024-05-10T04:48:49.936 INFO:teuthology.orchestra.run.smithi117.stdout:(144/153): libmount-2.32.1-46.el8.x86_64.rpm 2.3 MB/s | 237 kB 00:00 2024-05-10T04:48:49.961 INFO:teuthology.orchestra.run.smithi117.stdout:(145/153): libfdisk-2.32.1-46.el8.x86_64.rpm 1.6 MB/s | 254 kB 00:00 2024-05-10T04:48:50.005 INFO:teuthology.orchestra.run.smithi117.stdout:(146/153): libsmartcols-2.32.1-46.el8.x86_64.rp 1.2 MB/s | 180 kB 00:00 2024-05-10T04:48:50.020 INFO:teuthology.orchestra.run.smithi047.stdout:(55/153): python3-jsonpointer-1.10-11.el8.noarc 159 kB/s | 20 kB 00:00 2024-05-10T04:48:50.037 INFO:teuthology.orchestra.run.smithi117.stdout:(147/153): libuuid-2.32.1-46.el8.x86_64.rpm 991 kB/s | 99 kB 00:00 2024-05-10T04:48:50.054 INFO:teuthology.orchestra.run.smithi047.stdout:(56/153): python3-mako-1.0.6-14.el8.noarch.rpm 1.1 MB/s | 157 kB 00:00 2024-05-10T04:48:50.120 INFO:teuthology.orchestra.run.smithi117.stdout:(148/153): openssl-1.1.1k-12.el8.x86_64.rpm 4.5 MB/s | 738 kB 00:00 2024-05-10T04:48:50.145 INFO:teuthology.orchestra.run.smithi047.stdout:(57/153): python3-markupsafe-0.23-19.el8.x86_64 310 kB/s | 39 kB 00:00 2024-05-10T04:48:50.170 INFO:teuthology.orchestra.run.smithi117.stdout:(149/153): openssl-libs-1.1.1k-12.el8.x86_64.rp 8.9 MB/s | 1.5 MB 00:00 2024-05-10T04:48:50.196 INFO:teuthology.orchestra.run.smithi117.stdout:(150/153): util-linux-user-2.32.1-46.el8.x86_64 1.3 MB/s | 103 kB 00:00 2024-05-10T04:48:50.246 INFO:teuthology.orchestra.run.smithi117.stdout:(151/153): xfsdump-3.1.8-7.el8.x86_64.rpm 4.4 MB/s | 334 kB 00:00 2024-05-10T04:48:50.279 INFO:teuthology.orchestra.run.smithi047.stdout:(58/153): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.6 MB/s | 225 kB 00:00 2024-05-10T04:48:50.330 INFO:teuthology.orchestra.run.smithi117.stdout:(152/153): util-linux-2.32.1-46.el8.x86_64.rpm 8.9 MB/s | 2.6 MB 00:00 2024-05-10T04:48:50.363 INFO:teuthology.orchestra.run.smithi117.stdout:(153/153): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2024-05-10T04:48:50.366 INFO:teuthology.orchestra.run.smithi117.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:48:50.367 INFO:teuthology.orchestra.run.smithi117.stdout:Total 8.3 MB/s | 227 MB 00:27 2024-05-10T04:48:50.371 INFO:teuthology.orchestra.run.smithi047.stdout:(59/153): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2024-05-10T04:48:50.396 INFO:teuthology.orchestra.run.smithi047.stdout:(60/153): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2024-05-10T04:48:50.480 INFO:teuthology.orchestra.run.smithi047.stdout:(61/153): python3-pyOpenSSL-19.0.0-1.el8.noarch 955 kB/s | 103 kB 00:00 2024-05-10T04:48:50.513 INFO:teuthology.orchestra.run.smithi047.stdout:(62/153): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2024-05-10T04:48:50.589 INFO:teuthology.orchestra.run.smithi047.stdout:(63/153): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2024-05-10T04:48:50.623 INFO:teuthology.orchestra.run.smithi047.stdout:(64/153): python3-pytz-2017.2-11.el8.noarch.rpm 525 kB/s | 57 kB 00:00 2024-05-10T04:48:50.748 INFO:teuthology.orchestra.run.smithi047.stdout:(65/153): python3-werkzeug-0.12.2-4.el8.noarch. 3.6 MB/s | 457 kB 00:00 2024-05-10T04:48:50.865 INFO:teuthology.orchestra.run.smithi047.stdout:(66/153): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2024-05-10T04:48:50.973 INFO:teuthology.orchestra.run.smithi047.stdout:(67/153): uuid-1.6.2-43.el8.x86_64.rpm 592 kB/s | 64 kB 00:00 2024-05-10T04:48:51.182 INFO:teuthology.orchestra.run.smithi047.stdout:(68/153): python3-scipy-1.0.0-21.module_el8+762 24 MB/s | 14 MB 00:00 2024-05-10T04:48:51.207 INFO:teuthology.orchestra.run.smithi047.stdout:(69/153): xmlstarlet-1.6.1-20.el8.x86_64.rpm 302 kB/s | 71 kB 00:00 2024-05-10T04:48:51.282 INFO:teuthology.orchestra.run.smithi047.stdout:(70/153): elfutils-libelf-devel-0.190-2.el8.x86 622 kB/s | 62 kB 00:00 2024-05-10T04:48:51.300 INFO:teuthology.orchestra.run.smithi047.stdout:(71/153): fuse-2.9.7-19.el8.x86_64.rpm 907 kB/s | 83 kB 00:00 2024-05-10T04:48:51.333 INFO:teuthology.orchestra.run.smithi047.stdout:(72/153): keyutils-libs-devel-1.5.10-9.el8.x86_ 957 kB/s | 48 kB 00:00 2024-05-10T04:48:51.375 INFO:teuthology.orchestra.run.smithi047.stdout:(73/153): libaio-devel-0.3.112-1.el8.x86_64.rpm 448 kB/s | 19 kB 00:00 2024-05-10T04:48:51.442 INFO:teuthology.orchestra.run.smithi047.stdout:(74/153): libcom_err-devel-1.45.6-5.el8.x86_64. 586 kB/s | 39 kB 00:00 2024-05-10T04:48:51.476 INFO:teuthology.orchestra.run.smithi047.stdout:(75/153): krb5-devel-1.18.2-22.el8.x86_64.rpm 3.1 MB/s | 561 kB 00:00 2024-05-10T04:48:51.526 INFO:teuthology.orchestra.run.smithi047.stdout:(76/153): libquadmath-8.5.0-22.el8.x86_64.rpm 3.4 MB/s | 172 kB 00:00 2024-05-10T04:48:51.568 INFO:teuthology.orchestra.run.smithi047.stdout:(77/153): libgfortran-8.5.0-22.el8.x86_64.rpm 5.0 MB/s | 645 kB 00:00 2024-05-10T04:48:51.593 INFO:teuthology.orchestra.run.smithi047.stdout:(78/153): librabbitmq-0.9.0-5.el8.x86_64.rpm 704 kB/s | 47 kB 00:00 2024-05-10T04:48:51.619 INFO:teuthology.orchestra.run.smithi047.stdout:(79/153): libselinux-devel-2.9-8.el8.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-05-10T04:48:51.644 INFO:teuthology.orchestra.run.smithi047.stdout:(80/153): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-05-10T04:48:51.670 INFO:teuthology.orchestra.run.smithi047.stdout:(81/153): libuuid-devel-2.32.1-46.el8.x86_64.rp 1.9 MB/s | 100 kB 00:00 2024-05-10T04:48:51.686 INFO:teuthology.orchestra.run.smithi047.stdout:(82/153): libverto-devel-0.3.2-2.el8.x86_64.rpm 432 kB/s | 18 kB 00:00 2024-05-10T04:48:51.703 INFO:teuthology.orchestra.run.smithi047.stdout:(83/153): libzstd-devel-1.4.4-1.el8.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-05-10T04:48:51.787 INFO:teuthology.orchestra.run.smithi047.stdout:(84/153): pcre2-devel-10.32-3.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2024-05-10T04:48:51.837 INFO:teuthology.orchestra.run.smithi047.stdout:(85/153): pcre2-utf16-10.32-3.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-05-10T04:48:51.905 INFO:teuthology.orchestra.run.smithi047.stdout:(86/153): pcre2-utf32-10.32-3.el8.x86_64.rpm 3.2 MB/s | 220 kB 00:00 2024-05-10T04:48:51.988 INFO:teuthology.orchestra.run.smithi047.stdout:(87/153): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.9 MB/s | 249 kB 00:00 2024-05-10T04:48:52.055 INFO:teuthology.orchestra.run.smithi047.stdout:(88/153): openssl-devel-1.1.1k-12.el8.x86_64.rp 8.7 MB/s | 3.2 MB 00:00 2024-05-10T04:48:52.089 INFO:teuthology.orchestra.run.smithi047.stdout:(89/153): python3-cryptography-3.2.1-7.el8.x86_ 6.2 MB/s | 641 kB 00:00 2024-05-10T04:48:52.114 INFO:teuthology.orchestra.run.smithi047.stdout:(90/153): python3-jwt-1.6.1-2.el8.noarch.rpm 731 kB/s | 43 kB 00:00 2024-05-10T04:48:52.323 INFO:teuthology.orchestra.run.smithi047.stdout:(91/153): python3-oauthlib-2.1.0-1.el8.noarch.r 664 kB/s | 155 kB 00:00 2024-05-10T04:48:52.348 INFO:teuthology.orchestra.run.smithi047.stdout:(92/153): python3-pycparser-2.14-14.el8.noarch. 466 kB/s | 109 kB 00:00 2024-05-10T04:48:52.373 INFO:teuthology.orchestra.run.smithi047.stdout:(93/153): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2024-05-10T04:48:52.374 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction check 2024-05-10T04:48:52.415 INFO:teuthology.orchestra.run.smithi047.stdout:(94/153): zlib-devel-1.2.11-21.el8.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-05-10T04:48:52.432 INFO:teuthology.orchestra.run.smithi047.stdout:(95/153): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 889 kB/s | 74 kB 00:00 2024-05-10T04:48:52.525 INFO:teuthology.orchestra.run.smithi047.stdout:(96/153): python3-packaging-16.8-9.el8.noarch.r 443 kB/s | 48 kB 00:00 2024-05-10T04:48:52.733 INFO:teuthology.orchestra.run.smithi047.stdout:(97/153): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2024-05-10T04:48:52.758 INFO:teuthology.orchestra.run.smithi047.stdout:(98/153): liboath-2.6.2-3.el8.x86_64.rpm 252 kB/s | 59 kB 00:00 2024-05-10T04:48:52.783 INFO:teuthology.orchestra.run.smithi047.stdout:(99/153): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2024-05-10T04:48:52.834 INFO:teuthology.orchestra.run.smithi047.stdout:(100/153): python3-bcrypt-3.1.6-2.el8.1.x86_64. 869 kB/s | 44 kB 00:00 2024-05-10T04:48:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction check succeeded. 2024-05-10T04:48:52.837 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction test 2024-05-10T04:48:52.893 INFO:teuthology.orchestra.run.smithi047.stdout:(101/153): python3-beautifulsoup4-4.6.3-2.el8.1 3.1 MB/s | 185 kB 00:00 2024-05-10T04:48:52.926 INFO:teuthology.orchestra.run.smithi047.stdout:(102/153): python3-asyncssh-2.7.0-2.el8.noarch. 2.8 MB/s | 476 kB 00:00 2024-05-10T04:48:52.952 INFO:teuthology.orchestra.run.smithi047.stdout:(103/153): python3-cachetools-3.1.1-4.el8.noarc 565 kB/s | 33 kB 00:00 2024-05-10T04:48:52.977 INFO:teuthology.orchestra.run.smithi047.stdout:(104/153): python3-certifi-2018.10.15-7.el8.noa 327 kB/s | 16 kB 00:00 2024-05-10T04:48:53.010 INFO:teuthology.orchestra.run.smithi047.stdout:(105/153): python3-cheroot-8.5.2-1.el8.noarch.r 2.9 MB/s | 173 kB 00:00 2024-05-10T04:48:53.044 INFO:teuthology.orchestra.run.smithi047.stdout:(106/153): python3-cherrypy-18.4.0-1.el8.noarch 5.6 MB/s | 384 kB 00:00 2024-05-10T04:48:53.070 INFO:teuthology.orchestra.run.smithi047.stdout:(107/153): python3-google-auth-1.1.1-10.el8.noa 1.4 MB/s | 81 kB 00:00 2024-05-10T04:48:53.095 INFO:teuthology.orchestra.run.smithi047.stdout:(108/153): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2024-05-10T04:48:53.120 INFO:teuthology.orchestra.run.smithi047.stdout:(109/153): python3-jaraco-functools-2.0-4.el8.n 351 kB/s | 18 kB 00:00 2024-05-10T04:48:53.170 INFO:teuthology.orchestra.run.smithi047.stdout:(110/153): python3-logutils-0.3.5-11.el8.noarch 983 kB/s | 49 kB 00:00 2024-05-10T04:48:53.204 INFO:teuthology.orchestra.run.smithi047.stdout:(111/153): python3-kubernetes-11.0.0-6.el8.noar 11 MB/s | 1.2 MB 00:00 2024-05-10T04:48:53.229 INFO:teuthology.orchestra.run.smithi047.stdout:(112/153): python3-more-itertools-7.2.0-3.el8.n 1.0 MB/s | 59 kB 00:00 2024-05-10T04:48:53.254 INFO:teuthology.orchestra.run.smithi047.stdout:(113/153): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2024-05-10T04:48:53.297 INFO:teuthology.orchestra.run.smithi047.stdout:(114/153): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2024-05-10T04:48:53.322 INFO:teuthology.orchestra.run.smithi047.stdout:(115/153): python3-portend-2.6-1.el8.noarch.rpm 233 kB/s | 16 kB 00:00 2024-05-10T04:48:53.347 INFO:teuthology.orchestra.run.smithi047.stdout:(116/153): python3-repoze-lru-0.7-6.el8.noarch. 674 kB/s | 34 kB 00:00 2024-05-10T04:48:53.372 INFO:teuthology.orchestra.run.smithi047.stdout:(117/153): python3-routes-2.4.1-12.el8.noarch.r 3.8 MB/s | 196 kB 00:00 2024-05-10T04:48:53.397 INFO:teuthology.orchestra.run.smithi047.stdout:(118/153): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2024-05-10T04:48:53.423 INFO:teuthology.orchestra.run.smithi047.stdout:(119/153): python3-simplegeneric-0.8.1-17.el8.n 372 kB/s | 19 kB 00:00 2024-05-10T04:48:53.448 INFO:teuthology.orchestra.run.smithi047.stdout:(120/153): python3-singledispatch-3.4.0.3-18.el 477 kB/s | 24 kB 00:00 2024-05-10T04:48:53.474 INFO:teuthology.orchestra.run.smithi047.stdout:(121/153): python3-tempora-1.14.1-5.el8.noarch. 586 kB/s | 29 kB 00:00 2024-05-10T04:48:53.499 INFO:teuthology.orchestra.run.smithi047.stdout:(122/153): python3-trustme-0.6.0-4.el8.noarch.r 554 kB/s | 27 kB 00:00 2024-05-10T04:48:53.524 INFO:teuthology.orchestra.run.smithi047.stdout:(123/153): python3-waitress-1.4.3-1.el8.noarch. 5.0 MB/s | 255 kB 00:00 2024-05-10T04:48:53.558 INFO:teuthology.orchestra.run.smithi047.stdout:(124/153): python3-webob-1.8.5-1.el8.1.noarch.r 4.2 MB/s | 251 kB 00:00 2024-05-10T04:48:53.583 INFO:teuthology.orchestra.run.smithi047.stdout:(125/153): python3-websocket-client-0.56.0-5.el 1.0 MB/s | 61 kB 00:00 2024-05-10T04:48:53.608 INFO:teuthology.orchestra.run.smithi047.stdout:(126/153): python3-webtest-2.0.33-1.el8.noarch. 1.7 MB/s | 85 kB 00:00 2024-05-10T04:48:53.634 INFO:teuthology.orchestra.run.smithi047.stdout:(127/153): python3-zc-lockfile-2.0-2.el8.noarch 457 kB/s | 23 kB 00:00 2024-05-10T04:48:53.754 INFO:teuthology.orchestra.run.smithi047.stdout:(128/153): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2024-05-10T04:48:54.471 INFO:teuthology.orchestra.run.smithi117.stdout:Transaction test succeeded. 2024-05-10T04:48:54.475 INFO:teuthology.orchestra.run.smithi117.stdout:Running transaction 2024-05-10T04:48:54.810 INFO:teuthology.orchestra.run.smithi047.stdout:(129/153): ceph-test-18.2.2-1330.g50174015.el8. 3.8 MB/s | 49 MB 00:12 2024-05-10T04:48:54.868 INFO:teuthology.orchestra.run.smithi047.stdout:(130/153): librados2-18.2.2-1330.g50174015.el8. 2.9 MB/s | 3.5 MB 00:01 2024-05-10T04:48:54.974 INFO:teuthology.orchestra.run.smithi047.stdout:(131/153): librbd1-18.2.2-1330.g50174015.el8.x8 2.9 MB/s | 3.5 MB 00:01 2024-05-10T04:48:55.094 INFO:teuthology.orchestra.run.smithi047.stdout:(132/153): NetworkManager-1.40.16-15.el8.x86_64 8.1 MB/s | 2.3 MB 00:00 2024-05-10T04:48:55.119 INFO:teuthology.orchestra.run.smithi047.stdout:(133/153): NetworkManager-team-1.40.16-15.el8.x 1.1 MB/s | 161 kB 00:00 2024-05-10T04:48:55.161 INFO:teuthology.orchestra.run.smithi047.stdout:(134/153): NetworkManager-libnm-1.40.16-15.el8. 6.5 MB/s | 1.9 MB 00:00 2024-05-10T04:48:55.187 INFO:teuthology.orchestra.run.smithi047.stdout:(135/153): NetworkManager-tui-1.40.16-15.el8.x8 3.8 MB/s | 356 kB 00:00 2024-05-10T04:48:55.203 INFO:teuthology.orchestra.run.smithi047.stdout:(136/153): acl-2.2.53-3.el8.x86_64.rpm 990 kB/s | 83 kB 00:00 2024-05-10T04:48:55.229 INFO:teuthology.orchestra.run.smithi047.stdout:(137/153): elfutils-debuginfod-client-0.190-2.e 1.1 MB/s | 77 kB 00:00 2024-05-10T04:48:55.254 INFO:teuthology.orchestra.run.smithi047.stdout:(138/153): elfutils-libelf-0.190-2.el8.x86_64.r 3.4 MB/s | 233 kB 00:00 2024-05-10T04:48:55.280 INFO:teuthology.orchestra.run.smithi047.stdout:(139/153): elfutils-libs-0.190-2.el8.x86_64.rpm 3.9 MB/s | 305 kB 00:00 2024-05-10T04:48:55.304 INFO:teuthology.orchestra.run.smithi047.stdout:(140/153): libacl-2.2.53-3.el8.x86_64.rpm 695 kB/s | 35 kB 00:00 2024-05-10T04:48:55.331 INFO:teuthology.orchestra.run.smithi047.stdout:(141/153): libacl-devel-2.2.53-3.el8.x86_64.rpm 1.7 MB/s | 85 kB 00:00 2024-05-10T04:48:55.356 INFO:teuthology.orchestra.run.smithi047.stdout:(142/153): libblkid-2.32.1-46.el8.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-05-10T04:48:55.381 INFO:teuthology.orchestra.run.smithi047.stdout:(143/153): libfdisk-2.32.1-46.el8.x86_64.rpm 5.0 MB/s | 254 kB 00:00 2024-05-10T04:48:55.414 INFO:teuthology.orchestra.run.smithi047.stdout:(144/153): iproute-6.2.0-5.el8.x86_64.rpm 4.5 MB/s | 854 kB 00:00 2024-05-10T04:48:55.439 INFO:teuthology.orchestra.run.smithi047.stdout:(145/153): libmount-2.32.1-46.el8.x86_64.rpm 2.8 MB/s | 237 kB 00:00 2024-05-10T04:48:55.465 INFO:teuthology.orchestra.run.smithi047.stdout:(146/153): libsmartcols-2.32.1-46.el8.x86_64.rp 2.1 MB/s | 180 kB 00:00 2024-05-10T04:48:55.490 INFO:teuthology.orchestra.run.smithi047.stdout:(147/153): libuuid-2.32.1-46.el8.x86_64.rpm 1.3 MB/s | 99 kB 00:00 2024-05-10T04:48:55.532 INFO:teuthology.orchestra.run.smithi047.stdout:(148/153): openssl-1.1.1k-12.el8.x86_64.rpm 7.9 MB/s | 738 kB 00:00 2024-05-10T04:48:55.582 INFO:teuthology.orchestra.run.smithi047.stdout:(149/153): util-linux-user-2.32.1-46.el8.x86_64 2.0 MB/s | 103 kB 00:00 2024-05-10T04:48:55.632 INFO:teuthology.orchestra.run.smithi047.stdout:(150/153): xfsdump-3.1.8-7.el8.x86_64.rpm 6.6 MB/s | 334 kB 00:00 2024-05-10T04:48:55.683 INFO:teuthology.orchestra.run.smithi047.stdout:(151/153): openssl-libs-1.1.1k-12.el8.x86_64.rp 6.8 MB/s | 1.5 MB 00:00 2024-05-10T04:48:55.733 INFO:teuthology.orchestra.run.smithi047.stdout:(152/153): xfsprogs-5.0.0-12.el8.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-05-10T04:48:55.783 INFO:teuthology.orchestra.run.smithi047.stdout:(153/153): util-linux-2.32.1-46.el8.x86_64.rpm 8.9 MB/s | 2.6 MB 00:00 2024-05-10T04:48:55.786 INFO:teuthology.orchestra.run.smithi047.stdout:-------------------------------------------------------------------------------- 2024-05-10T04:48:55.786 INFO:teuthology.orchestra.run.smithi047.stdout:Total 7.5 MB/s | 227 MB 00:30 2024-05-10T04:48:57.827 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction check 2024-05-10T04:48:58.325 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction check succeeded. 2024-05-10T04:48:58.325 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction test 2024-05-10T04:49:00.052 INFO:teuthology.orchestra.run.smithi047.stdout:Transaction test succeeded. 2024-05-10T04:49:00.056 INFO:teuthology.orchestra.run.smithi047.stdout:Running transaction 2024-05-10T04:49:00.286 INFO:teuthology.orchestra.run.smithi117.stdout: Preparing : 1/1 2024-05-10T04:49:00.475 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-05-10T04:49:00.703 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:49:00.953 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:49:01.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/177 2024-05-10T04:49:01.311 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:49:01.408 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:49:01.619 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:49:01.714 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:49:01.943 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/177 2024-05-10T04:49:02.134 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/177 2024-05-10T04:49:02.350 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/177 2024-05-10T04:49:02.597 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/177 2024-05-10T04:49:02.794 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:49:03.255 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:49:03.460 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:49:03.926 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:49:04.135 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:49:04.282 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:49:04.494 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:49:04.609 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:49:04.946 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:49:05.195 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:49:05.299 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:49:05.515 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libpq-13.5-1.el8.x86_64 15/177 2024-05-10T04:49:05.733 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/177 2024-05-10T04:49:06.045 INFO:teuthology.orchestra.run.smithi047.stdout: Preparing : 1/1 2024-05-10T04:49:06.210 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/177 2024-05-10T04:49:06.251 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/1 2024-05-10T04:49:06.431 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 18/177 2024-05-10T04:49:06.576 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:49:06.593 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:49:06.701 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:49:06.850 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:1.1.1k-12.el8.x86_64 1/177 2024-05-10T04:49:06.869 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:49:06.941 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:49:07.053 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/177 2024-05-10T04:49:07.178 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:49:07.280 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libuuid-2.32.1-46.el8.x86_64 3/177 2024-05-10T04:49:07.454 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 21/177 2024-05-10T04:49:07.478 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:49:07.577 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libblkid-2.32.1-46.el8.x86_64 4/177 2024-05-10T04:49:07.676 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:49:07.753 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:49:07.857 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/177 2024-05-10T04:49:08.049 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:49:08.051 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 6/177 2024-05-10T04:49:08.267 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/177 2024-05-10T04:49:08.318 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:49:08.502 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libelf-0.190-2.el8.x86_64 8/177 2024-05-10T04:49:08.678 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:49:08.809 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:49:09.059 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 24/177 2024-05-10T04:49:09.166 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 9/177 2024-05-10T04:49:09.216 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 25/177 2024-05-10T04:49:09.376 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:49:09.469 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:49:09.538 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:49:09.742 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:49:09.969 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:49:10.169 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:49:10.324 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:49:10.403 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:49:10.544 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:49:10.601 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:49:10.649 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:49:10.989 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:49:11.200 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:49:11.267 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:49:11.306 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/177 2024-05-10T04:49:11.458 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:49:11.492 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libpq-13.5-1.el8.x86_64 15/177 2024-05-10T04:49:11.722 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 16/177 2024-05-10T04:49:12.264 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:49:12.293 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/177 2024-05-10T04:49:12.569 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 18/177 2024-05-10T04:49:12.575 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 30/177 2024-05-10T04:49:12.784 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 31/177 2024-05-10T04:49:12.973 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 32/177 2024-05-10T04:49:13.027 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:49:13.161 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:49:13.178 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/177 2024-05-10T04:49:13.327 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:49:13.349 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 34/177 2024-05-10T04:49:13.414 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 20/177 2024-05-10T04:49:13.487 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 35/177 2024-05-10T04:49:13.740 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 36/177 2024-05-10T04:49:13.877 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libacl-2.2.53-3.el8.x86_64 21/177 2024-05-10T04:49:14.135 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:49:14.207 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 22/177 2024-05-10T04:49:14.555 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:49:14.805 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:49:14.839 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 37/177 2024-05-10T04:49:15.195 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 38/177 2024-05-10T04:49:15.308 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.40.16-15.el8.x86_64 23/177 2024-05-10T04:49:15.513 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 24/177 2024-05-10T04:49:15.526 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 39/177 2024-05-10T04:49:15.693 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 25/177 2024-05-10T04:49:15.699 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:49:15.902 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:49:16.082 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libquadmath-8.5.0-22.el8.x86_64 26/177 2024-05-10T04:49:16.244 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:49:16.946 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libgfortran-8.5.0-22.el8.x86_64 27/177 2024-05-10T04:49:17.168 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:49:17.761 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:49:17.893 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 28/177 2024-05-10T04:49:18.077 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:49:18.077 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 41/177 2024-05-10T04:49:18.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/177 2024-05-10T04:49:18.521 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rsa-4.9-2.el8.noarch 43/177 2024-05-10T04:49:18.723 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 44/177 2024-05-10T04:49:18.899 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 45/177 2024-05-10T04:49:18.952 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 29/177 2024-05-10T04:49:19.065 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 46/177 2024-05-10T04:49:19.270 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 47/177 2024-05-10T04:49:19.315 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 30/177 2024-05-10T04:49:19.465 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:49:19.558 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:49:19.661 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 31/177 2024-05-10T04:49:19.749 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:49:19.834 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:49:19.843 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 32/177 2024-05-10T04:49:20.017 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 50/177 2024-05-10T04:49:20.059 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/177 2024-05-10T04:49:20.203 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 51/177 2024-05-10T04:49:20.234 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 34/177 2024-05-10T04:49:20.374 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 35/177 2024-05-10T04:49:20.415 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:49:20.630 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 36/177 2024-05-10T04:49:20.978 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:49:21.290 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:49:21.319 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:49:21.497 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/177 2024-05-10T04:49:21.767 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 37/177 2024-05-10T04:49:21.788 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/177 2024-05-10T04:49:21.997 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 56/177 2024-05-10T04:49:22.121 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 38/177 2024-05-10T04:49:22.172 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 57/177 2024-05-10T04:49:22.327 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 58/177 2024-05-10T04:49:22.416 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 39/177 2024-05-10T04:49:22.561 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 59/177 2024-05-10T04:49:22.584 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:49:22.763 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 60/177 2024-05-10T04:49:22.945 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 61/177 2024-05-10T04:49:23.118 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 62/177 2024-05-10T04:49:23.263 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 63/177 2024-05-10T04:49:23.436 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 64/177 2024-05-10T04:49:23.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 65/177 2024-05-10T04:49:23.766 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-portend-2.6-1.el8.noarch 66/177 2024-05-10T04:49:23.970 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 67/177 2024-05-10T04:49:24.190 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 68/177 2024-05-10T04:49:24.438 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 69/177 2024-05-10T04:49:24.638 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 70/177 2024-05-10T04:49:24.759 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 40/177 2024-05-10T04:49:25.000 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 71/177 2024-05-10T04:49:25.224 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 41/177 2024-05-10T04:49:25.274 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 72/177 2024-05-10T04:49:25.434 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 42/177 2024-05-10T04:49:25.451 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 73/177 2024-05-10T04:49:25.675 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rsa-4.9-2.el8.noarch 43/177 2024-05-10T04:49:25.884 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 44/177 2024-05-10T04:49:26.061 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 45/177 2024-05-10T04:49:26.232 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-libs-0.190-2.el8.x86_64 46/177 2024-05-10T04:49:26.402 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 74/177 2024-05-10T04:49:26.498 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el8.x86_64 47/177 2024-05-10T04:49:26.613 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:49:26.692 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:49:26.704 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:49:26.790 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libfdisk-2.32.1-46.el8.x86_64 48/177 2024-05-10T04:49:26.934 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:49:26.935 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 76/177 2024-05-10T04:49:27.024 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libmount-2.32.1-46.el8.x86_64 49/177 2024-05-10T04:49:27.164 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/177 2024-05-10T04:49:27.174 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libuuid-devel-2.32.1-46.el8.x86_64 50/177 2024-05-10T04:49:27.356 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 51/177 2024-05-10T04:49:27.397 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 78/177 2024-05-10T04:49:27.554 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:49:27.814 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 79/177 2024-05-10T04:49:28.103 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 80/177 2024-05-10T04:49:28.134 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libsmartcols-2.32.1-46.el8.x86_64 52/177 2024-05-10T04:49:28.294 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/177 2024-05-10T04:49:28.418 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:49:28.446 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: util-linux-2.32.1-46.el8.x86_64 53/177 2024-05-10T04:49:28.522 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 82/177 2024-05-10T04:49:28.685 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 54/177 2024-05-10T04:49:29.749 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 83/177 2024-05-10T04:49:29.749 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 55/177 2024-05-10T04:49:29.749 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 56/177 2024-05-10T04:49:29.749 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 57/177 2024-05-10T04:49:29.750 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 58/177 2024-05-10T04:49:29.750 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 59/177 2024-05-10T04:49:29.981 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 84/177 2024-05-10T04:49:29.994 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 60/177 2024-05-10T04:49:30.201 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 61/177 2024-05-10T04:49:30.325 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/177 2024-05-10T04:49:30.363 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 62/177 2024-05-10T04:49:30.500 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 63/177 2024-05-10T04:49:30.555 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 86/177 2024-05-10T04:49:30.666 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 64/177 2024-05-10T04:49:30.805 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 87/177 2024-05-10T04:49:30.833 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 65/177 2024-05-10T04:49:31.028 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-portend-2.6-1.el8.noarch 66/177 2024-05-10T04:49:31.142 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 88/177 2024-05-10T04:49:31.213 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 67/177 2024-05-10T04:49:31.391 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/177 2024-05-10T04:49:31.463 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 68/177 2024-05-10T04:49:31.665 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 90/177 2024-05-10T04:49:31.725 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 69/177 2024-05-10T04:49:31.892 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 91/177 2024-05-10T04:49:32.060 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 70/177 2024-05-10T04:49:32.289 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 92/177 2024-05-10T04:49:32.481 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 71/177 2024-05-10T04:49:32.484 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 93/177 2024-05-10T04:49:32.631 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 94/177 2024-05-10T04:49:32.735 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 72/177 2024-05-10T04:49:32.813 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 95/177 2024-05-10T04:49:32.933 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 73/177 2024-05-10T04:49:33.155 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 96/177 2024-05-10T04:49:33.384 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 97/177 2024-05-10T04:49:33.510 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 98/177 2024-05-10T04:49:33.743 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 99/177 2024-05-10T04:49:33.918 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 74/177 2024-05-10T04:49:33.973 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 100/177 2024-05-10T04:49:34.108 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:49:34.173 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : fuse-2.9.7-19.el8.x86_64 101/177 2024-05-10T04:49:34.201 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 75/177 2024-05-10T04:49:34.364 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 102/177 2024-05-10T04:49:34.423 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 76/177 2024-05-10T04:49:34.553 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:49:34.646 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:49:34.670 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-packaging-16.8-9.el8.noarch 77/177 2024-05-10T04:49:34.804 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 104/177 2024-05-10T04:49:34.912 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 78/177 2024-05-10T04:49:35.459 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 79/177 2024-05-10T04:49:35.742 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 80/177 2024-05-10T04:49:35.941 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 81/177 2024-05-10T04:49:36.189 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 82/177 2024-05-10T04:49:36.435 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 83/177 2024-05-10T04:49:37.731 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 84/177 2024-05-10T04:49:37.881 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:49:38.114 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 85/177 2024-05-10T04:49:38.128 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:49:38.376 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 86/177 2024-05-10T04:49:38.771 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 87/177 2024-05-10T04:49:38.854 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:49:39.120 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 88/177 2024-05-10T04:49:39.186 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:49:39.377 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 89/177 2024-05-10T04:49:39.403 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:49:39.569 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:49:39.633 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 90/177 2024-05-10T04:49:39.855 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 91/177 2024-05-10T04:49:40.164 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 92/177 2024-05-10T04:49:40.380 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 93/177 2024-05-10T04:49:40.526 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 94/177 2024-05-10T04:49:40.710 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 95/177 2024-05-10T04:49:41.050 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 96/177 2024-05-10T04:49:41.329 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 97/177 2024-05-10T04:49:41.464 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 98/177 2024-05-10T04:49:41.683 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 99/177 2024-05-10T04:49:41.910 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 100/177 2024-05-10T04:49:42.135 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : fuse-2.9.7-19.el8.x86_64 101/177 2024-05-10T04:49:42.329 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 102/177 2024-05-10T04:49:42.515 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:49:42.596 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 103/177 2024-05-10T04:49:42.774 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 104/177 2024-05-10T04:49:46.020 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:49:46.299 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:49:47.055 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 105/177 2024-05-10T04:49:47.371 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:49:47.559 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 106/177 2024-05-10T04:49:47.739 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:50:00.790 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /sys 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /proc 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /run 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /mnt 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /var/tmp 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /home 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /tmp 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout:skipping the directory /dev 2024-05-10T04:50:00.791 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:01.173 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:50:03.046 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:50:03.264 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:50:03.529 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:50:03.748 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:50:04.331 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:50:04.547 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:50:04.596 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:50:04.822 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 112/177 2024-05-10T04:50:05.077 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 113/177 2024-05-10T04:50:05.222 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:50:05.326 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:50:05.623 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : jq-1.6-8.el8.x86_64 115/177 2024-05-10T04:50:05.847 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : automake-1.16.1-8.el8.noarch 116/177 2024-05-10T04:50:06.447 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:50:06.617 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:50:06.738 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 118/177 2024-05-10T04:50:06.937 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 119/177 2024-05-10T04:50:07.154 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:50:08.347 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:50:08.596 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:50:09.611 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 107/177 2024-05-10T04:50:09.611 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /sys 2024-05-10T04:50:09.611 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /proc 2024-05-10T04:50:09.611 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /dev 2024-05-10T04:50:09.611 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /run 2024-05-10T04:50:09.612 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /mnt 2024-05-10T04:50:09.612 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /var/tmp 2024-05-10T04:50:09.612 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /home 2024-05-10T04:50:09.612 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /tmp 2024-05-10T04:50:09.612 INFO:teuthology.orchestra.run.smithi047.stdout:skipping the directory /dev 2024-05-10T04:50:09.612 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:09.687 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:50:09.870 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:50:10.000 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:50:10.021 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:50:10.397 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 123/177 2024-05-10T04:50:10.604 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:50:10.672 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:50:10.837 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:50:10.864 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:50:11.086 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 126/177 2024-05-10T04:50:11.279 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:50:12.006 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 108/177 2024-05-10T04:50:12.226 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:50:12.502 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 109/177 2024-05-10T04:50:12.737 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:50:13.358 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 110/177 2024-05-10T04:50:13.603 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:50:13.654 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 111/177 2024-05-10T04:50:13.887 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 112/177 2024-05-10T04:50:14.109 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 113/177 2024-05-10T04:50:14.261 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:50:14.363 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 114/177 2024-05-10T04:50:14.678 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : jq-1.6-8.el8.x86_64 115/177 2024-05-10T04:50:14.886 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : automake-1.16.1-8.el8.noarch 116/177 2024-05-10T04:50:15.482 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:50:15.646 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephadm-2:18.2.2-1330.g50174015.el8.noarch 117/177 2024-05-10T04:50:15.762 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 118/177 2024-05-10T04:50:15.989 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 119/177 2024-05-10T04:50:16.194 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:50:16.610 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:50:17.461 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 120/177 2024-05-10T04:50:17.708 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:50:18.375 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 128/177 2024-05-10T04:50:18.603 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:50:18.663 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:50:18.859 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 121/177 2024-05-10T04:50:18.878 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:50:18.947 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:50:19.036 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:50:19.161 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:50:19.171 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 122/177 2024-05-10T04:50:19.566 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:50:19.596 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 123/177 2024-05-10T04:50:19.784 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:50:19.794 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:50:19.852 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 124/177 2024-05-10T04:50:20.035 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:50:20.063 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 125/177 2024-05-10T04:50:20.075 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:50:20.284 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-2:18.2.2-1330.g50174015.el8.x86_64 126/177 2024-05-10T04:50:20.417 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 133/177 2024-05-10T04:50:20.485 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:50:21.686 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 134/177 2024-05-10T04:50:22.299 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 135/177 2024-05-10T04:50:22.508 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 136/177 2024-05-10T04:50:22.708 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 137/177 2024-05-10T04:50:22.865 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 138/177 2024-05-10T04:50:23.047 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 139/177 2024-05-10T04:50:23.258 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:50:23.519 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 141/177 2024-05-10T04:50:23.808 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:50:23.994 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 143/177 2024-05-10T04:50:25.105 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:50:25.384 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:50:25.459 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:50:25.664 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 145/177 2024-05-10T04:50:25.885 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 146/177 2024-05-10T04:50:26.119 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 147/177 2024-05-10T04:50:26.137 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 127/177 2024-05-10T04:50:26.522 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 148/177 2024-05-10T04:50:26.921 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 149/177 2024-05-10T04:50:27.160 INFO:teuthology.orchestra.run.smithi117.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 150/177 2024-05-10T04:50:27.314 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 151/177 2024-05-10T04:50:27.550 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:50:27.655 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:50:27.884 INFO:teuthology.orchestra.run.smithi117.stdout: Installing : bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:50:27.910 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:50:28.042 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 128/177 2024-05-10T04:50:28.053 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 154/177 2024-05-10T04:50:28.219 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 155/177 2024-05-10T04:50:28.399 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:50:28.405 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 156/177 2024-05-10T04:50:28.461 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 129/177 2024-05-10T04:50:28.602 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 157/177 2024-05-10T04:50:28.668 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:50:28.739 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-1330.g50174 130/177 2024-05-10T04:50:28.755 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 158/177 2024-05-10T04:50:28.755 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:50:28.926 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:50:29.046 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:50:29.046 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:50:29.358 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 131/177 2024-05-10T04:50:29.618 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:50:29.690 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:50:29.691 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:50:29.916 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:50:29.970 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:50:30.127 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 162/177 2024-05-10T04:50:30.254 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-contrib-10.23-2.module_el8+572+929c87 133/177 2024-05-10T04:50:30.256 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 163/177 2024-05-10T04:50:30.476 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 164/177 2024-05-10T04:50:30.677 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:50:30.901 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 166/177 2024-05-10T04:50:30.902 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:50:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:50:31.120 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:50:31.328 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:50:31.328 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:50:31.552 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:50:31.583 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 134/177 2024-05-10T04:50:31.702 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 170/177 2024-05-10T04:50:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:50:31.724 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:50:31.882 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : openssl-devel-1:1.1.1k-12.el8.x86_64 135/177 2024-05-10T04:50:32.108 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : elfutils-libelf-devel-0.190-2.el8.x86_64 136/177 2024-05-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:50:32.254 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:50:32.307 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : util-linux-user-2.32.1-46.el8.x86_64 137/177 2024-05-10T04:50:32.477 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:50:32.477 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:50:32.481 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 138/177 2024-05-10T04:50:32.663 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 139/177 2024-05-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:50:32.702 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:50:32.860 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-team-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:50:32.910 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:50:33.061 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : NetworkManager-tui-1:1.40.16-15.el8.x86_64 141/177 2024-05-10T04:50:33.092 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 175/177 2024-05-10T04:50:33.261 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 176/177 2024-05-10T04:50:33.262 INFO:teuthology.orchestra.run.smithi117.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:50:33.340 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:50:33.518 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : libacl-devel-2.2.53-3.el8.x86_64 143/177 2024-05-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi117.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi117.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-10T04:50:33.768 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:34.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/177 2024-05-10T04:50:34.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/177 2024-05-10T04:50:34.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/177 2024-05-10T04:50:34.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/177 2024-05-10T04:50:34.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/177 2024-05-10T04:50:34.493 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/177 2024-05-10T04:50:34.494 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/177 2024-05-10T04:50:34.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/177 2024-05-10T04:50:34.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:50:34.495 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/177 2024-05-10T04:50:34.496 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/177 2024-05-10T04:50:34.511 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/177 2024-05-10T04:50:34.512 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : jq-1.6-8.el8.x86_64 42/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 44/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 47/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/177 2024-05-10T04:50:34.513 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 54/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/177 2024-05-10T04:50:34.514 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 66/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/177 2024-05-10T04:50:34.515 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 71/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 72/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 77/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 78/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 79/177 2024-05-10T04:50:34.516 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 82/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 85/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/177 2024-05-10T04:50:34.517 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 90/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 97/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 98/177 2024-05-10T04:50:34.518 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 99/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 100/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 101/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 102/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 103/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 104/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 105/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 106/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 107/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 108/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 109/177 2024-05-10T04:50:34.519 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 110/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 111/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 112/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 113/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 114/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 117/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 118/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 119/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 120/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 121/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 122/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 123/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 124/177 2024-05-10T04:50:34.520 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 125/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 126/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 127/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 128/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 129/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 130/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 134/177 2024-05-10T04:50:34.521 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 135/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 136/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 137/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 138/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 139/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 141/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : acl-2.2.53-1.el8.x86_64 143/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 144/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/177 2024-05-10T04:50:34.522 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 146/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 147/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 148/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 149/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 150/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 151/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 152/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 153/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 154/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 155/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 156/177 2024-05-10T04:50:34.523 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 157/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 158/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 159/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 160/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 161/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 162/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 163/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 164/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 166/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 167/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 168/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 169/177 2024-05-10T04:50:34.524 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 170/177 2024-05-10T04:50:34.525 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 171/177 2024-05-10T04:50:34.525 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 172/177 2024-05-10T04:50:34.525 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:50:34.525 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 174/177 2024-05-10T04:50:34.525 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 175/177 2024-05-10T04:50:34.525 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 176/177 2024-05-10T04:50:34.738 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:50:35.017 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:50:35.098 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: postgresql-server-10.23-2.module_el8+572+929c87a 144/177 2024-05-10T04:50:35.297 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : xfsdump-3.1.8-7.el8.x86_64 145/177 2024-05-10T04:50:35.560 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 146/177 2024-05-10T04:50:35.778 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 147/177 2024-05-10T04:50:36.134 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 148/177 2024-05-10T04:50:36.507 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : iproute-6.2.0-5.el8.x86_64 149/177 2024-05-10T04:50:36.793 INFO:teuthology.orchestra.run.smithi047.stdout: Upgrading : openssl-1:1.1.1k-12.el8.x86_64 150/177 2024-05-10T04:50:36.976 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 151/177 2024-05-10T04:50:37.233 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:50:37.342 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 152/177 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 177/177 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout:Upgraded: 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:37.485 INFO:teuthology.orchestra.run.smithi117.stdout: acl-2.2.53-3.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: iproute-6.2.0-5.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-2.2.53-3.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: libacl-devel-2.2.53-3.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: libblkid-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: libmount-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.486 INFO:teuthology.orchestra.run.smithi117.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: xfsdump-3.1.8-7.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout:Installed: 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.487 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.488 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: fuse-2.9.7-19.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: jq-1.6-8.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T04:50:37.489 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libpq-13.5-1.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.490 INFO:teuthology.orchestra.run.smithi117.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-0.3.15-4.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-05-10T04:50:37.491 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T04:50:37.492 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T04:50:37.493 INFO:teuthology.orchestra.run.smithi117.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T04:50:37.494 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T04:50:37.495 INFO:teuthology.orchestra.run.smithi117.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T04:50:37.496 INFO:teuthology.orchestra.run.smithi117.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T04:50:37.497 INFO:teuthology.orchestra.run.smithi117.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-05-10T04:50:37.497 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:37.497 INFO:teuthology.orchestra.run.smithi117.stdout:Complete! 2024-05-10T04:50:37.608 INFO:teuthology.orchestra.run.smithi047.stdout: Installing : bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:50:37.635 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 153/177 2024-05-10T04:50:37.769 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-tui-1:1.40.16-4.el8.x86_64 154/177 2024-05-10T04:50:37.800 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:37.978 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 155/177 2024-05-10T04:50:38.528 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 156/177 2024-05-10T04:50:38.727 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-1:1.1.1k-9.el8.x86_64 157/177 2024-05-10T04:50:38.880 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 158/177 2024-05-10T04:50:38.880 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:50:39.172 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 159/177 2024-05-10T04:50:39.172 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:50:39.415 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 160/177 2024-05-10T04:50:39.416 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:50:39.673 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 161/177 2024-05-10T04:50:39.828 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : acl-2.2.53-1.el8.x86_64 162/177 2024-05-10T04:50:39.948 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libacl-devel-2.2.53-1.el8.x86_64 163/177 2024-05-10T04:50:40.160 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 164/177 2024-05-10T04:50:40.365 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:50:40.618 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 166/177 2024-05-10T04:50:40.618 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:50:40.820 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 167/177 2024-05-10T04:50:40.820 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:50:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 168/177 2024-05-10T04:50:41.020 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:50:41.245 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 169/177 2024-05-10T04:50:41.360 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-team-1:1.40.16-4.el8.x86_64 170/177 2024-05-10T04:50:41.383 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:50:41.384 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:50:41.886 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-1:1.40.16-4.el8.x86_64 171/177 2024-05-10T04:50:41.886 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:50:42.119 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: NetworkManager-libnm-1:1.40.16-4.el8.x86_64 172/177 2024-05-10T04:50:42.120 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:50:42.353 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:50:42.353 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:50:42.553 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 174/177 2024-05-10T04:50:42.751 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 175/177 2024-05-10T04:50:42.878 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : libacl-2.2.53-1.el8.x86_64 176/177 2024-05-10T04:50:42.878 INFO:teuthology.orchestra.run.smithi047.stdout: Cleanup : openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:50:43.367 INFO:teuthology.orchestra.run.smithi047.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8.x86_64 177/177 2024-05-10T04:50:43.367 INFO:teuthology.orchestra.run.smithi047.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-10T04:50:43.367 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:44.133 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-2:18.2.2-1330.g50174015.el8.x86_64 1/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 3/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 4/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-1330.g50174 5/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 6/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 7/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 8/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 9/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 10/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 11/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 12/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 13/177 2024-05-10T04:50:44.134 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_ 14/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 15/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 16/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados-devel-2:18.2.2-1330.g50174015.el8.x86_6 17/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libradosstriper1-2:18.2.2-1330.g50174015.el8.x86 18/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librgw2-2:18.2.2-1330.g50174015.el8.x86_64 19/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-argparse-2:18.2.2-1330.g50174015.el 20/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-ceph-common-2:18.2.2-1330.g50174015.el8. 21/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_6 22/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 23/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 24/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 25/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 26/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 27/177 2024-05-10T04:50:44.135 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 28/177 2024-05-10T04:50:44.136 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-1330.g50174015. 29/177 2024-05-10T04:50:44.136 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noa 30/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.n 31/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-1330.g501 32/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el 33/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 34/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-1330.g50174015.e 35/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 36/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephadm-2:18.2.2-1330.g50174015.el8.noarch 37/177 2024-05-10T04:50:44.150 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 38/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : automake-1.16.1-8.el8.noarch 39/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : jq-1.6-8.el8.x86_64 42/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 44/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 47/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-10.23-2.module_el8+572+929c87ac.x86_6 50/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-contrib-10.23-2.module_el8+572+929c87 51/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : postgresql-server-10.23-2.module_el8+572+929c87a 52/177 2024-05-10T04:50:44.151 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 54/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/177 2024-05-10T04:50:44.152 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 65/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x 66/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-devel-0.190-2.el8.x86_64 71/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 72/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/177 2024-05-10T04:50:44.153 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libgfortran-8.5.0-22.el8.x86_64 77/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libquadmath-8.5.0-22.el8.x86_64 78/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 79/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-devel-2.32.1-46.el8.x86_64 82/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-devel-1:1.1.1k-12.el8.x86_64 85/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/177 2024-05-10T04:50:44.154 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 90/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/177 2024-05-10T04:50:44.155 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-packaging-16.8-9.el8.noarch 97/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 98/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 99/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 100/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 101/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 102/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 103/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 104/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 105/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 106/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 107/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 108/177 2024-05-10T04:50:44.156 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 109/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 110/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 111/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 112/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 113/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 114/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 115/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-portend-2.6-1.el8.noarch 116/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 117/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 118/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 119/177 2024-05-10T04:50:44.157 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 120/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 121/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 122/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 123/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 124/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 125/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 126/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 127/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 128/177 2024-05-10T04:50:44.158 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 129/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-2:18.2.2-1330.g50174015.el8.x86_64 130/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 131/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-2:18.2.2-1330.g50174015.el8.x86_64 132/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 133/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.40.16-15.el8.x86_64 134/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-1:1.40.16-4.el8.x86_64 135/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.40.16-15.el8.x86_64 136/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-libnm-1:1.40.16-4.el8.x86_64 137/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.40.16-15.el8.x86_64 138/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-team-1:1.40.16-4.el8.x86_64 139/177 2024-05-10T04:50:44.159 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.40.16-15.el8.x86_64 140/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : NetworkManager-tui-1:1.40.16-4.el8.x86_64 141/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : acl-2.2.53-3.el8.x86_64 142/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : acl-2.2.53-1.el8.x86_64 143/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el8.x86_64 144/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.190-2.el8.x86_64 146/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 147/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.190-2.el8.x86_64 148/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 149/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : iproute-6.2.0-5.el8.x86_64 150/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 151/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-2.2.53-3.el8.x86_64 152/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-2.2.53-1.el8.x86_64 153/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-devel-2.2.53-3.el8.x86_64 154/177 2024-05-10T04:50:44.160 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libacl-devel-2.2.53-1.el8.x86_64 155/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.32.1-46.el8.x86_64 156/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 157/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.32.1-46.el8.x86_64 158/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 159/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.32.1-46.el8.x86_64 160/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 161/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.32.1-46.el8.x86_64 162/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 163/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.32.1-46.el8.x86_64 164/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 165/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:1.1.1k-12.el8.x86_64 166/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-1:1.1.1k-9.el8.x86_64 167/177 2024-05-10T04:50:44.161 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:1.1.1k-12.el8.x86_64 168/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8.x86_64 169/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.32.1-46.el8.x86_64 170/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 171/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.32.1-46.el8.x86_64 172/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 173/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.8-7.el8.x86_64 174/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 175/177 2024-05-10T04:50:44.162 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 176/177 2024-05-10T04:50:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 177/177 2024-05-10T04:50:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:46.613 INFO:teuthology.orchestra.run.smithi047.stdout:Upgraded: 2024-05-10T04:50:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:46.613 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-libnm-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-team-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: NetworkManager-tui-1:1.40.16-15.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: acl-2.2.53-3.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-debuginfod-client-0.190-2.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-0.190-2.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libs-0.190-2.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: iproute-6.2.0-5.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-2.2.53-3.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: libacl-devel-2.2.53-3.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: libblkid-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: libfdisk-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: libmount-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.614 INFO:teuthology.orchestra.run.smithi047.stdout: librados2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: librbd1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: libsmartcols-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-1:1.1.1k-12.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-libs-1:1.1.1k-12.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: util-linux-user-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: xfsdump-3.1.8-7.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-5.0.0-12.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout:Installed: 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: automake-1.16.1-8.el8.noarch 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: bison-3.0.4-10.el8.x86_64 2024-05-10T04:50:46.615 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-base-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-grafana-dashboards-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-immutable-object-cache-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mds-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-dashboard-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-diskprediction-local-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-modules-core-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mgr-rook-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-mon-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-osd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.616 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-prometheus-alerts-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-radosgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-selinux-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-test-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: ceph-volume-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: cephadm-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: cephfs-top-2:18.2.2-1330.g50174015.el8.noarch 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: elfutils-libelf-devel-0.190-2.el8.x86_64 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: flex-2.6.1-9.el8.x86_64 2024-05-10T04:50:46.617 INFO:teuthology.orchestra.run.smithi047.stdout: fuse-2.9.7-19.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: jq-1.6-8.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: krb5-devel-1.18.2-22.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libcephfs2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libcephsqlite-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libgfortran-8.5.0-22.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: liboath-2.6.2-3.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libpq-13.5-1.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: libquadmath-8.5.0-22.el8.x86_64 2024-05-10T04:50:46.618 INFO:teuthology.orchestra.run.smithi047.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: librados-devel-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libradosstriper1-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: librgw2-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libselinux-devel-2.9-8.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libsepol-devel-2.9-3.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libtool-2.4.6-25.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libunwind-1.3.1-3.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libuuid-devel-2.32.1-46.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libverto-devel-0.3.2-2.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: oniguruma-6.8.2-3.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-0.3.15-4.el8.x86_64 2024-05-10T04:50:46.619 INFO:teuthology.orchestra.run.smithi047.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: openssl-devel-1:1.1.1k-12.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-devel-10.32-3.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf16-10.32-3.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: pcre2-utf32-10.32-3.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-contrib-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: postgresql-server-10.23-2.module_el8+572+929c87ac.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-babel-2.5.1-7.el8.noarch 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-argparse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-ceph-common-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.620 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cephfs-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-6.2-6.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-05-10T04:50:46.621 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-mako-1.0.6-14.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-natsort-7.1.1-2.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-packaging-16.8-9.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-portend-2.6-1.el8.noarch 2024-05-10T04:50:46.622 INFO:teuthology.orchestra.run.smithi047.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pycparser-2.14-14.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-pytz-2017.2-11.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rados-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rgw-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-routes-2.4.1-12.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-rsa-4.9-2.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-05-10T04:50:46.623 INFO:teuthology.orchestra.run.smithi047.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-fuse-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-mirror-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: rbd-nbd-2:18.2.2-1330.g50174015.el8.x86_64 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: socat-1.7.4.1-1.el8.x86_64 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: thrift-0.13.0-2.el8.x86_64 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: uuid-1.6.2-43.el8.x86_64 2024-05-10T04:50:46.624 INFO:teuthology.orchestra.run.smithi047.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2024-05-10T04:50:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-05-10T04:50:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: zlib-devel-1.2.11-21.el8.x86_64 2024-05-10T04:50:46.625 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:46.625 INFO:teuthology.orchestra.run.smithi047.stdout:Complete! 2024-05-10T04:50:46.987 DEBUG:teuthology.parallel:result is None 2024-05-10T04:50:46.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:50:47.134 DEBUG:teuthology.orchestra.run.smithi047:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T04:50:47.192 INFO:teuthology.orchestra.run.smithi047.stdout:18.2.2-1330.g50174015.el8 2024-05-10T04:50:47.192 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T04:50:47.193 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T04:50:47.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:50:47.333 DEBUG:teuthology.orchestra.run.smithi117:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-10T04:50:47.394 INFO:teuthology.orchestra.run.smithi117.stdout:18.2.2-1330.g50174015.el8 2024-05-10T04:50:47.394 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1330.g50174015.el8 2024-05-10T04:50:47.394 INFO:teuthology.task.install:The correct ceph version 18.2.2-1330.g50174015 is installed. 2024-05-10T04:50:47.396 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-10T04:50:47.396 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:47.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T04:50:47.471 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:47.471 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-10T04:50:47.545 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-10T04:50:47.545 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:47.545 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T04:50:47.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T04:50:47.724 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:47.724 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/daemon-helper 2024-05-10T04:50:47.794 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-10T04:50:47.901 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-10T04:50:47.901 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:47.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T04:50:47.969 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T04:50:48.079 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:48.079 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-10T04:50:48.146 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-10T04:50:48.251 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-10T04:50:48.251 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:48.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T04:50:48.320 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T04:50:48.430 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:48.431 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/usr/bin/stdin-killer 2024-05-10T04:50:48.498 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-10T04:50:48.606 INFO:teuthology.run_tasks:Running task ceph... 2024-05-10T04:50:48.702 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-10T04:50:48.703 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 777 /var/log/ceph 2024-05-10T04:50:48.707 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 777 /var/log/ceph 2024-05-10T04:50:48.771 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-10T04:50:48.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T04:50:48.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-10T04:50:48.842 INFO:tasks.ceph:Creating extra log directories... 2024-05-10T04:50:48.842 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T04:50:48.846 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-10T04:50:48.919 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-10T04:50:48.920 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-10T04:50:48.920 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-10T04:50:48.920 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:48.920 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T04:50:48.965 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:49.168 DEBUG:teuthology.orchestra.run.smithi047:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:49.241 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:49.241 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-10T04:50:49.286 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:49.494 DEBUG:teuthology.orchestra.run.smithi117:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-05-10T04:50:49.566 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-10T04:50:49.566 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-10T04:50:49.566 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570', 'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'description': 'fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7700570', 'kclient-workload': {'sequential': [{'kclient': ['client.1']}, {'workunit': {'clients': {'client.1': ['suites/dbench.sh']}}}]}, 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 65, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 4933, 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'sleep_before_teardown': 0, 'subset': '420/512', 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20240509.171335-reef-debug', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_50174015a7e79f951b988949abe236791f52d4da/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '50174015a7e79f951b988949abe236791f52d4da', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi047.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCW9cGFsHnarNmMU49jrgZ/sshT7WippJne/1sbUukOOQqcHD7NwdZio5eu0zQnnXIo6QESpXGjj2RvKGTYu3l4=', 'smithi117.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDX6FdGxF46ZrwVeinvC+mTyMYIFC/cd+3YZb/rfhPgYx5HwDplQBLjZpiMFJjhIMcXpasD9ZBCdwulGADlN1X0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '50174015a7e79f951b988949abe236791f52d4da'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '50174015a7e79f951b988949abe236791f52d4da', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'parallel': ['user-workload', 'kclient-workload']}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '1ae7ad82388e92a475afff437d49054826c019a1', 'timestamp': '2024-05-10_02:33:39', 'tube': 'smithi', 'user': 'pdonnell', 'user-workload': {'sequential': [{'ceph-fuse': ['client.0']}, {'workunit': {'clients': {'client.0': ['suites/iozone.sh']}}}]}, 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-05-10T04:50:49.567 DEBUG:teuthology.orchestra.run.smithi047:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T04:50:49.571 DEBUG:teuthology.orchestra.run.smithi117:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-10T04:50:49.615 DEBUG:teuthology.orchestra.run.smithi047:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T04:50:49.658 DEBUG:teuthology.orchestra.run.smithi117:> sudo install -d -m0777 -- /var/run/ceph 2024-05-10T04:50:49.725 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:49.725 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T04:50:49.771 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T04:50:49.771 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_1 2024-05-10T04:50:49.860 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T04:50:49.860 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:49.860 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 448 Links: 1 2024-05-10T04:50:49.860 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:49.860 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-10 04:50:43.582263842 +0000 2024-05-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-10 04:47:16.145921227 +0000 2024-05-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-10 04:47:16.145921227 +0000 2024-05-10T04:50:49.861 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-10 04:47:16.122921707 +0000 2024-05-10T04:50:49.861 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T04:50:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-10T04:50:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-10T04:50:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000163275 s, 3.1 MB/s 2024-05-10T04:50:49.930 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T04:50:49.977 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_2 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 454 Links: 1 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-10 04:50:43.582263842 +0000 2024-05-10T04:50:50.022 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-10 04:47:16.650910693 +0000 2024-05-10T04:50:50.023 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-10 04:47:16.650910693 +0000 2024-05-10T04:50:50.023 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-10 04:47:16.628911152 +0000 2024-05-10T04:50:50.023 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T04:50:50.126 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-10T04:50:50.126 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-10T04:50:50.126 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000166738 s, 3.1 MB/s 2024-05-10T04:50:50.128 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T04:50:50.174 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_3 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 460 Links: 1 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-10 04:50:43.583263822 +0000 2024-05-10T04:50:50.260 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-10 04:47:17.171899826 +0000 2024-05-10T04:50:50.261 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-10 04:47:17.171899826 +0000 2024-05-10T04:50:50.261 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-10 04:47:17.146900347 +0000 2024-05-10T04:50:50.261 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-10T04:50:50.364 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000174571 s, 2.9 MB/s 2024-05-10T04:50:50.367 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T04:50:50.413 DEBUG:teuthology.orchestra.run.smithi047:> stat /dev/vg_nvme/lv_4 2024-05-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi047.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 6h/6d Inode: 466 Links: 1 2024-05-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:50.497 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 2024-05-10 04:50:43.583263822 +0000 2024-05-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-10 04:47:17.652889793 +0000 2024-05-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-10 04:47:17.652889793 +0000 2024-05-10T04:50:50.498 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: 2024-05-10 04:47:17.633890189 +0000 2024-05-10T04:50:50.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T04:50:50.603 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records in 2024-05-10T04:50:50.603 INFO:teuthology.orchestra.run.smithi047.stderr:1+0 records out 2024-05-10T04:50:50.603 INFO:teuthology.orchestra.run.smithi047.stderr:512 bytes copied, 0.000195298 s, 2.6 MB/s 2024-05-10T04:50:50.606 DEBUG:teuthology.orchestra.run.smithi047:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T04:50:50.653 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:50:50.653 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:50.653 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/scratch_devs of=/dev/stdout 2024-05-10T04:50:50.702 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-10T04:50:50.702 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_1 2024-05-10T04:50:50.789 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 444 Links: 1 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-10 04:50:33.970001752 +0000 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-10 04:47:08.703320652 +0000 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-10 04:47:08.703320652 +0000 2024-05-10T04:50:50.790 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-05-10 04:47:08.680321092 +0000 2024-05-10T04:50:50.790 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-10T04:50:50.854 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-10T04:50:50.854 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-10T04:50:50.854 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00030209 s, 1.7 MB/s 2024-05-10T04:50:50.857 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-10T04:50:50.903 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_2 2024-05-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 450 Links: 1 2024-05-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:50.947 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-10 04:50:33.970001752 +0000 2024-05-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-10 04:47:09.245310304 +0000 2024-05-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-10 04:47:09.245310304 +0000 2024-05-10T04:50:50.948 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-05-10 04:47:09.219310800 +0000 2024-05-10T04:50:50.948 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-10T04:50:51.050 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-10T04:50:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-10T04:50:51.051 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.00028748 s, 1.8 MB/s 2024-05-10T04:50:51.053 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-10T04:50:51.099 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_3 2024-05-10T04:50:51.186 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 456 Links: 1 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-10 04:50:33.970001752 +0000 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-10 04:47:09.766300357 +0000 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-10 04:47:09.766300357 +0000 2024-05-10T04:50:51.187 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-05-10 04:47:09.739300872 +0000 2024-05-10T04:50:51.187 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-10T04:50:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-10T04:50:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-10T04:50:51.290 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000300178 s, 1.7 MB/s 2024-05-10T04:50:51.292 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-10T04:50:51.339 DEBUG:teuthology.orchestra.run.smithi117:> stat /dev/vg_nvme/lv_4 2024-05-10T04:50:51.424 INFO:teuthology.orchestra.run.smithi117.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-10T04:50:51.424 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-10T04:50:51.424 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 6h/6d Inode: 462 Links: 1 2024-05-10T04:50:51.425 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:50:51.425 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:device_t:s0 2024-05-10T04:50:51.425 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 2024-05-10 04:50:33.970001752 +0000 2024-05-10T04:50:51.425 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-10 04:47:10.284290466 +0000 2024-05-10T04:50:51.425 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-10 04:47:10.284290466 +0000 2024-05-10T04:50:51.425 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-05-10 04:47:10.257290981 +0000 2024-05-10T04:50:51.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-10T04:50:51.526 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records in 2024-05-10T04:50:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:1+0 records out 2024-05-10T04:50:51.527 INFO:teuthology.orchestra.run.smithi117.stderr:512 bytes copied, 0.000320605 s, 1.6 MB/s 2024-05-10T04:50:51.529 DEBUG:teuthology.orchestra.run.smithi117:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-10T04:50:51.575 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:50:51.575 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T04:50:51.575 INFO:tasks.ceph:Generating config... 2024-05-10T04:50:51.576 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-10T04:50:51.576 INFO:tasks.ceph:[client] debug client = 20 2024-05-10T04:50:51.576 INFO:tasks.ceph:[client] debug ms = 1 2024-05-10T04:50:51.576 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-10T04:50:51.576 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-10T04:50:51.577 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-10T04:50:51.577 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-10T04:50:51.578 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-10T04:50:51.578 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-10T04:50:51.578 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-10T04:50:51.578 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-10T04:50:51.578 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-10T04:50:51.578 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-10T04:50:51.579 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-10T04:50:51.579 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-10T04:50:51.579 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-10T04:50:51.579 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-05-10T04:50:51.579 INFO:tasks.ceph:Setting up mon.a... 2024-05-10T04:50:51.579 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-10T04:50:51.780 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.keyring 2024-05-10T04:50:51.794 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-10T04:50:51.976 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:50:52.044 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.47'), ('mon.b', '172.21.15.117'), ('mon.c', '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]')] 2024-05-10T04:50:52.044 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.47,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-10T04:50:52.045 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:52.045 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T04:50:52.090 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.47 --add b 172.21.15.117 --addv c '[v2:172.21.15.117:3301,v1:172.21.15.117:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: generated fsid 63debaa4-fa23-4f28-8f14-9786e692137f 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:setting min_mon_release = pacific 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:epoch 0 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:fsid 63debaa4-fa23-4f28-8f14-9786e692137f 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:last_changed 2024-05-10T04:50:52.296989+0000 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:created 2024-05-10T04:50:52.296989+0000 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:min_mon_release 16 (pacific) 2024-05-10T04:50:52.297 INFO:teuthology.orchestra.run.smithi047.stdout:election_strategy: 1 2024-05-10T04:50:52.298 INFO:teuthology.orchestra.run.smithi047.stdout:0: [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] mon.a 2024-05-10T04:50:52.298 INFO:teuthology.orchestra.run.smithi047.stdout:1: [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] mon.b 2024-05-10T04:50:52.298 INFO:teuthology.orchestra.run.smithi047.stdout:2: [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] mon.c 2024-05-10T04:50:52.298 INFO:teuthology.orchestra.run.smithi047.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-10T04:50:52.307 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-10T04:50:52.352 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 63debaa4-fa23-4f28-8f14-9786e692137f... 2024-05-10T04:50:52.353 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T04:50:52.396 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-10T04:50:52.510 INFO:teuthology.orchestra.run.smithi047.stdout:[global] 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: chdir = "" 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: auth supported = cephx 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: filestore xattr use omap = true 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: mon clock drift allowed = 1.000 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: osd crush chooseleaf type = 0 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: auth debug = true 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on old message = true 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on bug = true 2024-05-10T04:50:52.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon pg warn max object skew = 0 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default size = 2 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow primary affinity = true 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd allow pg remap = true 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on legacy crush tunables = false 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on crush straw calc version zero = false 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on no sortbitwise = false 2024-05-10T04:50:52.512 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on osd down out interval zero = false 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon warn on too few osds = false 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon_allow_pool_size_one = true 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: osd default data pool replay window = 5 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon allow pool delete = true 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon cluster log file level = debug 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: debug asserts on shutdown = true 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon health detail to clog = false 2024-05-10T04:50:52.513 INFO:teuthology.orchestra.run.smithi047.stdout: mon host = "172.21.15.47,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: ms die on skipped message = False 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: fsid = 63debaa4-fa23-4f28-8f14-9786e692137f 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout:[osd] 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd journal size = 100 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub load threshold = 5.0 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd scrub max interval = 600 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd mclock profile = high_recovery_ops 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd recover clone overlap = true 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd recovery max chunk = 1048576 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug shutdown = true 2024-05-10T04:50:52.514 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug op order = true 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug verify stray on activate = true 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: osd open classes on start = true 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug pg log writeout = true 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: osd deep scrub update digest min age = 30 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: osd map max advance = 10 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: journal zero on create = true 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: filestore ondisk finisher threads = 3 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: filestore apply finisher threads = 3 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.515 INFO:teuthology.orchestra.run.smithi047.stdout: bdev debug aio = true 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: osd debug misdirected ops = true 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore block size = 96636764160 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: bluestore fsck on mount = True 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluefs = 20 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: debug bluestore = 20 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: debug osd = 20 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: debug rocksdb = 10 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd full ratio = 0.9 2024-05-10T04:50:52.516 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd nearfull ratio = 0.8 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: osd failsafe full ratio = 0.95 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: osd objectstore = bluestore 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: osd shutdown pgref assert = True 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr] 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: debug mgr = 20 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-10T04:50:52.517 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mgr/telemetry/nag = false 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout:[mon] 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: debug mon = 20 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: debug paxos = 20 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: debug auth = 20 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon data avail warn = 5 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon mgr mkfs grace = 240 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd reporter subtree level = osd 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon osd prime pg temp = true 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:50:52.518 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: # 1m isn't quite enough 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: mon_down_mkfs_grace = 2m 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: mon_warn_on_filestore_osds = false 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: mon op complaint time = 120 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:50:52.519 INFO:teuthology.orchestra.run.smithi047.stdout:[client] 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: rgw cache enabled = true 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable ops log = true 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: rgw enable usage log = true 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: client mount timeout = 600 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: debug client = 20 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.a] 2024-05-10T04:50:52.520 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.b] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:[mon.c] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout:[mds] 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds = 20 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: debug mds balancer = 20 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: debug ms = 1 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug frag = True 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: mds debug scatterstat = True 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: mds op complaint time = 180 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: mds verify scatter = True 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: osd op complaint time = 180 2024-05-10T04:50:52.521 INFO:teuthology.orchestra.run.smithi047.stdout: rados mon op timeout = 900 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi047.stdout: rados osd op timeout = 900 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi117.stdout:[global] 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi117.stdout: chdir = "" 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi117.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi117.stdout: auth supported = cephx 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.522 INFO:teuthology.orchestra.run.smithi117.stdout: filestore xattr use omap = true 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: mon clock drift allowed = 1.000 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: osd crush chooseleaf type = 0 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: auth debug = true 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on old message = true 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on bug = true 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: mon pg warn max object skew = 0 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: # disable pg_autoscaler by default for new pools 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.523 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default size = 2 2024-05-10T04:50:52.525 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.525 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow primary affinity = true 2024-05-10T04:50:52.525 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd allow pg remap = true 2024-05-10T04:50:52.525 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on legacy crush tunables = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on crush straw calc version zero = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on no sortbitwise = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on osd down out interval zero = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon warn on too few osds = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon_allow_pool_size_one = true 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: osd default data pool replay window = 5 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon allow pool delete = true 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.526 INFO:teuthology.orchestra.run.smithi117.stdout: mon cluster log file level = debug 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: debug asserts on shutdown = true 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: mon health detail to clog = false 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: mon host = "172.21.15.47,172.21.15.117,[v2:172.21.15.117:3301,v1:172.21.15.117:6790]" 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: ms die on skipped message = False 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: fsid = 63debaa4-fa23-4f28-8f14-9786e692137f 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout:[osd] 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: osd journal size = 100 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub load threshold = 5.0 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: osd scrub max interval = 600 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: osd mclock profile = high_recovery_ops 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: osd recover clone overlap = true 2024-05-10T04:50:52.527 INFO:teuthology.orchestra.run.smithi117.stdout: osd recovery max chunk = 1048576 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug shutdown = true 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug op order = true 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug verify stray on activate = true 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd open classes on start = true 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug pg log writeout = true 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd deep scrub update digest min age = 30 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: osd map max advance = 10 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: journal zero on create = true 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.528 INFO:teuthology.orchestra.run.smithi117.stdout: filestore ondisk finisher threads = 3 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: filestore apply finisher threads = 3 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: bdev debug aio = true 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: osd debug misdirected ops = true 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore block size = 96636764160 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: bluestore fsck on mount = True 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluefs = 20 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: debug bluestore = 20 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: debug osd = 20 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: debug rocksdb = 10 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd backfillfull_ratio = 0.85 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd full ratio = 0.9 2024-05-10T04:50:52.529 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd nearfull ratio = 0.8 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: osd failsafe full ratio = 0.95 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: osd objectstore = bluestore 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: osd shutdown pgref assert = True 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr] 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: debug mgr = 20 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: mgr/telemetry/nag = false 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout:[mon] 2024-05-10T04:50:52.530 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: debug mon = 20 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: debug paxos = 20 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: debug auth = 20 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon data avail warn = 5 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon mgr mkfs grace = 240 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min pgs per osd = 4 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd reporter subtree level = osd 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon osd prime pg temp = true 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon reweight min bytes per osd = 10 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: auth mon ticket ttl = 660 # 11m 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: auth service ticket ttl = 240 # 4m 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: # don't complain about insecure global_id in the test suite 2024-05-10T04:50:52.531 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: # 1m isn't quite enough 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: mon_down_mkfs_grace = 2m 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: mon_warn_on_filestore_osds = false 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: mon op complaint time = 120 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout:[client] 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: rgw cache enabled = true 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable ops log = true 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: rgw enable usage log = true 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: client mount timeout = 600 2024-05-10T04:50:52.532 INFO:teuthology.orchestra.run.smithi117.stdout: debug client = 20 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.a] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.b] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mon.c] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout:[mds] 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds = 20 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: debug mds balancer = 20 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: debug ms = 1 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug frag = True 2024-05-10T04:50:52.533 INFO:teuthology.orchestra.run.smithi117.stdout: mds debug scatterstat = True 2024-05-10T04:50:52.534 INFO:teuthology.orchestra.run.smithi117.stdout: mds op complaint time = 180 2024-05-10T04:50:52.534 INFO:teuthology.orchestra.run.smithi117.stdout: mds verify scatter = True 2024-05-10T04:50:52.534 INFO:teuthology.orchestra.run.smithi117.stdout: osd op complaint time = 180 2024-05-10T04:50:52.534 INFO:teuthology.orchestra.run.smithi117.stdout: rados mon op timeout = 900 2024-05-10T04:50:52.534 INFO:teuthology.orchestra.run.smithi117.stdout: rados osd op timeout = 900 2024-05-10T04:50:52.543 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-10T04:50:52.543 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-10T04:50:52.733 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-10T04:50:52.734 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:52.734 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-10T04:50:52.779 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:52.779 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-10T04:50:52.865 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:50:52.865 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:52.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T04:50:52.866 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:50:53.001 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:50:53.001 DEBUG:teuthology.orchestra.run.smithi047:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:50:53.086 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T04:50:53.087 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:53.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-10T04:50:53.087 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-10T04:50:53.184 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:50:53.184 DEBUG:teuthology.orchestra.run.smithi117:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:50:53.269 INFO:tasks.ceph:Setting up mon nodes... 2024-05-10T04:50:53.269 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-10T04:50:53.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T04:50:53.464 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-10T04:50:53.479 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T04:50:53.684 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-10T04:50:53.699 INFO:tasks.ceph:Setting up mds nodes... 2024-05-10T04:50:53.699 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T04:50:53.888 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-10T04:50:53.901 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-10T04:50:53.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T04:50:54.158 INFO:teuthology.orchestra.run.smithi047.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-10T04:50:54.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-10T04:50:54.237 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T04:50:54.423 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-10T04:50:54.436 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-10T04:50:54.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T04:50:54.685 INFO:teuthology.orchestra.run.smithi117.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-10T04:50:54.697 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-10T04:50:54.763 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-10T04:50:54.763 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-10T04:50:54.932 INFO:teuthology.orchestra.run.smithi047.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-10T04:50:54.969 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-10T04:50:55.130 INFO:teuthology.orchestra.run.smithi117.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-05-10T04:50:55.165 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-10T04:50:55.165 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi047.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi117.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-10T04:50:55.166 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-10T04:50:55.233 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:50:55.233 INFO:tasks.ceph:role: osd.0 2024-05-10T04:50:55.233 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:50:55.233 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:50:55.299 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:50:55.300 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:50:55.300 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:50:55.300 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:50:55.323 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-10T04:50:55.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-10T04:50:55.411 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-10T04:50:55.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-10T04:50:55.586 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-10T04:50:55.652 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:50:55.653 INFO:tasks.ceph:role: osd.1 2024-05-10T04:50:55.653 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:50:55.653 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T04:50:55.719 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:50:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:50:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:50:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:50:55.719 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:50:55.719 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:50:55.720 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:50:55.720 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:50:55.720 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:50:55.720 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:50:55.742 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-10T04:50:55.747 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-10T04:50:55.747 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-10T04:50:55.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-10T04:50:55.921 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-10T04:50:55.987 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:50:55.988 INFO:tasks.ceph:role: osd.2 2024-05-10T04:50:55.988 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:50:55.988 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T04:50:56.053 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:50:56.053 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:50:56.053 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:50:56.054 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:50:56.076 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-10T04:50:56.080 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-10T04:50:56.080 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-10T04:50:56.181 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-10T04:50:56.253 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-10T04:50:56.319 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-10T04:50:56.319 INFO:tasks.ceph:role: osd.3 2024-05-10T04:50:56.319 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:50:56.319 DEBUG:teuthology.orchestra.run.smithi047:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:50:56.385 INFO:teuthology.orchestra.run.smithi047.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:50:56.408 INFO:teuthology.orchestra.run.smithi047.stdout:Discarding blocks...Done. 2024-05-10T04:50:56.411 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi047.front.sepia.ceph.com -o noatime 2024-05-10T04:50:56.412 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-10T04:50:56.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-10T04:50:56.587 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:50:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:50:57.301+0000 7ff261cec800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-10T04:50:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:50:57.301+0000 7ff261cec800 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-10T04:50:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:50:57.301+0000 7ff261cec800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:50:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:50:57.301+0000 7ff261cec800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:50:57.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:50:57.302+0000 7ff261cec800 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-10T04:50:57.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:50:57.304+0000 7ff261cec800 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-10T04:51:00.236 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-10T04:51:00.308 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:00.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:00.482+0000 7fd93984b800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-10T04:51:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:00.482+0000 7fd93984b800 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-10T04:51:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:00.482+0000 7fd93984b800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:51:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:00.482+0000 7fd93984b800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:51:00.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:00.482+0000 7fd93984b800 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-10T04:51:00.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:00.484+0000 7fd93984b800 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-10T04:51:03.441 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-10T04:51:03.513 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:03.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:03.690+0000 7fb4bd601800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-10T04:51:03.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:03.690+0000 7fb4bd601800 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-10T04:51:03.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:03.690+0000 7fb4bd601800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:51:03.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:03.690+0000 7fb4bd601800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:51:03.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:03.690+0000 7fb4bd601800 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-10T04:51:03.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:03.692+0000 7fb4bd601800 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-10T04:51:06.620 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-10T04:51:06.692 DEBUG:teuthology.orchestra.run.smithi047:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:06.869+0000 7ff9dc144800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-10T04:51:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:06.869+0000 7ff9dc144800 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-10T04:51:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:06.869+0000 7ff9dc144800 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:51:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:06.870+0000 7ff9dc144800 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:51:06.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:06.870+0000 7ff9dc144800 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-10T04:51:06.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:06.871+0000 7ff9dc144800 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-10T04:51:09.792 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-10T04:51:09.864 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-10T04:51:09.937 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:51:09.937 INFO:tasks.ceph:role: osd.4 2024-05-10T04:51:09.937 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T04:51:09.937 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-10T04:51:10.014 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:51:10.014 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:51:10.014 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:51:10.014 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:51:10.014 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:51:10.015 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:51:10.015 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:51:10.015 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:51:10.015 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:51:10.015 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:51:10.378 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-10T04:51:10.381 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-10T04:51:10.381 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-10T04:51:10.558 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-10T04:51:10.632 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-10T04:51:10.698 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:51:10.699 INFO:tasks.ceph:role: osd.5 2024-05-10T04:51:10.699 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T04:51:10.699 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:51:10.772 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:51:10.773 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:51:10.773 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:51:11.125 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-10T04:51:11.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-10T04:51:11.129 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-10T04:51:11.237 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-10T04:51:11.309 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-10T04:51:11.375 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:51:11.375 INFO:tasks.ceph:role: osd.6 2024-05-10T04:51:11.375 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T04:51:11.376 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:51:11.449 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:51:11.450 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:51:11.823 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-10T04:51:11.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-10T04:51:11.827 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-10T04:51:11.943 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-10T04:51:12.018 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-10T04:51:12.084 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-10T04:51:12.084 INFO:tasks.ceph:role: osd.7 2024-05-10T04:51:12.084 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T04:51:12.084 DEBUG:teuthology.orchestra.run.smithi117:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-10T04:51:12.158 INFO:teuthology.orchestra.run.smithi117.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: = sunit=0 swidth=0 blks 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-10T04:51:12.159 INFO:teuthology.orchestra.run.smithi117.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-10T04:51:12.542 INFO:teuthology.orchestra.run.smithi117.stdout:Discarding blocks...Done. 2024-05-10T04:51:12.545 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi117.front.sepia.ceph.com -o noatime 2024-05-10T04:51:12.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-10T04:51:12.717 DEBUG:teuthology.orchestra.run.smithi117:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-10T04:51:12.791 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:13.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:13.005+0000 7fa7fbc4f800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-10T04:51:13.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:13.006+0000 7fa7fbc4f800 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-10T04:51:13.006 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:13.006+0000 7fa7fbc4f800 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:51:13.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:13.006+0000 7fa7fbc4f800 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:51:13.007 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:13.006+0000 7fa7fbc4f800 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-10T04:51:13.009 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:13.008+0000 7fa7fbc4f800 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-10T04:51:15.960 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-10T04:51:16.028 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:16.198+0000 7ff342313800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-10T04:51:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:16.198+0000 7ff342313800 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-10T04:51:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:16.198+0000 7ff342313800 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:51:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:16.198+0000 7ff342313800 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:51:16.199 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:16.198+0000 7ff342313800 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-10T04:51:16.200 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:16.200+0000 7ff342313800 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-10T04:51:19.124 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-10T04:51:19.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:19.363+0000 7ff92659d800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-10T04:51:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:19.363+0000 7ff92659d800 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-10T04:51:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:19.363+0000 7ff92659d800 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:51:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:19.363+0000 7ff92659d800 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:51:19.364 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:19.363+0000 7ff92659d800 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-10T04:51:19.365 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:19.365+0000 7ff92659d800 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-10T04:51:19.568 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:19.573 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:22.295 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-10T04:51:22.362 DEBUG:teuthology.orchestra.run.smithi117:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:22.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:22.534+0000 7f2f1f845800 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-10T04:51:22.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:22.534+0000 7f2f1f845800 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-10T04:51:22.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:22.534+0000 7f2f1f845800 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:51:22.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:22.534+0000 7f2f1f845800 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:51:22.535 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:22.534+0000 7f2f1f845800 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-10T04:51:22.536 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:22.536+0000 7f2f1f845800 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-10T04:51:25.457 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-10T04:51:25.523 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-10T04:51:25.523 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:25.524 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-10T04:51:25.597 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:25.598 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-10T04:51:25.667 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:25.667 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-10T04:51:25.774 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:25.774 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-10T04:51:25.880 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:25.881 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-10T04:51:25.986 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:25.986 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-10T04:51:26.094 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:26.094 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-10T04:51:26.200 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.200 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-10T04:51:26.272 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.272 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-10T04:51:26.380 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.380 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-10T04:51:26.487 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.487 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-10T04:51:26.593 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.593 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-10T04:51:26.699 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.699 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-10T04:51:26.806 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-10T04:51:26.912 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:26.912 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-10T04:51:26.961 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:26.961 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-05-10T04:51:27.004 INFO:tasks.ceph:Adding keys to all mons... 2024-05-10T04:51:27.005 DEBUG:teuthology.orchestra.run.smithi047:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T04:51:27.008 DEBUG:teuthology.orchestra.run.smithi117:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-10T04:51:27.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.y] 2024-05-10T04:51:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCtpz1mDTCnGxAABG7hufCZYHqnjfFMbeREjQ== 2024-05-10T04:51:27.071 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.a] 2024-05-10T04:51:27.071 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCtpz1mEUz0NBAAxrtPWfR2+Mz9USlbKEuisw== 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.c] 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCupz1mxEZzCRAA3znjQsuRf36UZ8YJGmhU6w== 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.0] 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCxpz1mHmIPEhAAKi8sNfi0PgfYh0imC7l1Fw== 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.1] 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC0pz1m3DzSHBAAIFIeNFtnJpC8mm1mVhzmng== 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.2] 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC3pz1mOpY5KRAAuqWOaAYo7stPDImHcWvmlQ== 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.3] 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQC6pz1mC0jsMxAAs7kwEHeO98uAIfLkILyQUg== 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout:[mgr.x] 2024-05-10T04:51:27.072 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCtpz1mzv3PKBAAldBO6Hir1mkshFvW8MmIhA== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.b] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCupz1mRyI/GRAA0A/bRkKA0zhwLhFAJcgMvw== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[mds.d] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCupz1mFvXWKBAAOf+lxpuTMpcsOJhMdCByGg== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.4] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDBpz1mvi9bABAAqIcW7Ur48YG7h5HQif7CTw== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.5] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDEpz1mLgfbCxAAyRg64ciwd+5BFPilmhelyQ== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.6] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDHpz1m8SyuFRAADxprxcAxe+4UVsCs/9ytJw== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[osd.7] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQDKpz1mz/nfHxAAZJOKi4DlL0UrBYUjHm2NFQ== 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout:[client.0] 2024-05-10T04:51:27.073 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCupz1mylGXNxAAnp7QtmRCjMFg1Imf4D5gQw== 2024-05-10T04:51:27.074 INFO:teuthology.orchestra.run.smithi047.stdout:[client.1] 2024-05-10T04:51:27.074 INFO:teuthology.orchestra.run.smithi047.stdout: key = AQCvpz1mOZXFBxAA0P5HAC7m77XRf6ynK4BtvQ== 2024-05-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.y] 2024-05-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCtpz1mDTCnGxAABG7hufCZYHqnjfFMbeREjQ== 2024-05-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.a] 2024-05-10T04:51:27.107 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCtpz1mEUz0NBAAxrtPWfR2+Mz9USlbKEuisw== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.c] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCupz1mxEZzCRAA3znjQsuRf36UZ8YJGmhU6w== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.0] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCxpz1mHmIPEhAAKi8sNfi0PgfYh0imC7l1Fw== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.1] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC0pz1m3DzSHBAAIFIeNFtnJpC8mm1mVhzmng== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.2] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC3pz1mOpY5KRAAuqWOaAYo7stPDImHcWvmlQ== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.3] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQC6pz1mC0jsMxAAs7kwEHeO98uAIfLkILyQUg== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[mgr.x] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCtpz1mzv3PKBAAldBO6Hir1mkshFvW8MmIhA== 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.b] 2024-05-10T04:51:27.108 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCupz1mRyI/GRAA0A/bRkKA0zhwLhFAJcgMvw== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[mds.d] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCupz1mFvXWKBAAOf+lxpuTMpcsOJhMdCByGg== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.4] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDBpz1mvi9bABAAqIcW7Ur48YG7h5HQif7CTw== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.5] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDEpz1mLgfbCxAAyRg64ciwd+5BFPilmhelyQ== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.6] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDHpz1m8SyuFRAADxprxcAxe+4UVsCs/9ytJw== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[osd.7] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQDKpz1mz/nfHxAAZJOKi4DlL0UrBYUjHm2NFQ== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[client.0] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCupz1mylGXNxAAnp7QtmRCjMFg1Imf4D5gQw== 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout:[client.1] 2024-05-10T04:51:27.109 INFO:teuthology.orchestra.run.smithi117.stdout: key = AQCvpz1mOZXFBxAA0P5HAC7m77XRf6ynK4BtvQ== 2024-05-10T04:51:27.110 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:51:27.119 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:51:27.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:27.331 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:27.514 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:27.518 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:27.701 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:27.708 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:27.896 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:27.903 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:28.083 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:28.089 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:28.269 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:28.273 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:28.452 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:51:28.456 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-10T04:51:28.634 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:28.638 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:28.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:28.823 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-10T04:51:29.005 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.009 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.193 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.376 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.554 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.559 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-10T04:51:29.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:51:29.741 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:51:29.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:51:29.927 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-10T04:51:30.108 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-10T04:51:30.108 DEBUG:teuthology.orchestra.run.smithi047:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-10T04:51:30.175 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:51:30.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-10T04:51:30.441 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-10T04:51:30.508 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:51:30.705 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-10T04:51:30.772 DEBUG:teuthology.orchestra.run.smithi117:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-10T04:51:30.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-10T04:51:31.032 DEBUG:teuthology.orchestra.run.smithi117:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-10T04:51:31.098 DEBUG:teuthology.orchestra.run.smithi047:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:31.103 DEBUG:teuthology.orchestra.run.smithi117:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-10T04:51:31.148 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-10T04:51:31.148 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-10T04:51:31.148 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-10T04:51:31.152 INFO:tasks.ceph.mon.a:Started 2024-05-10T04:51:31.152 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-10T04:51:31.152 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-10T04:51:31.191 INFO:tasks.ceph.mon.b:Started 2024-05-10T04:51:31.191 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-10T04:51:31.191 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-10T04:51:31.195 INFO:tasks.ceph.mon.c:Started 2024-05-10T04:51:31.195 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-10T04:51:31.195 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-10T04:51:31.195 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-10T04:51:31.199 INFO:tasks.ceph.mgr.y:Started 2024-05-10T04:51:31.199 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-10T04:51:31.199 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-10T04:51:31.203 INFO:tasks.ceph.mgr.x:Started 2024-05-10T04:51:31.204 INFO:tasks.ceph:Setting crush tunables to default 2024-05-10T04:51:31.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph osd crush tunables default 2024-05-10T04:51:31.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.474+0000 7fcfeec00700 1 Processor -- start 2024-05-10T04:51:31.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.474+0000 7fcfeec00700 1 -- start start 2024-05-10T04:51:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.475+0000 7fcfeec00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 0x7fcfe80c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.475+0000 7fcfeec00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfe806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfeec00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe806d640 con 0x7fcfe80c6cc0 2024-05-10T04:51:31.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfeec00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe8152fc0 con 0x7fcfe8152bb0 2024-05-10T04:51:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfeec00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80c9800 con 0x7fcfe806bdb0 2024-05-10T04:51:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 0x7fcfe80c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfecc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfe806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7e00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fcfe80c6cc0 0x7fcfe80c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:52358/0 (socket says 172.21.15.47:52358) 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7e00700 1 -- 172.21.15.47:0/2747307598 learned_addr learned my addr 172.21.15.47:0/2747307598 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7400700 1 -- 172.21.15.47:0/2747307598 >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 msgr2=0x7fcfe80c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7400700 1 -- 172.21.15.47:0/2747307598 >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 msgr2=0x7fcfe80c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7400700 1 --2- 172.21.15.47:0/2747307598 >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 0x7fcfe80c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfe7400700 1 --2- 172.21.15.47:0/2747307598 >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 0x7fcfe80c5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfecc00700 1 -- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 msgr2=0x7fcfe806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfecc00700 1 -- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 msgr2=0x7fcfe806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfecc00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfe806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-10T04:51:31.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.476+0000 7fcfecc00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfe806c1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039505341 0 0) 0x7fcfe806d640 con 0x7fcfe80c6cc0 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfcc0035b0 con 0x7fcfe80c6cc0 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 256032232 0 0) 0x7fcfcc0035b0 con 0x7fcfe80c6cc0 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 msgr2=0x7fcfe806c1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfe806c1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 msgr2=0x7fcfe80c5cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 --2- 172.21.15.47:0/2747307598 >> v2:172.21.15.117:3300/0 conn(0x7fcfe8152bb0 0x7fcfe80c5cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe806c700 con 0x7fcfe80c6cc0 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7fcfd8001670 con 0x7fcfe80c6cc0 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 >> v1:172.21.15.117:6789/0 conn(0x7fcfe80c6cc0 legacy=0x7fcfe80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfcc003a00 0x7fcfcc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc004850 0x7fcfcc004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfcc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8152fc0 con 0x7fcfcc004850 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80c9800 con 0x7fcfcc003a00 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.643+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfcc005620 con 0x7fcfe806bdb0 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfcc003a00 0x7fcfcc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7400700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc004850 0x7fcfcc004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfecc00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfcc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 -- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 msgr2=0x7fcfcc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfe806bdb0 0x7fcfcc00ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 -- 172.21.15.47:0/2747307598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc004850 msgr2=0x7fcfcc004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfcc004850 0x7fcfcc004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 -- 172.21.15.47:0/2747307598 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfcc0035b0 con 0x7fcfcc003a00 2024-05-10T04:51:31.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.644+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfcc003a00 0x7fcfcc003e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800c210 tx=0x7fcfcc005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e10af701a994e3e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:31.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.645+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd800cd50 con 0x7fcfcc003a00 2024-05-10T04:51:31.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.645+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8005960 con 0x7fcfcc003a00 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.645+0000 7fcfe6a00700 1 -- 172.21.15.47:0/2747307598 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8005d10 con 0x7fcfcc003a00 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfeec00700 1 -- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfcc003a00 msgr2=0x7fcfcc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfeec00700 1 --2- 172.21.15.47:0/2747307598 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfcc003a00 0x7fcfcc003e70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800c210 tx=0x7fcfcc005880 comp rx=0 tx=0).stop 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfecc00700 1 -- 172.21.15.47:0/2747307598 reap_dead start 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfeec00700 1 -- 172.21.15.47:0/2747307598 shutdown_connections 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfeec00700 1 -- 172.21.15.47:0/2747307598 >> 172.21.15.47:0/2747307598 conn(0x7fcfe80ca960 msgr2=0x7fcfe80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfeec00700 1 -- 172.21.15.47:0/2747307598 shutdown_connections 2024-05-10T04:51:31.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.646+0000 7fcfeec00700 1 -- 172.21.15.47:0/2747307598 wait complete. 2024-05-10T04:51:31.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.649+0000 7fcfeec00700 1 Processor -- start 2024-05-10T04:51:31.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.649+0000 7fcfeec00700 1 -- start start 2024-05-10T04:51:31.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfeec00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 0x7fcfe81f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfeec00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfe8155960 0x7fcfe814f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfeec00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe8143e40 0x7fcfe8144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:31.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfeec00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81f2c60 con 0x7fcfe8155960 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfeec00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8153dd0 con 0x7fcfe8143e40 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfeec00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81ef810 con 0x7fcfcc003a00 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfe7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 0x7fcfe81f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfe7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfe8155960 0x7fcfe814f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfe7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 0x7fcfe81f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:39844/0 (socket says 172.21.15.47:39844) 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfe7e00700 1 -- 172.21.15.47:0/679493463 learned_addr learned my addr 172.21.15.47:0/679493463 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.651+0000 7fcfecc00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe8143e40 0x7fcfe8144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7e00700 1 -- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe8143e40 msgr2=0x7fcfe8144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe8143e40 0x7fcfe8144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7e00700 1 -- 172.21.15.47:0/679493463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfe8155960 msgr2=0x7fcfe814f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfe8155960 0x7fcfe814f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7e00700 1 -- 172.21.15.47:0/679493463 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe81562c0 con 0x7fcfcc003a00 2024-05-10T04:51:31.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7400700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfe8155960 0x7fcfe814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.652+0000 7fcfe7e00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 0x7fcfe81f3080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0055f0 tx=0x7fcfd8000fe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.653+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8004870 con 0x7fcfcc003a00 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.653+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd8004a10 con 0x7fcfcc003a00 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.653+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8004dc0 con 0x7fcfcc003a00 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.653+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe8156010 con 0x7fcfcc003a00 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.653+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe81539b0 con 0x7fcfcc003a00 2024-05-10T04:51:31.655 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.654+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcfd80073d0 con 0x7fcfcc003a00 2024-05-10T04:51:31.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.655+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe8072ec0 con 0x7fcfcc003a00 2024-05-10T04:51:31.656 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.655+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcfd80053b0 con 0x7fcfcc003a00 2024-05-10T04:51:31.658 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.658+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fcfd8045dc0 con 0x7fcfcc003a00 2024-05-10T04:51:31.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.740+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcfe81f2720 con 0x7fcfcc003a00 2024-05-10T04:51:31.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.744+0000 7fcfdfe00700 1 -- 172.21.15.47:0/679493463 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcfe81f2720 con 0x7fcfcc003a00 2024-05-10T04:51:31.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.745+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 msgr2=0x7fcfe81f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:31.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.745+0000 7fcfeec00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 0x7fcfe81f3080 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc0055f0 tx=0x7fcfd8000fe0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 shutdown_connections 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcfe8143e40 0x7fcfe8144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcfcc003a00 0x7fcfe81f3080 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 --2- 172.21.15.47:0/679493463 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcfe8155960 0x7fcfe814f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 >> 172.21.15.47:0/679493463 conn(0x7fcfe80ca960 msgr2=0x7fcfe80c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 shutdown_connections 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:31.746+0000 7fcfeec00700 1 -- 172.21.15.47:0/679493463 wait complete. 2024-05-10T04:51:31.747 INFO:teuthology.orchestra.run.smithi047.stderr:adjusted tunables profile to default 2024-05-10T04:51:31.772 INFO:tasks.ceph:check_enable_crimson: False 2024-05-10T04:51:31.772 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-10T04:51:31.772 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:31.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-10T04:51:31.801 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:31.799+0000 7f49e4c75240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T04:51:31.814 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:31.813+0000 7f384f06e240 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-10T04:51:31.839 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:31.839 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-10T04:51:31.949 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:31.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-10T04:51:32.009 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:32.007+0000 7f49e4c75240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T04:51:32.054 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:32.054+0000 7f384f06e240 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-10T04:51:32.070 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:51:32.070 DEBUG:teuthology.orchestra.run.smithi047:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-10T04:51:32.137 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:32.137 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-10T04:51:32.208 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:32.208 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-10T04:51:32.314 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:32.315 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-10T04:51:32.425 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:51:32.425 DEBUG:teuthology.orchestra.run.smithi117:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-10T04:51:32.471 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:32.469+0000 7f49e4c75240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T04:51:32.506 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:32.505+0000 7f384f06e240 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-10T04:51:32.535 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new ea304499-866a-4f25-b383-9a8ef9d64c2d 0 2024-05-10T04:51:32.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.840+0000 7fb8edc00700 1 Processor -- start 2024-05-10T04:51:32.842 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.840+0000 7fb8edc00700 1 -- start start 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8edc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8edc00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e806d640 con 0x7fb8e806bdb0 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8edc00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80c6100 con 0x7fb8e80c5cf0 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8edc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80c9800 con 0x7fb8e80c6cc0 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8dfe00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fb8e80c5cf0 0x7fb8e80c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:39540/0 (socket says 172.21.15.117:39540) 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8dfe00700 1 -- 172.21.15.117:0/2102347753 learned_addr learned my addr 172.21.15.117:0/2102347753 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.842+0000 7fb8e6a00700 1 --2- 172.21.15.117:0/2102347753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6000700 1 -- 172.21.15.117:0/2102347753 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793253524 0 0) 0x7fb8e80c6100 con 0x7fb8e80c5cf0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6000700 1 -- 172.21.15.117:0/2102347753 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8cc0035b0 con 0x7fb8e80c5cf0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6a00700 1 -- 172.21.15.117:0/2102347753 >> v1:172.21.15.117:6789/0 conn(0x7fb8e80c5cf0 legacy=0x7fb8e80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6a00700 1 -- 172.21.15.117:0/2102347753 >> v1:172.21.15.47:6789/0 conn(0x7fb8e806bdb0 legacy=0x7fb8e806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6000700 1 -- 172.21.15.117:0/2102347753 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378088946 0 0) 0x7fb8e806d640 con 0x7fb8e806bdb0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6a00700 1 -- 172.21.15.117:0/2102347753 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80c8910 con 0x7fb8e80c6cc0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.843+0000 7fb8e6a00700 1 --2- 172.21.15.117:0/2102347753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8152bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009870 tx=0x7fb8d8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f33f733fc872de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8e6000700 1 -- 172.21.15.117:0/2102347753 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8011830 con 0x7fb8e80c6cc0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8e6000700 1 -- 172.21.15.117:0/2102347753 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8011990 con 0x7fb8e80c6cc0 2024-05-10T04:51:32.846 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8e6000700 1 -- 172.21.15.117:0/2102347753 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8011d00 con 0x7fb8e80c6cc0 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8edc00700 1 -- 172.21.15.117:0/2102347753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 msgr2=0x7fb8e8152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8edc00700 1 --2- 172.21.15.117:0/2102347753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8152bb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8009870 tx=0x7fb8d8009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8edc00700 1 -- 172.21.15.117:0/2102347753 shutdown_connections 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8edc00700 1 --2- 172.21.15.117:0/2102347753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8152bb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.844+0000 7fb8edc00700 1 -- 172.21.15.117:0/2102347753 >> 172.21.15.117:0/2102347753 conn(0x7fb8e80ca960 msgr2=0x7fb8e80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.845+0000 7fb8edc00700 1 -- 172.21.15.117:0/2102347753 shutdown_connections 2024-05-10T04:51:32.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.845+0000 7fb8edc00700 1 -- 172.21.15.117:0/2102347753 wait complete. 2024-05-10T04:51:32.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.847+0000 7fb8edc00700 1 Processor -- start 2024-05-10T04:51:32.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.847+0000 7fb8edc00700 1 -- start start 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.848+0000 7fb8edc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 0x7fb8e814c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.848+0000 7fb8edc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8e80c5cf0 0x7fb8e814b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.848+0000 7fb8edc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.848+0000 7fb8edc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e814d280 con 0x7fb8e80c5cf0 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.848+0000 7fb8edc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80be8a0 con 0x7fb8e806bdb0 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.848+0000 7fb8edc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80bfbd0 con 0x7fb8e80c6cc0 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 0x7fb8e814c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 0x7fb8e814c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40472/0 (socket says 172.21.15.117:40472) 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 -- 172.21.15.117:0/4160726604 learned_addr learned my addr 172.21.15.117:0/4160726604 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8dfe00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8e80c5cf0 0x7fb8e814b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e7400700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:32.851 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 -- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 msgr2=0x7fb8e8149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8149920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 -- 172.21.15.117:0/4160726604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8e80c5cf0 msgr2=0x7fb8e814b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8e80c5cf0 0x7fb8e814b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 -- 172.21.15.117:0/4160726604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d80094a0 con 0x7fb8e806bdb0 2024-05-10T04:51:32.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.849+0000 7fb8e6a00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 0x7fb8e814c790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80090b0 tx=0x7fb8d8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:32.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.850+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80045d0 con 0x7fb8e806bdb0 2024-05-10T04:51:32.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.850+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d801e070 con 0x7fb8e806bdb0 2024-05-10T04:51:32.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.850+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e81ef330 con 0x7fb8e806bdb0 2024-05-10T04:51:32.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.850+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d80038c0 con 0x7fb8e806bdb0 2024-05-10T04:51:32.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.850+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e81eea00 con 0x7fb8e806bdb0 2024-05-10T04:51:32.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.850+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fb8d8003d20 con 0x7fb8e806bdb0 2024-05-10T04:51:32.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.851+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb8d802dd00 con 0x7fb8e806bdb0 2024-05-10T04:51:32.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.851+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e8074720 con 0x7fb8e806bdb0 2024-05-10T04:51:32.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.854+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fb8d8020070 con 0x7fb8e806bdb0 2024-05-10T04:51:32.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.941+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea304499-866a-4f25-b383-9a8ef9d64c2d", "id": 0} v 0) v1 -- 0x7fb8e8156f10 con 0x7fb8e806bdb0 2024-05-10T04:51:32.947 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.945+0000 7fb8dea00700 1 -- 172.21.15.117:0/4160726604 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea304499-866a-4f25-b383-9a8ef9d64c2d", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8d8015020 con 0x7fb8e806bdb0 2024-05-10T04:51:32.947 INFO:teuthology.orchestra.run.smithi117.stdout:0 2024-05-10T04:51:32.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 msgr2=0x7fb8e814c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:32.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 0x7fb8e814c790 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb8d80090b0 tx=0x7fb8d8004750 comp rx=0 tx=0).stop 2024-05-10T04:51:32.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 shutdown_connections 2024-05-10T04:51:32.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb8e80c6cc0 0x7fb8e8149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb8e806bdb0 0x7fb8e814c790 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 --2- 172.21.15.117:0/4160726604 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb8e80c5cf0 0x7fb8e814b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:32.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.946+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 >> 172.21.15.117:0/4160726604 conn(0x7fb8e80ca960 msgr2=0x7fb8e806c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:32.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.947+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 shutdown_connections 2024-05-10T04:51:32.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:32.947+0000 7fb8edc00700 1 -- 172.21.15.117:0/4160726604 wait complete. 2024-05-10T04:51:32.973 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 118bd21d-98bf-48a0-be7e-b15d5c881c29 1 2024-05-10T04:51:33.119 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:33.117+0000 7f49e4c75240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T04:51:33.147 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:33.146+0000 7f384f06e240 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-10T04:51:33.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.238+0000 7f3910a00700 1 Processor -- start 2024-05-10T04:51:33.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.238+0000 7f3910a00700 1 -- start start 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3910a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f390c0c6cc0 0x7f390c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3910a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f390c06bdb0 0x7f390c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3910a00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c06d640 con 0x7f390c0c5cf0 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3910a00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0c9800 con 0x7f390c06bdb0 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3910a00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c06c700 con 0x7f390c0c6cc0 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3909e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f390c0c6cc0 0x7f390c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3909e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f390c0c6cc0 0x7f390c152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40484/0 (socket says 172.21.15.117:40484) 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3909e00700 1 -- 172.21.15.117:0/3520904824 learned_addr learned my addr 172.21.15.117:0/3520904824 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f390a800700 1 --2- 172.21.15.117:0/3520904824 >> v2:172.21.15.47:3300/0 conn(0x7f390c06bdb0 0x7f390c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3909e00700 1 -- 172.21.15.117:0/3520904824 >> v2:172.21.15.47:3300/0 conn(0x7f390c06bdb0 msgr2=0x7f390c06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:33.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3909e00700 1 --2- 172.21.15.117:0/3520904824 >> v2:172.21.15.47:3300/0 conn(0x7f390c06bdb0 0x7f390c06c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.240+0000 7f3909e00700 1 -- 172.21.15.117:0/3520904824 >> v1:172.21.15.47:6789/0 conn(0x7f390c0c5cf0 legacy=0x7f390c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.243 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.241+0000 7f3909e00700 1 -- 172.21.15.117:0/3520904824 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0c6100 con 0x7f390c0c6cc0 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.241+0000 7f3909e00700 1 --2- 172.21.15.117:0/3520904824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c152bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f390c08c3a0 tx=0x7f38fc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aac9bcf79a06026b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.241+0000 7f3908a00700 1 -- 172.21.15.117:0/3520904824 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc011830 con 0x7f390c0c6cc0 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.241+0000 7f3908a00700 1 -- 172.21.15.117:0/3520904824 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc011990 con 0x7f390c0c6cc0 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.241+0000 7f3908a00700 1 -- 172.21.15.117:0/3520904824 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc011d20 con 0x7f390c0c6cc0 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 -- 172.21.15.117:0/3520904824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 msgr2=0x7f390c152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 --2- 172.21.15.117:0/3520904824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c152bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f390c08c3a0 tx=0x7f38fc009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 -- 172.21.15.117:0/3520904824 shutdown_connections 2024-05-10T04:51:33.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 --2- 172.21.15.117:0/3520904824 >> v2:172.21.15.47:3300/0 conn(0x7f390c06bdb0 0x7f390c06c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 --2- 172.21.15.117:0/3520904824 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c152bb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 -- 172.21.15.117:0/3520904824 >> 172.21.15.117:0/3520904824 conn(0x7f390c0ca960 msgr2=0x7f390c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 -- 172.21.15.117:0/3520904824 shutdown_connections 2024-05-10T04:51:33.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.242+0000 7f3910a00700 1 -- 172.21.15.117:0/3520904824 wait complete. 2024-05-10T04:51:33.245 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.244+0000 7f3910a00700 1 Processor -- start 2024-05-10T04:51:33.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.244+0000 7f3910a00700 1 -- start start 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.245+0000 7f3910a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 0x7f390c0ab930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3910a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390c0c5cf0 0x7f390c1eb370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3910a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3910a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1495c0 con 0x7f390c0c5cf0 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3910a00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1ef420 con 0x7f390c0c6cc0 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3910a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1eaf20 con 0x7f390c06bdb0 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3909e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 0x7f390c0ab930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3909e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 0x7f390c0ab930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:37914/0 (socket says 172.21.15.117:37914) 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3909e00700 1 -- 172.21.15.117:0/3055729283 learned_addr learned my addr 172.21.15.117:0/3055729283 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f390a800700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.250 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3909400700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390c0c5cf0 0x7f390c1eb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f390a800700 1 -- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 msgr2=0x7f390c0ab930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f390a800700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 0x7f390c0ab930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f390a800700 1 -- 172.21.15.117:0/3055729283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390c0c5cf0 msgr2=0x7f390c1eb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f390a800700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390c0c5cf0 0x7f390c1eb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f390a800700 1 -- 172.21.15.117:0/3055729283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38fc009550 con 0x7f390c0c6cc0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3909e00700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 0x7f390c0ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.246+0000 7f3909400700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390c0c5cf0 0x7f390c1eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f390a800700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c143ec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f390400eb70 tx=0x7f390400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904009a80 con 0x7f390c0c6cc0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f390400f040 con 0x7f390c0c6cc0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c1551d0 con 0x7f390c0c6cc0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f390400cc20 con 0x7f390c0c6cc0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0c4c50 con 0x7f390c0c6cc0 2024-05-10T04:51:33.251 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3904014780 con 0x7f390c0c6cc0 2024-05-10T04:51:33.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.247+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f390401dc30 con 0x7f390c0c6cc0 2024-05-10T04:51:33.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.248+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c144b70 con 0x7f390c0c6cc0 2024-05-10T04:51:33.252 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.251+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f390403bdc0 con 0x7f390c0c6cc0 2024-05-10T04:51:33.341 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.340+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "118bd21d-98bf-48a0-be7e-b15d5c881c29", "id": 1} v 0) v1 -- 0x7f390c072ec0 con 0x7f390c0c6cc0 2024-05-10T04:51:33.346 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.344+0000 7f3902000700 1 -- 172.21.15.117:0/3055729283 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "118bd21d-98bf-48a0-be7e-b15d5c881c29", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f390402a030 con 0x7f390c0c6cc0 2024-05-10T04:51:33.346 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-05-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 msgr2=0x7f390c143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c143ec0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f390400eb70 tx=0x7f390400ee80 comp rx=0 tx=0).stop 2024-05-10T04:51:33.347 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 shutdown_connections 2024-05-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f390c0c6cc0 0x7f390c143ec0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f390c06bdb0 0x7f390c0ab930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 --2- 172.21.15.117:0/3055729283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f390c0c5cf0 0x7f390c1eb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.345+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 >> 172.21.15.117:0/3055729283 conn(0x7f390c0ca960 msgr2=0x7f390c152160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.346+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 shutdown_connections 2024-05-10T04:51:33.348 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.346+0000 7f3910a00700 1 -- 172.21.15.117:0/3055729283 wait complete. 2024-05-10T04:51:33.371 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 6c63a1dd-1a77-4b38-bc70-c8bd6e646124 2 2024-05-10T04:51:33.390 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:33.388+0000 7f49e4c75240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T04:51:33.412 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:33.411+0000 7f384f06e240 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-10T04:51:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.630+0000 7f0657000700 1 Processor -- start 2024-05-10T04:51:33.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.630+0000 7f0657000700 1 -- start start 2024-05-10T04:51:33.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0657000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f06500c6cc0 0x7f0650152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0657000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f065006bdb0 0x7f065006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0657000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065006d640 con 0x7f06500c5cf0 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0657000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06500c9800 con 0x7f06500c6cc0 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0657000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065006c700 con 0x7f065006bdb0 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0655000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f065006bdb0 0x7f065006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0655000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f065006bdb0 0x7f065006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40506/0 (socket says 172.21.15.117:40506) 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f0655000700 1 -- 172.21.15.117:0/1415800410 learned_addr learned my addr 172.21.15.117:0/1415800410 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:33.634 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.632+0000 7f064fe00700 1 --2- 172.21.15.117:0/1415800410 >> v2:172.21.15.47:3300/0 conn(0x7f06500c6cc0 0x7f0650152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f0655000700 1 -- 172.21.15.117:0/1415800410 >> v2:172.21.15.47:3300/0 conn(0x7f06500c6cc0 msgr2=0x7f0650152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f0655000700 1 --2- 172.21.15.117:0/1415800410 >> v2:172.21.15.47:3300/0 conn(0x7f06500c6cc0 0x7f0650152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f0655000700 1 -- 172.21.15.117:0/1415800410 >> v1:172.21.15.47:6789/0 conn(0x7f06500c5cf0 legacy=0x7f06500c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f0655000700 1 -- 172.21.15.117:0/1415800410 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06500c6100 con 0x7f065006bdb0 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f064fe00700 1 --2- 172.21.15.117:0/1415800410 >> v2:172.21.15.47:3300/0 conn(0x7f06500c6cc0 0x7f0650152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f0655000700 1 --2- 172.21.15.117:0/1415800410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f065006bdb0 0x7f065006c1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06501530f0 tx=0x7f064800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8604f520c6e0d1e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f064ea00700 1 -- 172.21.15.117:0/1415800410 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800e070 con 0x7f065006bdb0 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f064ea00700 1 -- 172.21.15.117:0/1415800410 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064800b910 con 0x7f065006bdb0 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.633+0000 7f064ea00700 1 -- 172.21.15.117:0/1415800410 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064800bcc0 con 0x7f065006bdb0 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 -- 172.21.15.117:0/1415800410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f065006bdb0 msgr2=0x7f065006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 --2- 172.21.15.117:0/1415800410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f065006bdb0 0x7f065006c1c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f06501530f0 tx=0x7f064800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 -- 172.21.15.117:0/1415800410 shutdown_connections 2024-05-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 --2- 172.21.15.117:0/1415800410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f065006bdb0 0x7f065006c1c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 --2- 172.21.15.117:0/1415800410 >> v2:172.21.15.47:3300/0 conn(0x7f06500c6cc0 0x7f0650152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 -- 172.21.15.117:0/1415800410 >> 172.21.15.117:0/1415800410 conn(0x7f06500ca960 msgr2=0x7f06500cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 -- 172.21.15.117:0/1415800410 shutdown_connections 2024-05-10T04:51:33.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.634+0000 7f0657000700 1 -- 172.21.15.117:0/1415800410 wait complete. 2024-05-10T04:51:33.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.637+0000 7f0657000700 1 Processor -- start 2024-05-10T04:51:33.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.637+0000 7f0657000700 1 -- start start 2024-05-10T04:51:33.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0657000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f065006bdb0 0x7f0650148170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0657000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06500c5cf0 0x7f06501eb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0657000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 0x7f065014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0657000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501ebce0 con 0x7f065006bdb0 2024-05-10T04:51:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0657000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501e1400 con 0x7f06500c5cf0 2024-05-10T04:51:33.641 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0657000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06501e1220 con 0x7f06500c6cc0 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f064fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f065006bdb0 0x7f0650148170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0655000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 0x7f065014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0655000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 0x7f065014c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:37916/0 (socket says 172.21.15.117:37916) 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.639+0000 7f0655000700 1 -- 172.21.15.117:0/967869812 learned_addr learned my addr 172.21.15.117:0/967869812 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f064f400700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06500c5cf0 0x7f06501eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0655000700 1 -- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06500c5cf0 msgr2=0x7f06501eb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0655000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06500c5cf0 0x7f06501eb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0655000700 1 -- 172.21.15.117:0/967869812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f065006bdb0 msgr2=0x7f0650148170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0655000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f065006bdb0 0x7f0650148170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.643 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0655000700 1 -- 172.21.15.117:0/967869812 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400094a0 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0655000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 0x7f065014c7a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0648012000 tx=0x7f0648004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.640+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648004880 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.641+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06480099b0 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.641+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0648009b30 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.641+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064801b670 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.641+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06501e1930 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.641+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f064801bad0 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.641+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0648024af0 con 0x7f06500c6cc0 2024-05-10T04:51:33.644 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.642+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0650074720 con 0x7f06500c6cc0 2024-05-10T04:51:33.646 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.644+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f0648042dc0 con 0x7f06500c6cc0 2024-05-10T04:51:33.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.731+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6c63a1dd-1a77-4b38-bc70-c8bd6e646124", "id": 2} v 0) v1 -- 0x7f06500c8b70 con 0x7f06500c6cc0 2024-05-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.736+0000 7f0647e00700 1 -- 172.21.15.117:0/967869812 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6c63a1dd-1a77-4b38-bc70-c8bd6e646124", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0648031030 con 0x7f06500c6cc0 2024-05-10T04:51:33.737 INFO:teuthology.orchestra.run.smithi117.stdout:2 2024-05-10T04:51:33.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 msgr2=0x7f065014c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:33.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 0x7f065014c7a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0648012000 tx=0x7f0648004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.738 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 shutdown_connections 2024-05-10T04:51:33.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f06500c6cc0 0x7f065014c7a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f065006bdb0 0x7f0650148170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 --2- 172.21.15.117:0/967869812 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f06500c5cf0 0x7f06501eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:33.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 >> 172.21.15.117:0/967869812 conn(0x7f06500ca960 msgr2=0x7f0650156da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:33.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 shutdown_connections 2024-05-10T04:51:33.739 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:33.737+0000 7f0657000700 1 -- 172.21.15.117:0/967869812 wait complete. 2024-05-10T04:51:33.762 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 9973fadf-e90e-4ba5-bdad-486dae45e099 3 2024-05-10T04:51:33.886 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:33.885+0000 7f49e4c75240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T04:51:33.895 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:33.894+0000 7f384f06e240 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-10T04:51:34.062 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.061+0000 7fc867c00700 1 Processor -- start 2024-05-10T04:51:34.063 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.061+0000 7fc867c00700 1 -- start start 2024-05-10T04:51:34.065 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc867c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc86006ded0 0x7fc8601509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc867c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8601570b0 0x7fc8600c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc867c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86006e4b0 con 0x7fc8600c2410 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc867c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600c2d60 con 0x7fc86006ded0 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc867c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8600aa1d0 con 0x7fc8601570b0 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc85fe00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fc8600c2410 0x7fc8601569a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:39550/0 (socket says 172.21.15.117:39550) 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc865c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc8601570b0 0x7fc8600c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc85fe00700 1 -- 172.21.15.117:0/3139763456 learned_addr learned my addr 172.21.15.117:0/3139763456 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc865200700 1 --2- 172.21.15.117:0/3139763456 >> v2:172.21.15.47:3300/0 conn(0x7fc86006ded0 0x7fc8601509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.063+0000 7fc865c00700 1 -- 172.21.15.117:0/3139763456 >> v2:172.21.15.47:3300/0 conn(0x7fc86006ded0 msgr2=0x7fc8601509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:34.066 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc865c00700 1 --2- 172.21.15.117:0/3139763456 >> v2:172.21.15.47:3300/0 conn(0x7fc86006ded0 0x7fc8601509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc865c00700 1 -- 172.21.15.117:0/3139763456 >> v1:172.21.15.117:6789/0 conn(0x7fc8600c2410 legacy=0x7fc8601569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc865c00700 1 -- 172.21.15.117:0/3139763456 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8601534c0 con 0x7fc8601570b0 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc85f400700 1 -- 172.21.15.117:0/3139763456 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172444351 0 0) 0x7fc86006e4b0 con 0x7fc8600c2410 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc865c00700 1 --2- 172.21.15.117:0/3139763456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc8600c2820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8600c1640 tx=0x7fc85800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81651bbf246f127b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc85f400700 1 -- 172.21.15.117:0/3139763456 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85800e070 con 0x7fc8601570b0 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc85f400700 1 -- 172.21.15.117:0/3139763456 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85800bb20 con 0x7fc8601570b0 2024-05-10T04:51:34.067 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.064+0000 7fc85f400700 1 -- 172.21.15.117:0/3139763456 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858012430 con 0x7fc8601570b0 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 -- 172.21.15.117:0/3139763456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 msgr2=0x7fc8600c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 --2- 172.21.15.117:0/3139763456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc8600c2820 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc8600c1640 tx=0x7fc85800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 -- 172.21.15.117:0/3139763456 shutdown_connections 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 --2- 172.21.15.117:0/3139763456 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc8600c2820 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 --2- 172.21.15.117:0/3139763456 >> v2:172.21.15.47:3300/0 conn(0x7fc86006ded0 0x7fc8601509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 -- 172.21.15.117:0/3139763456 >> 172.21.15.117:0/3139763456 conn(0x7fc8600a8ae0 msgr2=0x7fc8600a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 -- 172.21.15.117:0/3139763456 shutdown_connections 2024-05-10T04:51:34.068 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.065+0000 7fc867c00700 1 -- 172.21.15.117:0/3139763456 wait complete. 2024-05-10T04:51:34.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.067+0000 7fc867c00700 1 Processor -- start 2024-05-10T04:51:34.069 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.067+0000 7fc867c00700 1 -- start start 2024-05-10T04:51:34.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc867c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 0x7fc86014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc867c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8600c2410 0x7fc8601eb760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc867c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc860149cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc867c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601ef1d0 con 0x7fc8600c2410 2024-05-10T04:51:34.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc867c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc860155120 con 0x7fc8601570b0 2024-05-10T04:51:34.072 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc867c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8601ef420 con 0x7fc86006ded0 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc865200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 0x7fc86014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc865c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc860149cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc865200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 0x7fc86014c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:37930/0 (socket says 172.21.15.117:37930) 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc865200700 1 -- 172.21.15.117:0/544256332 learned_addr learned my addr 172.21.15.117:0/544256332 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc865c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc860149cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40538/0 (socket says 172.21.15.117:40538) 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.069+0000 7fc85fe00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8600c2410 0x7fc8601eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865200700 1 -- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 msgr2=0x7fc860149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865200700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc860149cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865200700 1 -- 172.21.15.117:0/544256332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8600c2410 msgr2=0x7fc8601eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865200700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8600c2410 0x7fc8601eb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865200700 1 -- 172.21.15.117:0/544256332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc858009a70 con 0x7fc86006ded0 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865c00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc860149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc85fe00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8600c2410 0x7fc8601eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:34.073 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc865200700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 0x7fc86014c010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc85400e840 tx=0x7fc85400eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854009590 con 0x7fc86006ded0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854013680 con 0x7fc86006ded0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854013a10 con 0x7fc86006ded0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc860155370 con 0x7fc86006ded0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.070+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc86014a8b0 con 0x7fc86006ded0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.071+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc854005a20 con 0x7fc86006ded0 2024-05-10T04:51:34.074 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.071+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fc854006660 con 0x7fc86006ded0 2024-05-10T04:51:34.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.071+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc860074720 con 0x7fc86006ded0 2024-05-10T04:51:34.075 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.074+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7fc854021060 con 0x7fc86006ded0 2024-05-10T04:51:34.162 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.160+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9973fadf-e90e-4ba5-bdad-486dae45e099", "id": 3} v 0) v1 -- 0x7fc86006f3e0 con 0x7fc86006ded0 2024-05-10T04:51:34.166 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.164+0000 7fc85cc00700 1 -- 172.21.15.117:0/544256332 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9973fadf-e90e-4ba5-bdad-486dae45e099", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc854017070 con 0x7fc86006ded0 2024-05-10T04:51:34.166 INFO:teuthology.orchestra.run.smithi117.stdout:3 2024-05-10T04:51:34.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 msgr2=0x7fc86014c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 0x7fc86014c010 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc85400e840 tx=0x7fc85400eb50 comp rx=0 tx=0).stop 2024-05-10T04:51:34.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 shutdown_connections 2024-05-10T04:51:34.167 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc8601570b0 0x7fc860149cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc86006ded0 0x7fc86014c010 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 --2- 172.21.15.117:0/544256332 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc8600c2410 0x7fc8601eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.165+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 >> 172.21.15.117:0/544256332 conn(0x7fc8600a8ae0 msgr2=0x7fc8600c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.166+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 shutdown_connections 2024-05-10T04:51:34.168 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.166+0000 7fc867c00700 1 -- 172.21.15.117:0/544256332 wait complete. 2024-05-10T04:51:34.192 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 4ef23640-6801-43e1-a3de-15909bbb34c8 4 2024-05-10T04:51:34.453 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.452+0000 7f7b90c00700 1 Processor -- start 2024-05-10T04:51:34.454 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.452+0000 7f7b90c00700 1 -- start start 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.453+0000 7f7b90c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0c6d90 0x7f7b8c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b90c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c0c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b90c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8c0c31e0 con 0x7f7b8c0ca8f0 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b90c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8c0c50e0 con 0x7f7b8c0c6d90 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b90c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c0cb110 con 0x7f7b8c0cad00 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b8a800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c0c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.456 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b89400700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7b8c0ca8f0 0x7f7b8c0c3600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:39562/0 (socket says 172.21.15.117:39562) 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b89400700 1 -- 172.21.15.117:0/4209865453 learned_addr learned my addr 172.21.15.117:0/4209865453 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b89e00700 1 --2- 172.21.15.117:0/4209865453 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0c6d90 0x7f7b8c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b88a00700 1 -- 172.21.15.117:0/4209865453 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3072804253 0 0) 0x7f7b8c0c31e0 con 0x7f7b8c0ca8f0 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b88a00700 1 -- 172.21.15.117:0/4209865453 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b700035b0 con 0x7f7b8c0ca8f0 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b8a800700 1 -- 172.21.15.117:0/4209865453 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0c6d90 msgr2=0x7f7b8c155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b8a800700 1 --2- 172.21.15.117:0/4209865453 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0c6d90 0x7f7b8c155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b8a800700 1 -- 172.21.15.117:0/4209865453 >> v1:172.21.15.117:6789/0 conn(0x7f7b8c0ca8f0 legacy=0x7f7b8c0c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.454+0000 7f7b8a800700 1 -- 172.21.15.117:0/4209865453 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8c0c5340 con 0x7f7b8c0cad00 2024-05-10T04:51:34.457 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.455+0000 7f7b8a800700 1 --2- 172.21.15.117:0/4209865453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c0c3d10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009d90 tx=0x7f7b8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e3025d35d696a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.455+0000 7f7b88a00700 1 -- 172.21.15.117:0/4209865453 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8400e070 con 0x7f7b8c0cad00 2024-05-10T04:51:34.458 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.455+0000 7f7b88a00700 1 -- 172.21.15.117:0/4209865453 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b8400bb20 con 0x7f7b8c0cad00 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.455+0000 7f7b88a00700 1 -- 172.21.15.117:0/4209865453 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84012430 con 0x7f7b8c0cad00 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 -- 172.21.15.117:0/4209865453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 msgr2=0x7f7b8c0c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 --2- 172.21.15.117:0/4209865453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c0c3d10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7b84009d90 tx=0x7f7b8400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 -- 172.21.15.117:0/4209865453 shutdown_connections 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 --2- 172.21.15.117:0/4209865453 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c0c3d10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 --2- 172.21.15.117:0/4209865453 >> v2:172.21.15.47:3300/0 conn(0x7f7b8c0c6d90 0x7f7b8c155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 -- 172.21.15.117:0/4209865453 >> 172.21.15.117:0/4209865453 conn(0x7f7b8c0c7620 msgr2=0x7f7b8c0c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 -- 172.21.15.117:0/4209865453 shutdown_connections 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.456+0000 7f7b90c00700 1 -- 172.21.15.117:0/4209865453 wait complete. 2024-05-10T04:51:34.459 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.458+0000 7f7b90c00700 1 Processor -- start 2024-05-10T04:51:34.460 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.458+0000 7f7b90c00700 1 -- start start 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b90c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b8c0c6d90 0x7f7b8c140490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b90c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b8c0ca8f0 0x7f7b8c0c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b90c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c1410d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b90c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c1428f0 con 0x7f7b8c0ca8f0 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b90c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c143620 con 0x7f7b8c0c6d90 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b90c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b8c1ef2b0 con 0x7f7b8c0cad00 2024-05-10T04:51:34.462 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b8a800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c1410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b89e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b8c0c6d90 0x7f7b8c140490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b8a800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c1410d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:37938/0 (socket says 172.21.15.117:37938) 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b8a800700 1 -- 172.21.15.117:0/1599850720 learned_addr learned my addr 172.21.15.117:0/1599850720 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.460+0000 7f7b89400700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b8c0ca8f0 0x7f7b8c0c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b8a800700 1 -- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b8c0c6d90 msgr2=0x7f7b8c140490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b8a800700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b8c0c6d90 0x7f7b8c140490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b8a800700 1 -- 172.21.15.117:0/1599850720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b8c0ca8f0 msgr2=0x7f7b8c0c0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b8a800700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b8c0ca8f0 0x7f7b8c0c0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.463 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b8a800700 1 -- 172.21.15.117:0/1599850720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b84009a70 con 0x7f7b8c0cad00 2024-05-10T04:51:34.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b8a800700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c1410d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b84014040 tx=0x7f7b84004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b840129f0 con 0x7f7b8c0cad00 2024-05-10T04:51:34.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b84020070 con 0x7f7b8c0cad00 2024-05-10T04:51:34.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b84012dd0 con 0x7f7b8c0cad00 2024-05-10T04:51:34.464 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.461+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8c158820 con 0x7f7b8c0cad00 2024-05-10T04:51:34.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.462+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8c141b30 con 0x7f7b8c0cad00 2024-05-10T04:51:34.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.462+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f7b84004340 con 0x7f7b8c0cad00 2024-05-10T04:51:34.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.462+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7b84022070 con 0x7f7b8c0cad00 2024-05-10T04:51:34.465 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.463+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8c074720 con 0x7f7b8c0cad00 2024-05-10T04:51:34.466 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.465+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f7b8402c060 con 0x7f7b8c0cad00 2024-05-10T04:51:34.555 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.553+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ef23640-6801-43e1-a3de-15909bbb34c8", "id": 4} v 0) v1 -- 0x7f7b8c0bf960 con 0x7f7b8c0cad00 2024-05-10T04:51:34.559 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.557+0000 7f7b82000700 1 -- 172.21.15.117:0/1599850720 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ef23640-6801-43e1-a3de-15909bbb34c8", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7b840045f0 con 0x7f7b8c0cad00 2024-05-10T04:51:34.559 INFO:teuthology.orchestra.run.smithi117.stdout:4 2024-05-10T04:51:34.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.558+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 msgr2=0x7f7b8c1410d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.560 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.558+0000 7f7b90c00700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c1410d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7b84014040 tx=0x7f7b84004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 shutdown_connections 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7b8c0cad00 0x7f7b8c1410d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7b8c0c6d90 0x7f7b8c140490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 --2- 172.21.15.117:0/1599850720 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7b8c0ca8f0 0x7f7b8c0c0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 >> 172.21.15.117:0/1599850720 conn(0x7f7b8c0c7620 msgr2=0x7f7b8c0c8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 shutdown_connections 2024-05-10T04:51:34.561 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.559+0000 7f7b90c00700 1 -- 172.21.15.117:0/1599850720 wait complete. 2024-05-10T04:51:34.583 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new c150d7f7-c885-4771-bbd8-69efcfa0a15d 5 2024-05-10T04:51:34.750 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:34.750+0000 7f384f06e240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T04:51:34.753 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:34.752+0000 7f49e4c75240 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-10T04:51:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.841+0000 7f6516c00700 1 Processor -- start 2024-05-10T04:51:34.843 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.841+0000 7f6516c00700 1 -- start start 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f6516c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f65100c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f6516c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65100c3b40 0x7f65100c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f6516c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100c31e0 con 0x7f65100c6d90 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f6516c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65100c50e0 con 0x7f65100c3b40 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f6516c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6510156300 con 0x7f6510155ef0 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f650f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f65100c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f6514c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f65100c3b40 0x7f65100c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f650fe00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f65100c6d90 0x7f65100ca8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.117:39578/0 (socket says 172.21.15.117:39578) 2024-05-10T04:51:34.845 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.843+0000 7f650fe00700 1 -- 172.21.15.117:0/2855438126 learned_addr learned my addr 172.21.15.117:0/2855438126 (peer_addr_for_me v1:172.21.15.117:0/0) 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650f400700 1 -- 172.21.15.117:0/2855438126 >> v2:172.21.15.117:3300/0 conn(0x7f65100c3b40 msgr2=0x7f65100c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650f400700 1 --2- 172.21.15.117:0/2855438126 >> v2:172.21.15.117:3300/0 conn(0x7f65100c3b40 0x7f65100c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650f400700 1 -- 172.21.15.117:0/2855438126 >> v1:172.21.15.117:6789/0 conn(0x7f65100c6d90 legacy=0x7f65100ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650f400700 1 -- 172.21.15.117:0/2855438126 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100c5340 con 0x7f6510155ef0 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f6514c00700 1 --2- 172.21.15.117:0/2855438126 >> v2:172.21.15.117:3300/0 conn(0x7f65100c3b40 0x7f65100c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650ea00700 1 -- 172.21.15.117:0/2855438126 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336068518 0 0) 0x7f65100c31e0 con 0x7f65100c6d90 2024-05-10T04:51:34.847 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650f400700 1 --2- 172.21.15.117:0/2855438126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f65100c3600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009840 tx=0x7f64fc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9642ed842ee5db7a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650ea00700 1 -- 172.21.15.117:0/2855438126 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011830 con 0x7f6510155ef0 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650ea00700 1 -- 172.21.15.117:0/2855438126 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc011990 con 0x7f6510155ef0 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.844+0000 7f650ea00700 1 -- 172.21.15.117:0/2855438126 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc011d20 con 0x7f6510155ef0 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 -- 172.21.15.117:0/2855438126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 msgr2=0x7f65100c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 --2- 172.21.15.117:0/2855438126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f65100c3600 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009840 tx=0x7f64fc009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 -- 172.21.15.117:0/2855438126 shutdown_connections 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 --2- 172.21.15.117:0/2855438126 >> v2:172.21.15.117:3300/0 conn(0x7f65100c3b40 0x7f65100c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 --2- 172.21.15.117:0/2855438126 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f65100c3600 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 -- 172.21.15.117:0/2855438126 >> 172.21.15.117:0/2855438126 conn(0x7f65100c7620 msgr2=0x7f65100c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 -- 172.21.15.117:0/2855438126 shutdown_connections 2024-05-10T04:51:34.848 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.845+0000 7f6516c00700 1 -- 172.21.15.117:0/2855438126 wait complete. 2024-05-10T04:51:34.849 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:34.846+0000 7f384f06e240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T04:51:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.847+0000 7f6516c00700 1 Processor -- start 2024-05-10T04:51:34.849 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.847+0000 7f6516c00700 1 -- start start 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6516c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 0x7f6510159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6516c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65100c6d90 0x7f6510146cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6516c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f6510157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6516c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65101ec320 con 0x7f65100c6d90 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6516c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65101ebdc0 con 0x7f65100c3b40 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6516c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65101ec040 con 0x7f6510155ef0 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 0x7f6510159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 0x7f6510159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.117:40558/0 (socket says 172.21.15.117:40558) 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 -- 172.21.15.117:0/1916743717 learned_addr learned my addr 172.21.15.117:0/1916743717 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f6514c00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f6510157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.852 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650f400700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65100c6d90 0x7f6510146cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 -- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 msgr2=0x7f6510157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f6510157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 -- 172.21.15.117:0/1916743717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65100c6d90 msgr2=0x7f6510146cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65100c6d90 0x7f6510146cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.849+0000 7f650fe00700 1 -- 172.21.15.117:0/1916743717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6508009a70 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f650fe00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 0x7f6510159220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f650000c520 tx=0x7f650000c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500004c80 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500004de0 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc0094a0 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65000072d0 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6510156c70 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f650001d3f0 con 0x7f65100c3b40 2024-05-10T04:51:34.853 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.850+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f6500013940 con 0x7f65100c3b40 2024-05-10T04:51:34.854 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:34.851+0000 7f49e4c75240 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-10T04:51:34.854 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.851+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6510074720 con 0x7f65100c3b40 2024-05-10T04:51:34.855 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.854+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6500013be0 con 0x7f65100c3b40 2024-05-10T04:51:34.942 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.940+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c150d7f7-c885-4771-bbd8-69efcfa0a15d", "id": 5} v 0) v1 -- 0x7f65100bf960 con 0x7f65100c3b40 2024-05-10T04:51:34.946 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.945+0000 7f6507e00700 1 -- 172.21.15.117:0/1916743717 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c150d7f7-c885-4771-bbd8-69efcfa0a15d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6500013d80 con 0x7f65100c3b40 2024-05-10T04:51:34.946 INFO:teuthology.orchestra.run.smithi117.stdout:5 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 msgr2=0x7f6510159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 0x7f6510159220 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f650000c520 tx=0x7f650000c830 comp rx=0 tx=0).stop 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 shutdown_connections 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6510155ef0 0x7f6510157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f65100c3b40 0x7f6510159220 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 --2- 172.21.15.117:0/1916743717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f65100c6d90 0x7f6510146cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:34.948 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 >> 172.21.15.117:0/1916743717 conn(0x7f65100c7620 msgr2=0x7f6510147dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:34.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 shutdown_connections 2024-05-10T04:51:34.949 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:34.946+0000 7f6516c00700 1 -- 172.21.15.117:0/1916743717 wait complete. 2024-05-10T04:51:34.974 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new b5083688-fdec-454e-80ae-8cb32bf2492e 6 2024-05-10T04:51:35.024 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.023+0000 7f384f06e240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T04:51:35.031 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:35.030+0000 7f49e4c75240 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-10T04:51:35.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.234+0000 7f6da5e00700 1 Processor -- start 2024-05-10T04:51:35.236 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.234+0000 7f6da5e00700 1 -- start start 2024-05-10T04:51:35.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6da5e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6da006ded0 0x7f6da01509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6da5e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da00c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6da5e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da006e4b0 con 0x7f6da00c2410 2024-05-10T04:51:35.238 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6da5e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da00c2d60 con 0x7f6da006ded0 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6da5e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00aa1d0 con 0x7f6da01570b0 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6d9f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da00c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6d9ea00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6da006ded0 0x7f6da01509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6d9ea00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6da006ded0 0x7f6da01509b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.117:37824/0 (socket says 172.21.15.117:37824) 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6d9f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da00c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:37966/0 (socket says 172.21.15.117:37966) 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.236+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2986199598 learned_addr learned my addr 172.21.15.117:0/2986199598 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2986199598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 msgr2=0x7f6da00c2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9ea00700 1 --2- 172.21.15.117:0/2986199598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da00c2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2986199598 >> v1:172.21.15.47:6789/0 conn(0x7f6da00c2410 legacy=0x7f6da01569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2986199598 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da01534c0 con 0x7f6da006ded0 2024-05-10T04:51:35.239 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9ea00700 1 --2- 172.21.15.117:0/2986199598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da01509b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009920 tx=0x7f6d90009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13df2b36f19ff8ef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9e000700 1 -- 172.21.15.117:0/2986199598 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90011830 con 0x7f6da006ded0 2024-05-10T04:51:35.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9e000700 1 -- 172.21.15.117:0/2986199598 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d90011990 con 0x7f6da006ded0 2024-05-10T04:51:35.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.237+0000 7f6d9e000700 1 -- 172.21.15.117:0/2986199598 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90011d20 con 0x7f6da006ded0 2024-05-10T04:51:35.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 -- 172.21.15.117:0/2986199598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 msgr2=0x7f6da01509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2986199598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da01509b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d90009920 tx=0x7f6d90009c30 comp rx=0 tx=0).stop 2024-05-10T04:51:35.240 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 -- 172.21.15.117:0/2986199598 shutdown_connections 2024-05-10T04:51:35.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2986199598 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da01509b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2986199598 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da00c2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 -- 172.21.15.117:0/2986199598 >> 172.21.15.117:0/2986199598 conn(0x7f6da00a8ae0 msgr2=0x7f6da00a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:35.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 -- 172.21.15.117:0/2986199598 shutdown_connections 2024-05-10T04:51:35.241 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.238+0000 7f6da5e00700 1 -- 172.21.15.117:0/2986199598 wait complete. 2024-05-10T04:51:35.241 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.240+0000 7f384f06e240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T04:51:35.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.240+0000 7f6da5e00700 1 Processor -- start 2024-05-10T04:51:35.242 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.241+0000 7f6da5e00700 1 -- start start 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6da5e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da0072660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6da5e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da00c2410 0x7f6da01ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6da5e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da0149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6da5e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00c4270 con 0x7f6da006ded0 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6da5e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da01eba00 con 0x7f6da00c2410 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6da5e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da00c43e0 con 0x7f6da01570b0 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6d9ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da0072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6d97e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da00c2410 0x7f6da01ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6d9f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da0149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6d9ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da0072660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.117:37830/0 (socket says 172.21.15.117:37830) 2024-05-10T04:51:35.244 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.242+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2305989754 learned_addr learned my addr 172.21.15.117:0/2305989754 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2305989754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 msgr2=0x7f6da0149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d9ea00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da0149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2305989754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da00c2410 msgr2=0x7f6da01ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d9ea00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da00c2410 0x7f6da01ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d9ea00700 1 -- 172.21.15.117:0/2305989754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d90009550 con 0x7f6da006ded0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d9ea00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da0072660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d90014040 tx=0x7f6d90004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d90004510 con 0x7f6da006ded0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d9001e070 con 0x7f6da006ded0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d900038c0 con 0x7f6da006ded0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da01eee40 con 0x7f6da006ded0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.243+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da00c0c40 con 0x7f6da006ded0 2024-05-10T04:51:35.246 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.244+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6d90003d20 con 0x7f6da006ded0 2024-05-10T04:51:35.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.244+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6d9002d450 con 0x7f6da006ded0 2024-05-10T04:51:35.247 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.244+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da00c7000 con 0x7f6da006ded0 2024-05-10T04:51:35.249 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.248+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6da00c7000 con 0x7f6da006ded0 2024-05-10T04:51:35.254 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:35.252+0000 7f49e4c75240 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-10T04:51:35.338 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.336+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5083688-fdec-454e-80ae-8cb32bf2492e", "id": 6} v 0) v1 -- 0x7f6da01eefd0 con 0x7f6da006ded0 2024-05-10T04:51:35.342 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.340+0000 7f6d97400700 1 -- 172.21.15.117:0/2305989754 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5083688-fdec-454e-80ae-8cb32bf2492e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d90020070 con 0x7f6da006ded0 2024-05-10T04:51:35.343 INFO:teuthology.orchestra.run.smithi117.stdout:6 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 msgr2=0x7f6da0072660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da0072660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d90014040 tx=0x7f6d90004750 comp rx=0 tx=0).stop 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 shutdown_connections 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6da01570b0 0x7f6da0149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6da006ded0 0x7f6da0072660 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 --2- 172.21.15.117:0/2305989754 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6da00c2410 0x7f6da01ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 >> 172.21.15.117:0/2305989754 conn(0x7f6da00a8ae0 msgr2=0x7f6da00aa7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.341+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 shutdown_connections 2024-05-10T04:51:35.344 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.342+0000 7f6da5e00700 1 -- 172.21.15.117:0/2305989754 wait complete. 2024-05-10T04:51:35.345 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.340+0000 7f384f06e240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T04:51:35.353 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:35.352+0000 7f49e4c75240 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-10T04:51:35.367 DEBUG:teuthology.orchestra.run.smithi117:> sudo ceph --cluster ceph osd new 2dd51725-60b7-4063-b7a9-6c01dc41c4fb 7 2024-05-10T04:51:35.446 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.445+0000 7f384f06e240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T04:51:35.463 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:35.462+0000 7f49e4c75240 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-10T04:51:35.548 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.548+0000 7f384f06e240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T04:51:35.567 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:35.566+0000 7f49e4c75240 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-10T04:51:35.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.625+0000 7f9c9bc00700 1 Processor -- start 2024-05-10T04:51:35.627 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.625+0000 7f9c9bc00700 1 -- start start 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c9bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c9bc00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9c9406bdb0 0x7f9c9406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c9bc00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9406d640 con 0x7f9c940c6cc0 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c9bc00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c94152fc0 con 0x7f9c9406bdb0 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c9bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c9800 con 0x7f9c94152bb0 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c93e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c93e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:37992/0 (socket says 172.21.15.117:37992) 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c99c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9c9406bdb0 0x7f9c9406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.627+0000 7f9c93e00700 1 -- 172.21.15.117:0/1717863952 learned_addr learned my addr 172.21.15.117:0/1717863952 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93e00700 1 -- 172.21.15.117:0/1717863952 >> v2:172.21.15.47:3300/0 conn(0x7f9c9406bdb0 msgr2=0x7f9c9406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93e00700 1 --2- 172.21.15.117:0/1717863952 >> v2:172.21.15.47:3300/0 conn(0x7f9c9406bdb0 0x7f9c9406c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93e00700 1 -- 172.21.15.117:0/1717863952 >> v1:172.21.15.47:6789/0 conn(0x7f9c940c6cc0 legacy=0x7f9c940c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.630 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93e00700 1 -- 172.21.15.117:0/1717863952 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9406c700 con 0x7f9c94152bb0 2024-05-10T04:51:35.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93e00700 1 --2- 172.21.15.117:0/1717863952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c5cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c800098f0 tx=0x7f9c80009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cb9e4f82de81aec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93400700 1 -- 172.21.15.117:0/1717863952 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80011830 con 0x7f9c94152bb0 2024-05-10T04:51:35.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93400700 1 -- 172.21.15.117:0/1717863952 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c80011990 con 0x7f9c94152bb0 2024-05-10T04:51:35.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.628+0000 7f9c93400700 1 -- 172.21.15.117:0/1717863952 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80011d20 con 0x7f9c94152bb0 2024-05-10T04:51:35.631 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1717863952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 msgr2=0x7f9c940c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1717863952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c5cf0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c800098f0 tx=0x7f9c80009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1717863952 shutdown_connections 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1717863952 >> v2:172.21.15.47:3300/0 conn(0x7f9c9406bdb0 0x7f9c9406c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1717863952 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c5cf0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1717863952 >> 172.21.15.117:0/1717863952 conn(0x7f9c940ca960 msgr2=0x7f9c940cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1717863952 shutdown_connections 2024-05-10T04:51:35.632 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.629+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1717863952 wait complete. 2024-05-10T04:51:35.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.632+0000 7f9c9bc00700 1 Processor -- start 2024-05-10T04:51:35.633 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.632+0000 7f9c9bc00700 1 -- start start 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c9bc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c9406bdb0 0x7f9c94155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c9bc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 0x7f9c941ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c9bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c9bc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c941eda90 con 0x7f9c940c6cc0 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c9bc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c94154010 con 0x7f9c9406bdb0 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c9bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9414b610 con 0x7f9c94152bb0 2024-05-10T04:51:35.635 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c93e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 0x7f9c941ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c99c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c93e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 0x7f9c941ecd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.117:37852/0 (socket says 172.21.15.117:37852) 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c93e00700 1 -- 172.21.15.117:0/1393622057 learned_addr learned my addr 172.21.15.117:0/1393622057 (peer_addr_for_me v2:172.21.15.117:0/0) 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c99c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.117:38002/0 (socket says 172.21.15.117:38002) 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.633+0000 7f9c99200700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c9406bdb0 0x7f9c94155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c93e00700 1 -- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 msgr2=0x7f9c940c4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c93e00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c93e00700 1 -- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c9406bdb0 msgr2=0x7f9c94155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c93e00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c9406bdb0 0x7f9c94155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.636 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c93e00700 1 -- 172.21.15.117:0/1393622057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009550 con 0x7f9c940c6cc0 2024-05-10T04:51:35.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c93e00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 0x7f9c941ecd70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009c40 tx=0x7f9c80004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:35.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80004510 con 0x7f9c940c6cc0 2024-05-10T04:51:35.637 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8001e070 con 0x7f9c940c6cc0 2024-05-10T04:51:35.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c94154de0 con 0x7f9c940c6cc0 2024-05-10T04:51:35.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.634+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800038e0 con 0x7f9c940c6cc0 2024-05-10T04:51:35.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.635+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c94154260 con 0x7f9c940c6cc0 2024-05-10T04:51:35.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.635+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f9c80003d40 con 0x7f9c940c6cc0 2024-05-10T04:51:35.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.635+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f9c8002d450 con 0x7f9c940c6cc0 2024-05-10T04:51:35.638 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.636+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c94072ec0 con 0x7f9c940c6cc0 2024-05-10T04:51:35.640 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.638+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f9c80020070 con 0x7f9c940c6cc0 2024-05-10T04:51:35.665 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.664+0000 7f384f06e240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T04:51:35.687 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:35.685+0000 7f49e4c75240 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-10T04:51:35.728 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.726+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2dd51725-60b7-4063-b7a9-6c01dc41c4fb", "id": 7} v 0) v1 -- 0x7f9c94152390 con 0x7f9c940c6cc0 2024-05-10T04:51:35.731 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.729+0000 7f9c90c00700 1 -- 172.21.15.117:0/1393622057 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2dd51725-60b7-4063-b7a9-6c01dc41c4fb", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c800330b0 con 0x7f9c940c6cc0 2024-05-10T04:51:35.731 INFO:teuthology.orchestra.run.smithi117.stdout:7 2024-05-10T04:51:35.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 msgr2=0x7f9c941ecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:35.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 0x7f9c941ecd70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009c40 tx=0x7f9c80004750 comp rx=0 tx=0).stop 2024-05-10T04:51:35.732 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 shutdown_connections 2024-05-10T04:51:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9c94152bb0 0x7f9c940c4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9c9406bdb0 0x7f9c94155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 --2- 172.21.15.117:0/1393622057 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9c940c6cc0 0x7f9c941ecd70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 >> 172.21.15.117:0/1393622057 conn(0x7f9c940ca960 msgr2=0x7f9c94157840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 shutdown_connections 2024-05-10T04:51:35.733 INFO:teuthology.orchestra.run.smithi117.stderr:2024-05-10T04:51:35.731+0000 7f9c9bc00700 1 -- 172.21.15.117:0/1393622057 wait complete. 2024-05-10T04:51:35.756 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-10T04:51:35.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-10T04:51:35.760 INFO:tasks.ceph.osd.0:Started 2024-05-10T04:51:35.760 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-10T04:51:35.760 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-10T04:51:35.766 INFO:tasks.ceph.osd.1:Started 2024-05-10T04:51:35.766 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-10T04:51:35.766 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-10T04:51:35.771 INFO:tasks.ceph.osd.2:Started 2024-05-10T04:51:35.771 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-10T04:51:35.771 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-10T04:51:35.775 INFO:tasks.ceph.osd.3:Started 2024-05-10T04:51:35.775 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-10T04:51:35.776 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-10T04:51:35.779 INFO:tasks.ceph.osd.4:Started 2024-05-10T04:51:35.779 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-10T04:51:35.779 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-10T04:51:35.783 INFO:tasks.ceph.osd.5:Started 2024-05-10T04:51:35.783 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-10T04:51:35.783 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-10T04:51:35.788 INFO:tasks.ceph.osd.6:Started 2024-05-10T04:51:35.788 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-10T04:51:35.788 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-10T04:51:35.793 INFO:tasks.ceph.osd.7:Started 2024-05-10T04:51:35.793 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:35.999 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:35.998+0000 7f384f06e240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T04:51:36.007 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:36.006+0000 7f49e4c75240 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-10T04:51:36.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.185+0000 7f6c06800700 1 Processor -- start 2024-05-10T04:51:36.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.185+0000 7f6c06800700 1 -- start start 2024-05-10T04:51:36.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6c06800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c000c9440 0x7f6c00158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6c06800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c00159050 0x7f6c0015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6c06800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0006c7c0 con 0x7f6c000c5c40 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6c06800700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0006d060 con 0x7f6c00159050 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6c06800700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c00159890 con 0x7f6c000c9440 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6bffe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c00159050 0x7f6c0015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6bffe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6c00159050 0x7f6c0015fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45342/0 (socket says 172.21.15.47:45342) 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6bffe00700 1 -- 172.21.15.47:0/4224416822 learned_addr learned my addr 172.21.15.47:0/4224416822 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.187+0000 7f6bfea00700 1 --2- 172.21.15.47:0/4224416822 >> v2:172.21.15.117:3300/0 conn(0x7f6c000c9440 0x7f6c00158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bffe00700 1 -- 172.21.15.47:0/4224416822 >> v2:172.21.15.117:3300/0 conn(0x7f6c000c9440 msgr2=0x7f6c00158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bffe00700 1 --2- 172.21.15.47:0/4224416822 >> v2:172.21.15.117:3300/0 conn(0x7f6c000c9440 0x7f6c00158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bffe00700 1 -- 172.21.15.47:0/4224416822 >> v1:172.21.15.117:6789/0 conn(0x7f6c000c5c40 legacy=0x7f6c000c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bffe00700 1 -- 172.21.15.47:0/4224416822 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0006ca10 con 0x7f6c00159050 2024-05-10T04:51:36.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bffe00700 1 --2- 172.21.15.47:0/4224416822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c00159050 0x7f6c0015fe40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c000730e0 tx=0x7f6bf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8109605e19084513 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:36.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bfe000700 1 -- 172.21.15.47:0/4224416822 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800e070 con 0x7f6c00159050 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bfe000700 1 -- 172.21.15.47:0/4224416822 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf800b910 con 0x7f6c00159050 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.188+0000 7f6bfe000700 1 -- 172.21.15.47:0/4224416822 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf800bcc0 con 0x7f6c00159050 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 -- 172.21.15.47:0/4224416822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c00159050 msgr2=0x7f6c0015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 --2- 172.21.15.47:0/4224416822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c00159050 0x7f6c0015fe40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6c000730e0 tx=0x7f6bf800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 -- 172.21.15.47:0/4224416822 shutdown_connections 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 --2- 172.21.15.47:0/4224416822 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c00159050 0x7f6c0015fe40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 --2- 172.21.15.47:0/4224416822 >> v2:172.21.15.117:3300/0 conn(0x7f6c000c9440 0x7f6c00158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 -- 172.21.15.47:0/4224416822 >> 172.21.15.47:0/4224416822 conn(0x7f6c000ca940 msgr2=0x7f6c000cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 -- 172.21.15.47:0/4224416822 shutdown_connections 2024-05-10T04:51:36.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.189+0000 7f6c06800700 1 -- 172.21.15.47:0/4224416822 wait complete. 2024-05-10T04:51:36.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.192+0000 7f6c06800700 1 Processor -- start 2024-05-10T04:51:36.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.192+0000 7f6c06800700 1 -- start start 2024-05-10T04:51:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6c06800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c000c5c40 0x7f6c000afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6c06800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 0x7f6c0014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6c06800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c00159050 0x7f6c001ee7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6c06800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c001ebab0 con 0x7f6c000c9440 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6c06800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c00154c80 con 0x7f6c000c5c40 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6c06800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c001eb220 con 0x7f6c00159050 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6bfea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 0x7f6c0014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6bfea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 0x7f6c0014d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45352/0 (socket says 172.21.15.47:45352) 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6bff400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c000c5c40 0x7f6c000afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6bfea00700 1 -- 172.21.15.47:0/1779374359 learned_addr learned my addr 172.21.15.47:0/1779374359 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.194+0000 7f6bffe00700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c00159050 0x7f6c001ee7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bfea00700 1 -- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c00159050 msgr2=0x7f6c001ee7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bfea00700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c00159050 0x7f6c001ee7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bfea00700 1 -- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c000c5c40 msgr2=0x7f6c000afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bfea00700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c000c5c40 0x7f6c000afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bfea00700 1 -- 172.21.15.47:0/1779374359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf8009b30 con 0x7f6c000c9440 2024-05-10T04:51:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bfea00700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 0x7f6c0014d360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e870 tx=0x7f6bec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec009590 con 0x7f6c000c9440 2024-05-10T04:51:36.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec013680 con 0x7f6c000c9440 2024-05-10T04:51:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c001ef020 con 0x7f6c000c9440 2024-05-10T04:51:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.195+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec0139f0 con 0x7f6c000c9440 2024-05-10T04:51:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.196+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c00156020 con 0x7f6c000c9440 2024-05-10T04:51:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.196+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f6bec005a20 con 0x7f6c000c9440 2024-05-10T04:51:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.196+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f6bec005cd0 con 0x7f6c000c9440 2024-05-10T04:51:36.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.197+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c00074720 con 0x7f6c000c9440 2024-05-10T04:51:36.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.199+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f6bec021060 con 0x7f6c000c9440 2024-05-10T04:51:36.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.274+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c001ebbf0 con 0x7f6c000c9440 2024-05-10T04:51:36.275 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:36.273+0000 7f49e4c75240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T04:51:36.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.274+0000 7f6bf7400700 1 -- 172.21.15.47:0/1779374359 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f6c001ebbf0 con 0x7f6c000c9440 2024-05-10T04:51:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:36.276 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":10,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:35.728545+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 msgr2=0x7f6c0014d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 0x7f6c0014d360 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6bec00e870 tx=0x7f6bec00eb80 comp rx=0 tx=0).stop 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 shutdown_connections 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c00159050 0x7f6c001ee7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c000c5c40 0x7f6c000afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 --2- 172.21.15.47:0/1779374359 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c000c9440 0x7f6c0014d360 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 >> 172.21.15.47:0/1779374359 conn(0x7f6c000ca940 msgr2=0x7f6c000c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 shutdown_connections 2024-05-10T04:51:36.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:36.276+0000 7f6c06800700 1 -- 172.21.15.47:0/1779374359 wait complete. 2024-05-10T04:51:36.280 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:36.280+0000 7f384f06e240 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-10T04:51:36.301 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-10T04:51:36.301 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-10T04:51:36.480 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:36.479+0000 7f49e4c75240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T04:51:36.493 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:36.493+0000 7f384f06e240 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-10T04:51:36.550 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-10T04:51:36.549+0000 7f5b56f39800 -1 Falling back to public interface 2024-05-10T04:51:36.556 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-10T04:51:36.555+0000 7fa636f9d800 -1 Falling back to public interface 2024-05-10T04:51:36.559 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-10T04:51:36.558+0000 7f576a57f800 -1 Falling back to public interface 2024-05-10T04:51:36.577 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:36.576+0000 7f49e4c75240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T04:51:36.590 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:36.590+0000 7f384f06e240 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-10T04:51:36.596 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-10T04:51:36.596+0000 7fefd0d1f800 -1 Falling back to public interface 2024-05-10T04:51:36.597 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-10T04:51:36.596+0000 7f662594b800 -1 Falling back to public interface 2024-05-10T04:51:36.605 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-10T04:51:36.604+0000 7ff9ff3c0800 -1 Falling back to public interface 2024-05-10T04:51:36.644 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-10T04:51:36.643+0000 7f470ad68800 -1 Falling back to public interface 2024-05-10T04:51:36.645 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-10T04:51:36.645+0000 7fc178506800 -1 Falling back to public interface 2024-05-10T04:51:37.106 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:37.363 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.362+0000 7f27f3e00700 1 Processor -- start 2024-05-10T04:51:37.363 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.363+0000 7f27f3e00700 1 -- start start 2024-05-10T04:51:37.366 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.364+0000 7f27f3e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0c5b80 0x7f27ec158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:37.366 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.364+0000 7f27f3e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec155490 con 0x7f27ec152bf0 2024-05-10T04:51:37.366 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.364+0000 7f27f3e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27ec0ca000 con 0x7f27ec155c70 2024-05-10T04:51:37.366 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.364+0000 7f27f3e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec0c64a0 con 0x7f27ec0c5b80 2024-05-10T04:51:37.366 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.364+0000 7f27f0a00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f27ec152bf0 0x7f27ec0c9840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46316/0 (socket says 172.21.15.47:46316) 2024-05-10T04:51:37.367 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.364+0000 7f27f0a00700 1 -- 172.21.15.47:0/1205460730 learned_addr learned my addr 172.21.15.47:0/1205460730 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:37.367 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27f1400700 1 --2- 172.21.15.47:0/1205460730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0c5b80 0x7f27ec158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:37.368 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985846365 0 0) 0x7f27ec155490 con 0x7f27ec152bf0 2024-05-10T04:51:37.368 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27d40035b0 con 0x7f27ec152bf0 2024-05-10T04:51:37.368 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2646921624 0 0) 0x7f27ec0ca000 con 0x7f27ec155c70 2024-05-10T04:51:37.368 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27ec155490 con 0x7f27ec155c70 2024-05-10T04:51:37.368 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27f1400700 1 -- 172.21.15.47:0/1205460730 >> v1:172.21.15.117:6789/0 conn(0x7f27ec155c70 legacy=0x7f27ec0c8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27f1400700 1 -- 172.21.15.47:0/1205460730 >> v1:172.21.15.47:6789/0 conn(0x7f27ec152bf0 legacy=0x7f27ec0c9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27f1400700 1 -- 172.21.15.47:0/1205460730 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec0ca2e0 con 0x7f27ec0c5b80 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.365+0000 7f27f1400700 1 --2- 172.21.15.47:0/1205460730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0c5b80 0x7f27ec158a60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009870 tx=0x7f27e0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd706873c7f9bfb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.366+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0011830 con 0x7f27ec0c5b80 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.366+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e0011990 con 0x7f27ec0c5b80 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.366+0000 7f27ebe00700 1 -- 172.21.15.47:0/1205460730 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e0011d20 con 0x7f27ec0c5b80 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 -- 172.21.15.47:0/1205460730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0c5b80 msgr2=0x7f27ec158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 --2- 172.21.15.47:0/1205460730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0c5b80 0x7f27ec158a60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f27e0009870 tx=0x7f27e0009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 -- 172.21.15.47:0/1205460730 shutdown_connections 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 --2- 172.21.15.47:0/1205460730 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec0c5b80 0x7f27ec158a60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 -- 172.21.15.47:0/1205460730 >> 172.21.15.47:0/1205460730 conn(0x7f27ec0ac860 msgr2=0x7f27ec0acc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 -- 172.21.15.47:0/1205460730 shutdown_connections 2024-05-10T04:51:37.369 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.367+0000 7f27f3e00700 1 -- 172.21.15.47:0/1205460730 wait complete. 2024-05-10T04:51:37.370 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.369+0000 7f27f3e00700 1 Processor -- start 2024-05-10T04:51:37.370 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.369+0000 7f27f3e00700 1 -- start start 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.370+0000 7f27f3e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec0c5b80 0x7f27ec1ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f3e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec152bf0 0x7f27ec1e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 0x7f27ec0c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f3e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1dfd60 con 0x7f27ec155c70 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f3e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1e24c0 con 0x7f27ec0c5b80 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f3e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27ec1e2950 con 0x7f27ec152bf0 2024-05-10T04:51:37.372 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 0x7f27ec0c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 0x7f27ec0c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45362/0 (socket says 172.21.15.47:45362) 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 -- 172.21.15.47:0/1661936120 learned_addr learned my addr 172.21.15.47:0/1661936120 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1400700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec0c5b80 0x7f27ec1ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f0a00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec152bf0 0x7f27ec1e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 -- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec152bf0 msgr2=0x7f27ec1e17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec152bf0 0x7f27ec1e17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 -- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec0c5b80 msgr2=0x7f27ec1ebd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec0c5b80 0x7f27ec1ebd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1e00700 1 -- 172.21.15.47:0/1661936120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e00094a0 con 0x7f27ec155c70 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.371+0000 7f27f1400700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec0c5b80 0x7f27ec1ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:37.373 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.372+0000 7f27f1e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 0x7f27ec0c41e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f27e400cb50 tx=0x7f27e400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:37.374 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.372+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4003c00 con 0x7f27ec155c70 2024-05-10T04:51:37.374 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.372+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e4003d60 con 0x7f27ec155c70 2024-05-10T04:51:37.374 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.372+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27ec1e2190 con 0x7f27ec155c70 2024-05-10T04:51:37.375 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.372+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e400aa20 con 0x7f27ec155c70 2024-05-10T04:51:37.375 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.372+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27ec0c0980 con 0x7f27ec155c70 2024-05-10T04:51:37.375 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.373+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f27e40050d0 con 0x7f27ec155c70 2024-05-10T04:51:37.375 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.373+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f27e4012cd0 con 0x7f27ec155c70 2024-05-10T04:51:37.375 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.373+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27ec067ea0 con 0x7f27ec155c70 2024-05-10T04:51:37.376 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.376+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73121 (secure 0 0 0) 0x7f27e4005560 con 0x7f27ec155c70 2024-05-10T04:51:37.407 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:37.405+0000 7f49e4c75240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T04:51:37.452 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.451+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27ec1e2600 con 0x7f27ec155c70 2024-05-10T04:51:37.453 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.452+0000 7f27e9600700 1 -- 172.21.15.47:0/1661936120 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f27e4005700 con 0x7f27ec155c70 2024-05-10T04:51:37.453 INFO:teuthology.misc.health.smithi047.stdout: 2024-05-10T04:51:37.453 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":10,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:35.728545+0000","last_up_change":"0.000000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:37.454 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 msgr2=0x7f27ec0c41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:37.454 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 0x7f27ec0c41e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f27e400cb50 tx=0x7f27e400ce60 comp rx=0 tx=0).stop 2024-05-10T04:51:37.454 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 shutdown_connections 2024-05-10T04:51:37.454 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27ec155c70 0x7f27ec0c41e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.454 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27ec0c5b80 0x7f27ec1ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.454 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 --2- 172.21.15.47:0/1661936120 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27ec152bf0 0x7f27ec1e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:37.455 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 >> 172.21.15.47:0/1661936120 conn(0x7f27ec0ac860 msgr2=0x7f27ec0abad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:37.455 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 shutdown_connections 2024-05-10T04:51:37.455 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:37.453+0000 7f27f3e00700 1 -- 172.21.15.47:0/1661936120 wait complete. 2024-05-10T04:51:37.461 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:37.461+0000 7f384f06e240 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-10T04:51:37.477 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-10T04:51:37.619 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:37.618+0000 7f49e4c75240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T04:51:37.680 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:37.680+0000 7f384f06e240 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-10T04:51:37.830 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:37.828+0000 7f49e4c75240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:51:37.892 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:37.892+0000 7f384f06e240 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:51:38.331 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:38.330+0000 7f49e4c75240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T04:51:38.414 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:38.414+0000 7f384f06e240 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-10T04:51:38.540 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:38.539+0000 7f49e4c75240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:51:38.632 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:38.631+0000 7f384f06e240 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-10T04:51:38.989 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:38.987+0000 7f49e4c75240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T04:51:39.086 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:39.086+0000 7f384f06e240 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-10T04:51:39.133 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:39.132+0000 7f49e4c75240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T04:51:39.251 INFO:tasks.ceph.mgr.y.smithi047.stderr:2024-05-10T04:51:39.250+0000 7f384f06e240 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-10T04:51:40.121 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-10T04:51:40.120+0000 7f5b56f39800 -1 osd.2 0 log_to_monitors true 2024-05-10T04:51:40.146 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-10T04:51:40.145+0000 7fa636f9d800 -1 osd.4 0 log_to_monitors true 2024-05-10T04:51:40.160 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:40.158+0000 7f499b000700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-10T04:51:40.162 INFO:tasks.ceph.mgr.x.smithi117.stderr:2024-05-10T04:51:40.161+0000 7f499b000700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-10T04:51:40.166 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-10T04:51:40.165+0000 7f576a57f800 -1 osd.5 0 log_to_monitors true 2024-05-10T04:51:40.228 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-10T04:51:40.227+0000 7f662594b800 -1 osd.6 0 log_to_monitors true 2024-05-10T04:51:40.266 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-10T04:51:40.266+0000 7fc178506800 -1 osd.3 0 log_to_monitors true 2024-05-10T04:51:40.302 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-10T04:51:40.301+0000 7f470ad68800 -1 osd.7 0 log_to_monitors true 2024-05-10T04:51:40.477 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-10T04:51:40.476+0000 7fefd0d1f800 -1 osd.0 0 log_to_monitors true 2024-05-10T04:51:40.482 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-10T04:51:40.481+0000 7ff9ff3c0800 -1 osd.1 0 log_to_monitors true 2024-05-10T04:51:42.095 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-10T04:51:42.094+0000 7f5b44c00700 -1 osd.2 0 waiting for initial osdmap 2024-05-10T04:51:42.102 INFO:tasks.ceph.osd.2.smithi047.stderr:2024-05-10T04:51:42.101+0000 7f5b3a400700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:42.835 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-10T04:51:42.833+0000 7f5758200700 -1 osd.5 0 waiting for initial osdmap 2024-05-10T04:51:42.862 INFO:tasks.ceph.osd.5.smithi117.stderr:2024-05-10T04:51:42.857+0000 7f574da00700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:42.864 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-10T04:51:42.863+0000 7fa625600700 -1 osd.4 0 waiting for initial osdmap 2024-05-10T04:51:42.882 INFO:tasks.ceph.osd.4.smithi117.stderr:2024-05-10T04:51:42.877+0000 7fa61a400700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:43.705 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-10T04:51:43.705+0000 7fc166200700 -1 osd.3 0 waiting for initial osdmap 2024-05-10T04:51:43.706 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-10T04:51:43.705+0000 7ff9ed000700 -1 osd.1 0 waiting for initial osdmap 2024-05-10T04:51:43.718 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-10T04:51:43.708+0000 7f6614000700 -1 osd.6 0 waiting for initial osdmap 2024-05-10T04:51:43.718 INFO:tasks.ceph.osd.3.smithi047.stderr:2024-05-10T04:51:43.714+0000 7fc15ba00700 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:43.719 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-10T04:51:43.718+0000 7fefbea00700 -1 osd.0 0 waiting for initial osdmap 2024-05-10T04:51:43.719 INFO:tasks.ceph.osd.6.smithi117.stderr:2024-05-10T04:51:43.716+0000 7f6608e00700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:43.723 INFO:tasks.ceph.osd.1.smithi047.stderr:2024-05-10T04:51:43.719+0000 7ff9e2800700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:43.726 INFO:tasks.ceph.osd.0.smithi047.stderr:2024-05-10T04:51:43.726+0000 7fefb4200700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:43.772 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-10T04:51:43.770+0000 7f46f8a00700 -1 osd.7 0 waiting for initial osdmap 2024-05-10T04:51:43.785 INFO:tasks.ceph.osd.7.smithi117.stderr:2024-05-10T04:51:43.779+0000 7f46ee200700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-10T04:51:44.284 DEBUG:teuthology.orchestra.run.smithi047:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:44.538 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.537+0000 7fd04cc00700 1 Processor -- start 2024-05-10T04:51:44.538 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.537+0000 7fd04cc00700 1 -- start start 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd04cc00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0480c3930 0x7fd048154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd04cc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c45c0 0x7fd048159250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd04cc00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0480c6450 con 0x7fd0480c41b0 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd04cc00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0480a7350 con 0x7fd0480c3930 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd04cc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0480c49d0 con 0x7fd0480c45c0 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd045e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0480c3930 0x7fd048154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.541 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd046800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c45c0 0x7fd048159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd045e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd0480c3930 0x7fd048154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:50400/0 (socket says 172.21.15.47:50400) 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd045e00700 1 -- 172.21.15.47:0/2328904965 learned_addr learned my addr 172.21.15.47:0/2328904965 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.539+0000 7fd03fe00700 1 --1- 172.21.15.47:0/2328904965 >> v1:172.21.15.117:6789/0 conn(0x7fd0480c41b0 0x7fd048158b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:43016/0 (socket says 172.21.15.47:43016) 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045e00700 1 -- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c45c0 msgr2=0x7fd048159250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045e00700 1 --2- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c45c0 0x7fd048159250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045e00700 1 -- 172.21.15.47:0/2328904965 >> v1:172.21.15.117:6789/0 conn(0x7fd0480c41b0 legacy=0x7fd048158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.542 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045e00700 1 -- 172.21.15.47:0/2328904965 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd048073130 con 0x7fd0480c3930 2024-05-10T04:51:44.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd046800700 1 --2- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c45c0 0x7fd048159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:44.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045e00700 1 --2- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c3930 0x7fd048154eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0380098f0 tx=0x7fd038009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01739acc93dfb6b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:44.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045400700 1 -- 172.21.15.47:0/2328904965 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038011830 con 0x7fd0480c3930 2024-05-10T04:51:44.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045400700 1 -- 172.21.15.47:0/2328904965 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd038011990 con 0x7fd0480c3930 2024-05-10T04:51:44.543 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.540+0000 7fd045400700 1 -- 172.21.15.47:0/2328904965 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd038011d20 con 0x7fd0480c3930 2024-05-10T04:51:44.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 -- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c3930 msgr2=0x7fd048154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 --2- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c3930 0x7fd048154eb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd0380098f0 tx=0x7fd038009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:44.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 -- 172.21.15.47:0/2328904965 shutdown_connections 2024-05-10T04:51:44.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 --2- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c45c0 0x7fd048159250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 --2- 172.21.15.47:0/2328904965 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c3930 0x7fd048154eb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.545 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 -- 172.21.15.47:0/2328904965 >> 172.21.15.47:0/2328904965 conn(0x7fd04806bd00 msgr2=0x7fd04806c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:44.546 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 -- 172.21.15.47:0/2328904965 shutdown_connections 2024-05-10T04:51:44.546 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.541+0000 7fd04cc00700 1 -- 172.21.15.47:0/2328904965 wait complete. 2024-05-10T04:51:44.546 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.543+0000 7fd04cc00700 1 Processor -- start 2024-05-10T04:51:44.546 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.544+0000 7fd04cc00700 1 -- start start 2024-05-10T04:51:44.550 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd04cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 0x7fd0481ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.550 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd04cc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c41b0 0x7fd0480abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd04cc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c45c0 0x7fd048151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd04cc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481eb7c0 con 0x7fd0480c3930 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd04cc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481e12d0 con 0x7fd0480c45c0 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd04cc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0481ec6f0 con 0x7fd0480c41b0 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd045e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 0x7fd0481ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd045e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 0x7fd0481ec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45432/0 (socket says 172.21.15.47:45432) 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd045e00700 1 -- 172.21.15.47:0/276550885 learned_addr learned my addr 172.21.15.47:0/276550885 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd046800700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c45c0 0x7fd048151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.551 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.545+0000 7fd03fe00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c41b0 0x7fd0480abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd045e00700 1 -- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c41b0 msgr2=0x7fd0480abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd045e00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c41b0 0x7fd0480abf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd045e00700 1 -- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c45c0 msgr2=0x7fd048151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd045e00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c45c0 0x7fd048151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd045e00700 1 -- 172.21.15.47:0/276550885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd040009a70 con 0x7fd0480c3930 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd045e00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 0x7fd0481ec1b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd038009c40 tx=0x7fd038004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0380044d0 con 0x7fd0480c3930 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03801e070 con 0x7fd0480c3930 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd038009550 con 0x7fd0480c3930 2024-05-10T04:51:44.552 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.546+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0380038e0 con 0x7fd0480c3930 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.547+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0480a6c10 con 0x7fd0480c3930 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.548+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd048067ea0 con 0x7fd0480c3930 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.548+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fd038003a40 con 0x7fd0480c3930 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.549+0000 7fd03e000700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd02406ac00 0x7fd02406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.549+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fd038089c40 con 0x7fd0480c3930 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.550+0000 7fd03fe00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd02406ac00 0x7fd02406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:44.553 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.550+0000 7fd03fe00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd02406ac00 0x7fd02406d110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd04806c330 tx=0x7fd030007ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:44.556 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.555+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd038055340 con 0x7fd0480c3930 2024-05-10T04:51:44.773 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.772+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd04806c360 con 0x7fd0480c3930 2024-05-10T04:51:44.774 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.773+0000 7fd03e000700 1 -- 172.21.15.47:0/276550885 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10463 (secure 0 0 0) 0x7fd038058960 con 0x7fd0480c3930 2024-05-10T04:51:44.774 INFO:teuthology.misc.health.smithi047.stdout: 2024-05-10T04:51:44.774 INFO:teuthology.misc.health.smithi047.stdout:{"epoch":14,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:43.863491+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:44.776 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.775+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd02406ac00 msgr2=0x7fd02406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.775+0000 7fd04cc00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd02406ac00 0x7fd02406d110 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd04806c330 tx=0x7fd030007ed0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.775+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 msgr2=0x7fd0481ec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.775+0000 7fd04cc00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 0x7fd0481ec1b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd038009c40 tx=0x7fd038004750 comp rx=0 tx=0).stop 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 shutdown_connections 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd0480c45c0 0x7fd048151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd0480c3930 0x7fd0481ec1b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd02406ac00 0x7fd02406d110 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 --2- 172.21.15.47:0/276550885 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd0480c41b0 0x7fd0480abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 >> 172.21.15.47:0/276550885 conn(0x7fd04806bd00 msgr2=0x7fd0480743a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 shutdown_connections 2024-05-10T04:51:44.777 INFO:teuthology.misc.health.smithi047.stderr:2024-05-10T04:51:44.776+0000 7fd04cc00700 1 -- 172.21.15.47:0/276550885 wait complete. 2024-05-10T04:51:44.797 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-10T04:51:44.798 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-10T04:51:44.798 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-10T04:51:44.798 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-10T04:51:44.802 INFO:tasks.ceph.mds.a:Started 2024-05-10T04:51:44.802 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-10T04:51:44.803 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-10T04:51:44.807 INFO:tasks.ceph.mds.c:Started 2024-05-10T04:51:44.807 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-10T04:51:44.807 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-10T04:51:44.812 INFO:tasks.ceph.mds.b:Started 2024-05-10T04:51:44.812 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-10T04:51:44.812 DEBUG:teuthology.orchestra.run.smithi117:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-10T04:51:44.817 INFO:tasks.ceph.mds.d:Started 2024-05-10T04:51:44.817 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-10T04:51:44.817 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:45.022 INFO:tasks.ceph.mds.a.smithi047.stdout:starting mds.a at 2024-05-10T04:51:45.024 INFO:tasks.ceph.mds.c.smithi047.stdout:starting mds.c at 2024-05-10T04:51:45.032 INFO:tasks.ceph.mds.d.smithi117.stdout:starting mds.d at 2024-05-10T04:51:45.036 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-05-10T04:51:45.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.099+0000 7f08b7e00700 1 Processor -- start 2024-05-10T04:51:45.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.099+0000 7f08b7e00700 1 -- start start 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.101+0000 7f08b7e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f08b006d400 0x7f08b0152e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.101+0000 7f08b7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b0155d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.101+0000 7f08b7e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b00c24d0 con 0x7f08b006d930 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.101+0000 7f08b7e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b00c5be0 con 0x7f08b006d400 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.101+0000 7f08b7e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0158e60 con 0x7f08b01558f0 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.101+0000 7f08b5400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f08b006d400 0x7f08b0152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f08b006d400 0x7f08b0152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45490/0 (socket says 172.21.15.47:45490) 2024-05-10T04:51:45.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 -- 172.21.15.47:0/2594935384 learned_addr learned my addr 172.21.15.47:0/2594935384 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5e00700 1 --2- 172.21.15.47:0/2594935384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b0155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 -- 172.21.15.47:0/2594935384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 msgr2=0x7f08b0155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 --2- 172.21.15.47:0/2594935384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b0155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 -- 172.21.15.47:0/2594935384 >> v1:172.21.15.117:6789/0 conn(0x7f08b006d930 legacy=0x7f08b00c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 -- 172.21.15.47:0/2594935384 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0159700 con 0x7f08b006d400 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08b5400700 1 --2- 172.21.15.47:0/2594935384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0152e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f08a40098f0 tx=0x7f08a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11eea84ecf1d67e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.102+0000 7f08afe00700 1 -- 172.21.15.47:0/2594935384 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4011830 con 0x7f08b006d400 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08afe00700 1 -- 172.21.15.47:0/2594935384 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4011990 con 0x7f08b006d400 2024-05-10T04:51:45.104 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08afe00700 1 -- 172.21.15.47:0/2594935384 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4011d20 con 0x7f08b006d400 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 -- 172.21.15.47:0/2594935384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 msgr2=0x7f08b0152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 --2- 172.21.15.47:0/2594935384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0152e60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f08a40098f0 tx=0x7f08a4009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 -- 172.21.15.47:0/2594935384 shutdown_connections 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 --2- 172.21.15.47:0/2594935384 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b0155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 --2- 172.21.15.47:0/2594935384 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0152e60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 -- 172.21.15.47:0/2594935384 >> 172.21.15.47:0/2594935384 conn(0x7f08b00aa440 msgr2=0x7f08b00aa850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 -- 172.21.15.47:0/2594935384 shutdown_connections 2024-05-10T04:51:45.105 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.103+0000 7f08b7e00700 1 -- 172.21.15.47:0/2594935384 wait complete. 2024-05-10T04:51:45.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.105+0000 7f08b7e00700 1 Processor -- start 2024-05-10T04:51:45.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.106+0000 7f08b7e00700 1 -- start start 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b7e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b006d930 0x7f08b00a9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b01ee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b7e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b01ef380 con 0x7f08b006d400 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b7e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b0157650 con 0x7f08b006d930 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b7e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b01ebdc0 con 0x7f08b01558f0 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45496/0 (socket says 172.21.15.47:45496) 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b5400700 1 -- 172.21.15.47:0/3416547118 learned_addr learned my addr 172.21.15.47:0/3416547118 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:45.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b5e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b01ee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.107+0000 7f08b4a00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b006d930 0x7f08b00a9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b5400700 1 -- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 msgr2=0x7f08b01ee6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b5400700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b01ee6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b5400700 1 -- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b006d930 msgr2=0x7f08b00a9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b5400700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b006d930 0x7f08b00a9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b5400700 1 -- 172.21.15.47:0/3416547118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a4009550 con 0x7f08b006d400 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b4a00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b006d930 0x7f08b00a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b5400700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0158690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009c40 tx=0x7f08a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4004590 con 0x7f08b006d400 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a401e070 con 0x7f08b006d400 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40038e0 con 0x7f08b006d400 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b0156de0 con 0x7f08b006d400 2024-05-10T04:51:45.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.108+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b01ef0c0 con 0x7f08b006d400 2024-05-10T04:51:45.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.109+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b0157ae0 con 0x7f08b006d400 2024-05-10T04:51:45.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.110+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f08a4003a40 con 0x7f08b006d400 2024-05-10T04:51:45.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.111+0000 7f08ad600700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f089006ac00 0x7f089006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.111+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f08a4089c50 con 0x7f08b006d400 2024-05-10T04:51:45.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.112+0000 7f08b4a00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f089006ac00 0x7f089006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.112+0000 7f08b4a00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f089006ac00 0x7f089006d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f08b01ef7c0 tx=0x7f089c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:45.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.116+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f08b0157ae0 con 0x7f08b006d400 2024-05-10T04:51:45.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.335+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b0157ae0 con 0x7f08b006d400 2024-05-10T04:51:45.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.336+0000 7f08ad600700 1 -- 172.21.15.47:0/3416547118 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10624 (secure 0 0 0) 0x7f08b0157ae0 con 0x7f08b006d400 2024-05-10T04:51:45.338 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:45.338 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":15,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:44.865678+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f089006ac00 msgr2=0x7f089006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f089006ac00 0x7f089006d110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f08b01ef7c0 tx=0x7f089c009040 comp rx=0 tx=0).stop 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 msgr2=0x7f08b0158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0158690 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009c40 tx=0x7f08a4004750 comp rx=0 tx=0).stop 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 shutdown_connections 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f089006ac00 0x7f089006d110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f08b01558f0 0x7f08b01ee6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f08b006d400 0x7f08b0158690 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 --2- 172.21.15.47:0/3416547118 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f08b006d930 0x7f08b00a9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 >> 172.21.15.47:0/3416547118 conn(0x7f08b00aa440 msgr2=0x7f08b00c90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:45.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 shutdown_connections 2024-05-10T04:51:45.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.339+0000 7f08b7e00700 1 -- 172.21.15.47:0/3416547118 wait complete. 2024-05-10T04:51:45.367 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-05-10T04:51:45.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:45.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.638+0000 7f6d99c00700 1 Processor -- start 2024-05-10T04:51:45.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.638+0000 7f6d99c00700 1 -- start start 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d99c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6d940c5c40 0x7f6d940c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d99c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d94159220 0x7f6d9415fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d99c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9406c7c0 con 0x7f6d940c9270 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d99c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d9406d060 con 0x7f6d940c5c40 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d99c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94159630 con 0x7f6d94159220 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d92a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6d940c5c40 0x7f6d940c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d92a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6d940c5c40 0x7f6d940c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45498/0 (socket says 172.21.15.47:45498) 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d92a00700 1 -- 172.21.15.47:0/389731606 learned_addr learned my addr 172.21.15.47:0/389731606 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.640+0000 7f6d93400700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d94159220 0x7f6d9415fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92a00700 1 -- 172.21.15.47:0/389731606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d94159220 msgr2=0x7f6d9415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:45.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92a00700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d94159220 0x7f6d9415fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92a00700 1 -- 172.21.15.47:0/389731606 >> v1:172.21.15.117:6789/0 conn(0x7f6d940c9270 legacy=0x7f6d94158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92a00700 1 -- 172.21.15.47:0/389731606 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d94159890 con 0x7f6d940c5c40 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d93400700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d94159220 0x7f6d9415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92a00700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c5c40 0x7f6d940c8d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d840098f0 tx=0x7f6d84009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22f9a3cddb39731 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92000700 1 -- 172.21.15.47:0/389731606 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400b8a0 con 0x7f6d940c5c40 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92000700 1 -- 172.21.15.47:0/389731606 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8400ba00 con 0x7f6d940c5c40 2024-05-10T04:51:45.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.641+0000 7f6d92000700 1 -- 172.21.15.47:0/389731606 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8400bd90 con 0x7f6d940c5c40 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 -- 172.21.15.47:0/389731606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c5c40 msgr2=0x7f6d940c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c5c40 0x7f6d940c8d30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d840098f0 tx=0x7f6d84009c00 comp rx=0 tx=0).stop 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 -- 172.21.15.47:0/389731606 shutdown_connections 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d94159220 0x7f6d9415fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 --2- 172.21.15.47:0/389731606 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c5c40 0x7f6d940c8d30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 -- 172.21.15.47:0/389731606 >> 172.21.15.47:0/389731606 conn(0x7f6d940ca940 msgr2=0x7f6d940cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 -- 172.21.15.47:0/389731606 shutdown_connections 2024-05-10T04:51:45.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.642+0000 7f6d99c00700 1 -- 172.21.15.47:0/389731606 wait complete. 2024-05-10T04:51:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.644+0000 7f6d99c00700 1 Processor -- start 2024-05-10T04:51:45.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.644+0000 7f6d99c00700 1 -- start start 2024-05-10T04:51:45.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d99c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d940c5c40 0x7f6d940af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d99c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 0x7f6d94156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d99c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d94159220 0x7f6d9414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d99c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d94157910 con 0x7f6d940c9270 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d99c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941eb1e0 con 0x7f6d94159220 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d99c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d941eb010 con 0x7f6d940c5c40 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d8be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 0x7f6d94156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d8be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 0x7f6d94156bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45504/0 (socket says 172.21.15.47:45504) 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d8be00700 1 -- 172.21.15.47:0/3027005343 learned_addr learned my addr 172.21.15.47:0/3027005343 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d93400700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d94159220 0x7f6d9414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.646+0000 7f6d92a00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d940c5c40 0x7f6d940af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8be00700 1 -- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d940c5c40 msgr2=0x7f6d940af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8be00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d940c5c40 0x7f6d940af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8be00700 1 -- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d94159220 msgr2=0x7f6d9414b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8be00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d94159220 0x7f6d9414b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8be00700 1 -- 172.21.15.47:0/3027005343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d84009550 con 0x7f6d940c9270 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8be00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 0x7f6d94156bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00c450 tx=0x7f6d7c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0050d0 con 0x7f6d940c9270 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7c005230 con 0x7f6d940c9270 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c003680 con 0x7f6d940c9270 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d940c1a80 con 0x7f6d940c9270 2024-05-10T04:51:45.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.647+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d941eb430 con 0x7f6d940c9270 2024-05-10T04:51:45.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.648+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d94074720 con 0x7f6d940c9270 2024-05-10T04:51:45.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.649+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f6d7c0037e0 con 0x7f6d940c9270 2024-05-10T04:51:45.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.650+0000 7f6d8aa00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6d7006ac00 0x7f6d7006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:45.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.650+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6d7c088070 con 0x7f6d940c9270 2024-05-10T04:51:45.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.651+0000 7f6d92a00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6d7006ac00 0x7f6d7006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:45.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.651+0000 7f6d92a00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6d7006ac00 0x7f6d7006d110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d840098f0 tx=0x7f6d84008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:45.657 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.656+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6d7c053760 con 0x7f6d940c9270 2024-05-10T04:51:45.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.916+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d940c8b10 con 0x7f6d940c9270 2024-05-10T04:51:45.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.916+0000 7f6d8aa00700 1 -- 172.21.15.47:0/3027005343 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7f6d7c017090 con 0x7f6d940c9270 2024-05-10T04:51:45.918 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:45.918 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-05-10T04:51:45.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6d7006ac00 msgr2=0x7f6d7006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6d7006ac00 0x7f6d7006d110 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6d840098f0 tx=0x7f6d84008030 comp rx=0 tx=0).stop 2024-05-10T04:51:45.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 msgr2=0x7f6d94156bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:45.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 0x7f6d94156bf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00c450 tx=0x7f6d7c00c760 comp rx=0 tx=0).stop 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 shutdown_connections 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6d94159220 0x7f6d9414b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6d7006ac00 0x7f6d7006d110 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6d940c5c40 0x7f6d940af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.918+0000 7f6d99c00700 1 --2- 172.21.15.47:0/3027005343 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6d940c9270 0x7f6d94156bf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.919+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 >> 172.21.15.47:0/3027005343 conn(0x7f6d940ca940 msgr2=0x7f6d940cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.919+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 shutdown_connections 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:45.919+0000 7f6d99c00700 1 -- 172.21.15.47:0/3027005343 wait complete. 2024-05-10T04:51:45.921 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 2 2024-05-10T04:51:47.945 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:48.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.220+0000 7f8fbb200700 1 Processor -- start 2024-05-10T04:51:48.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.221+0000 7f8fbb200700 1 -- start start 2024-05-10T04:51:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.222+0000 7f8fbb200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb40ca900 0x7f8fb40cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.222+0000 7f8fbb200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40c62d0 con 0x7f8fb40c37a0 2024-05-10T04:51:48.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.222+0000 7f8fbb200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb40c56c0 con 0x7f8fb4152be0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.222+0000 7f8fbb200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40c59a0 con 0x7f8fb40ca900 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb9200700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8fb40c37a0 0x7f8fb40c3bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:32930/0 (socket says 172.21.15.47:32930) 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb9200700 1 -- 172.21.15.47:0/942268027 learned_addr learned my addr 172.21.15.47:0/942268027 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb3400700 1 --2- 172.21.15.47:0/942268027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb40ca900 0x7f8fb40cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504798844 0 0) 0x7f8fb40c62d0 con 0x7f8fb40c37a0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f980035b0 con 0x7f8fb40c37a0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606731680 0 0) 0x7f8fb40c56c0 con 0x7f8fb4152be0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fb40c62d0 con 0x7f8fb4152be0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb3400700 1 -- 172.21.15.47:0/942268027 >> v1:172.21.15.117:6789/0 conn(0x7f8fb4152be0 legacy=0x7f8fb4155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb3400700 1 -- 172.21.15.47:0/942268027 >> v1:172.21.15.47:6789/0 conn(0x7f8fb40c37a0 legacy=0x7f8fb40c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.223+0000 7f8fb3400700 1 -- 172.21.15.47:0/942268027 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40c5c80 con 0x7f8fb40ca900 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.224+0000 7f8fb3400700 1 --2- 172.21.15.47:0/942268027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb40ca900 0x7f8fb40cad10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009870 tx=0x7f8fa0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f622e3f300bf0bda server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:48.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.224+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0011830 con 0x7f8fb40ca900 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.224+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa0011990 con 0x7f8fb40ca900 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.224+0000 7f8fb2a00700 1 -- 172.21.15.47:0/942268027 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa0011d20 con 0x7f8fb40ca900 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 -- 172.21.15.47:0/942268027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb40ca900 msgr2=0x7f8fb40cad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 --2- 172.21.15.47:0/942268027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb40ca900 0x7f8fb40cad10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f8fa0009870 tx=0x7f8fa0009b80 comp rx=0 tx=0).stop 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 -- 172.21.15.47:0/942268027 shutdown_connections 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 --2- 172.21.15.47:0/942268027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb40ca900 0x7f8fb40cad10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 -- 172.21.15.47:0/942268027 >> 172.21.15.47:0/942268027 conn(0x7f8fb40c7630 msgr2=0x7f8fb40c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 -- 172.21.15.47:0/942268027 shutdown_connections 2024-05-10T04:51:48.228 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.225+0000 7f8fbb200700 1 -- 172.21.15.47:0/942268027 wait complete. 2024-05-10T04:51:48.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.227+0000 7f8fbb200700 1 Processor -- start 2024-05-10T04:51:48.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.227+0000 7f8fbb200700 1 -- start start 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fbb200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb40c37a0 0x7f8fb40c0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fbb200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 0x7f8fb41eb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fbb200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb4152be0 0x7f8fb4149f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fbb200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb41ec130 con 0x7f8fb40ca900 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fbb200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4155e60 con 0x7f8fb40c37a0 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fbb200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4154cc0 con 0x7f8fb4152be0 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 0x7f8fb41eb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 0x7f8fb41eb450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45508/0 (socket says 172.21.15.47:45508) 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 -- 172.21.15.47:0/3391649884 learned_addr learned my addr 172.21.15.47:0/3391649884 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:48.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb9200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb4152be0 0x7f8fb4149f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3e00700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb40c37a0 0x7f8fb40c0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 -- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb4152be0 msgr2=0x7f8fb4149f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb4152be0 0x7f8fb4149f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 -- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb40c37a0 msgr2=0x7f8fb40c0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb40c37a0 0x7f8fb40c0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3400700 1 -- 172.21.15.47:0/3391649884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa00094a0 con 0x7f8fb40ca900 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.229+0000 7f8fb3e00700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb40c37a0 0x7f8fb40c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.230+0000 7f8fb3400700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 0x7f8fb41eb450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00090b0 tx=0x7f8fa0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.230+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa001a970 con 0x7f8fb40ca900 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.230+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa001aad0 con 0x7f8fb40ca900 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.230+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa001ae40 con 0x7f8fb40ca900 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.230+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb41533a0 con 0x7f8fb40ca900 2024-05-10T04:51:48.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.230+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb41e13c0 con 0x7f8fb40ca900 2024-05-10T04:51:48.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.231+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb4074720 con 0x7f8fb40ca900 2024-05-10T04:51:48.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.233+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f8fa002d450 con 0x7f8fb40ca900 2024-05-10T04:51:48.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.234+0000 7f8fabe00700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8f9406ac30 0x7f8f9406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.234+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8fa008a1f0 con 0x7f8fb40ca900 2024-05-10T04:51:48.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.235+0000 7f8fb3e00700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8f9406ac30 0x7f8f9406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.236+0000 7f8fb3e00700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8f9406ac30 0x7f8f9406d140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40011e0 tx=0x7f8fa4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:48.241 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.240+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8fa00557f0 con 0x7f8fb40ca900 2024-05-10T04:51:48.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.507+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8fb40b0700 con 0x7f8fb40ca900 2024-05-10T04:51:48.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.509+0000 7f8fabe00700 1 -- 172.21.15.47:0/3391649884 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f8fa0015de0 con 0x7f8fb40ca900 2024-05-10T04:51:48.511 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:48.511 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8f9406ac30 msgr2=0x7f8f9406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8f9406ac30 0x7f8f9406d140 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40011e0 tx=0x7f8fa4009040 comp rx=0 tx=0).stop 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 msgr2=0x7f8fb41eb450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 0x7f8fb41eb450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00090b0 tx=0x7f8fa0004750 comp rx=0 tx=0).stop 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 shutdown_connections 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8f9406ac30 0x7f8f9406d140 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8fb4152be0 0x7f8fb4149f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8fb40c37a0 0x7f8fb40c0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 --2- 172.21.15.47:0/3391649884 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8fb40ca900 0x7f8fb41eb450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 >> 172.21.15.47:0/3391649884 conn(0x7f8fb40c7630 msgr2=0x7f8fb40ca050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 shutdown_connections 2024-05-10T04:51:48.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.512+0000 7f8fbb200700 1 -- 172.21.15.47:0/3391649884 wait complete. 2024-05-10T04:51:48.515 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 3 2024-05-10T04:51:48.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:48.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.806+0000 7f4ae7c00700 1 Processor -- start 2024-05-10T04:51:48.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.806+0000 7f4ae7c00700 1 -- start start 2024-05-10T04:51:48.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4ae7c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ae00c9440 0x7f4ae0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4ae7c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae006c7c0 con 0x7f4ae0159050 2024-05-10T04:51:48.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4ae7c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae006d060 con 0x7f4ae00c5c40 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4ae7c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ae0159890 con 0x7f4ae00c9440 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4adfe00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f4ae00c9440 0x7f4ae0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4ae5c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f4ae0159050 0x7f4ae015fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:32938/0 (socket says 172.21.15.47:32938) 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.808+0000 7f4ae5c00700 1 -- 172.21.15.47:0/2860047068 learned_addr learned my addr 172.21.15.47:0/2860047068 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adf400700 1 -- 172.21.15.47:0/2860047068 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217946780 0 0) 0x7f4ae006c7c0 con 0x7f4ae0159050 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adf400700 1 -- 172.21.15.47:0/2860047068 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ac80035b0 con 0x7f4ae0159050 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adf400700 1 -- 172.21.15.47:0/2860047068 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3762424547 0 0) 0x7f4ae006d060 con 0x7f4ae00c5c40 2024-05-10T04:51:48.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adfe00700 1 -- 172.21.15.47:0/2860047068 >> v1:172.21.15.117:6789/0 conn(0x7f4ae00c5c40 legacy=0x7f4ae00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adfe00700 1 -- 172.21.15.47:0/2860047068 >> v1:172.21.15.47:6789/0 conn(0x7f4ae0159050 legacy=0x7f4ae015fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adfe00700 1 -- 172.21.15.47:0/2860047068 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae006ca10 con 0x7f4ae00c9440 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adfe00700 1 --2- 172.21.15.47:0/2860047068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae0158b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009840 tx=0x7f4acc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0a31f826849538a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adf400700 1 -- 172.21.15.47:0/2860047068 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc011830 con 0x7f4ae00c9440 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adf400700 1 -- 172.21.15.47:0/2860047068 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc011990 con 0x7f4ae00c9440 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.809+0000 7f4adf400700 1 -- 172.21.15.47:0/2860047068 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc011d20 con 0x7f4ae00c9440 2024-05-10T04:51:48.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2860047068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 msgr2=0x7f4ae0158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2860047068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae0158b10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009840 tx=0x7f4acc009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:48.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2860047068 shutdown_connections 2024-05-10T04:51:48.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2860047068 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae0158b10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2860047068 >> 172.21.15.47:0/2860047068 conn(0x7f4ae00ca940 msgr2=0x7f4ae00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:48.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2860047068 shutdown_connections 2024-05-10T04:51:48.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.810+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2860047068 wait complete. 2024-05-10T04:51:48.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.812+0000 7f4ae7c00700 1 Processor -- start 2024-05-10T04:51:48.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.812+0000 7f4ae7c00700 1 -- start start 2024-05-10T04:51:48.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae7c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 0x7f4ae0157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae7c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae01eb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae7c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0159050 0x7f4ae014bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae7c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00c2570 con 0x7f4ae00c5c40 2024-05-10T04:51:48.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae7c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae00afc80 con 0x7f4ae00c9440 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae7c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae01eef90 con 0x7f4ae0159050 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae5200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 0x7f4ae0157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae5200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 0x7f4ae0157d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45518/0 (socket says 172.21.15.47:45518) 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae5200700 1 -- 172.21.15.47:0/2782335503 learned_addr learned my addr 172.21.15.47:0/2782335503 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4adfe00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae01eb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae5c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0159050 0x7f4ae014bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae5200700 1 -- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0159050 msgr2=0x7f4ae014bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.814+0000 7f4ae5200700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0159050 0x7f4ae014bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4ae5200700 1 -- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 msgr2=0x7f4ae01eb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4ae5200700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae01eb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4ae5200700 1 -- 172.21.15.47:0/2782335503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc0094a0 con 0x7f4ae00c5c40 2024-05-10T04:51:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4ae5200700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 0x7f4ae0157d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c450 tx=0x7f4ad400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:48.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40054e0 con 0x7f4ae00c5c40 2024-05-10T04:51:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad400ce60 con 0x7f4ae00c5c40 2024-05-10T04:51:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40038a0 con 0x7f4ae00c5c40 2024-05-10T04:51:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae01eaf00 con 0x7f4ae00c5c40 2024-05-10T04:51:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.815+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae01ef270 con 0x7f4ae00c5c40 2024-05-10T04:51:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.816+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae01eedf0 con 0x7f4ae00c5c40 2024-05-10T04:51:48.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.817+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f4ad4003a00 con 0x7f4ae00c5c40 2024-05-10T04:51:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.818+0000 7f4adcc00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f4ac006ac00 0x7f4ac006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.818+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4ad4088390 con 0x7f4ae00c5c40 2024-05-10T04:51:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.818+0000 7f4adfe00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f4ac006ac00 0x7f4ac006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:48.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.819+0000 7f4adfe00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f4ac006ac00 0x7f4ac006d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009fd0 tx=0x7f4acc01c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:48.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:48.823+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f4ae01eedf0 con 0x7f4ae00c5c40 2024-05-10T04:51:49.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.044+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ae01eedf0 con 0x7f4ae00c5c40 2024-05-10T04:51:49.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.086+0000 7f4adcc00700 1 -- 172.21.15.47:0/2782335503 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f4ae01eedf0 con 0x7f4ae00c5c40 2024-05-10T04:51:49.088 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:49.088 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":18,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:48.039079+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f4ac006ac00 msgr2=0x7f4ac006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f4ac006ac00 0x7f4ac006d110 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4acc009fd0 tx=0x7f4acc01c040 comp rx=0 tx=0).stop 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 msgr2=0x7f4ae0157d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 0x7f4ae0157d90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4ad400c450 tx=0x7f4ad400c760 comp rx=0 tx=0).stop 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 shutdown_connections 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f4ac006ac00 0x7f4ac006d110 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4ae0159050 0x7f4ae014bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.092 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4ae00c5c40 0x7f4ae0157d90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 --2- 172.21.15.47:0/2782335503 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4ae00c9440 0x7f4ae01eb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 >> 172.21.15.47:0/2782335503 conn(0x7f4ae00ca940 msgr2=0x7f4ae01518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 shutdown_connections 2024-05-10T04:51:49.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.090+0000 7f4ae7c00700 1 -- 172.21.15.47:0/2782335503 wait complete. 2024-05-10T04:51:49.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-10T04:51:49.118 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:51:49.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.390+0000 7febed800700 1 Processor -- start 2024-05-10T04:51:49.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.390+0000 7febed800700 1 -- start start 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febed800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe80c6cc0 0x7febe8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febed800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7febe806bdb0 0x7febe806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febed800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe806d640 con 0x7febe80c5cf0 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febed800700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe80c9800 con 0x7febe806bdb0 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febed800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe806c700 con 0x7febe80c6cc0 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febe6000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7febe80c5cf0 0x7febe80c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:32940/0 (socket says 172.21.15.47:32940) 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febe6000700 1 -- 172.21.15.47:0/532878379 learned_addr learned my addr 172.21.15.47:0/532878379 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febe7400700 1 --2- 172.21.15.47:0/532878379 >> v2:172.21.15.47:3300/0 conn(0x7febe806bdb0 0x7febe806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febe6a00700 1 --2- 172.21.15.47:0/532878379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe80c6cc0 0x7febe8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.392+0000 7febe5600700 1 -- 172.21.15.47:0/532878379 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494743659 0 0) 0x7febe806d640 con 0x7febe80c5cf0 2024-05-10T04:51:49.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe5600700 1 -- 172.21.15.47:0/532878379 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febcc0035b0 con 0x7febe80c5cf0 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe6a00700 1 -- 172.21.15.47:0/532878379 >> v2:172.21.15.47:3300/0 conn(0x7febe806bdb0 msgr2=0x7febe806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe6a00700 1 --2- 172.21.15.47:0/532878379 >> v2:172.21.15.47:3300/0 conn(0x7febe806bdb0 0x7febe806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe6a00700 1 -- 172.21.15.47:0/532878379 >> v1:172.21.15.47:6789/0 conn(0x7febe80c5cf0 legacy=0x7febe80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe6a00700 1 -- 172.21.15.47:0/532878379 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe80c6100 con 0x7febe80c6cc0 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe6a00700 1 --2- 172.21.15.47:0/532878379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe80c6cc0 0x7febe8152bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7febd8009840 tx=0x7febd8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7518f26d9d77191 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.393+0000 7febe5600700 1 -- 172.21.15.47:0/532878379 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8011830 con 0x7febe80c6cc0 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.394+0000 7febe5600700 1 -- 172.21.15.47:0/532878379 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd8011990 con 0x7febe80c6cc0 2024-05-10T04:51:49.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.394+0000 7febe5600700 1 -- 172.21.15.47:0/532878379 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8011d00 con 0x7febe80c6cc0 2024-05-10T04:51:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 -- 172.21.15.47:0/532878379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe80c6cc0 msgr2=0x7febe8152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 --2- 172.21.15.47:0/532878379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe80c6cc0 0x7febe8152bb0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7febd8009840 tx=0x7febd8009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 -- 172.21.15.47:0/532878379 shutdown_connections 2024-05-10T04:51:49.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 --2- 172.21.15.47:0/532878379 >> v2:172.21.15.47:3300/0 conn(0x7febe806bdb0 0x7febe806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 --2- 172.21.15.47:0/532878379 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe80c6cc0 0x7febe8152bb0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 -- 172.21.15.47:0/532878379 >> 172.21.15.47:0/532878379 conn(0x7febe80ca960 msgr2=0x7febe80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 -- 172.21.15.47:0/532878379 shutdown_connections 2024-05-10T04:51:49.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.395+0000 7febed800700 1 -- 172.21.15.47:0/532878379 wait complete. 2024-05-10T04:51:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.397+0000 7febed800700 1 Processor -- start 2024-05-10T04:51:49.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.398+0000 7febed800700 1 -- start start 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.399+0000 7febed800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe806bdb0 0x7febe80c1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.399+0000 7febed800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 0x7febe8150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febed800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febe80c6cc0 0x7febe80bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febed800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe80c0c40 con 0x7febe80c5cf0 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febed800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe81ee230 con 0x7febe80c6cc0 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febed800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe81ef090 con 0x7febe806bdb0 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 0x7febe8150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 0x7febe8150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45526/0 (socket says 172.21.15.47:45526) 2024-05-10T04:51:49.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe7400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febe80c6cc0 0x7febe80bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6000700 1 -- 172.21.15.47:0/3075610708 learned_addr learned my addr 172.21.15.47:0/3075610708 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6a00700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe806bdb0 0x7febe80c1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6a00700 1 -- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febe80c6cc0 msgr2=0x7febe80bff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6a00700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febe80c6cc0 0x7febe80bff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6a00700 1 -- 172.21.15.47:0/3075610708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 msgr2=0x7febe8150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6a00700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 0x7febe8150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe6a00700 1 -- 172.21.15.47:0/3075610708 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80094a0 con 0x7febe806bdb0 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.400+0000 7febe7400700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febe80c6cc0 0x7febe80bff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febe6000700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 0x7febe8150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:49.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febe6a00700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe806bdb0 0x7febe80c1280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febe80731e0 tx=0x7febd8004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd8004550 con 0x7febe806bdb0 2024-05-10T04:51:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd801e070 con 0x7febe806bdb0 2024-05-10T04:51:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd80038e0 con 0x7febe806bdb0 2024-05-10T04:51:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe80c17c0 con 0x7febe806bdb0 2024-05-10T04:51:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.401+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe81ee760 con 0x7febe806bdb0 2024-05-10T04:51:49.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.402+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe80bfd70 con 0x7febe806bdb0 2024-05-10T04:51:49.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.404+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7febd8003a40 con 0x7febe806bdb0 2024-05-10T04:51:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.405+0000 7febdea00700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febc806ac30 0x7febc806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.405+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7febd8020070 con 0x7febe806bdb0 2024-05-10T04:51:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.405+0000 7febe6000700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febc806ac30 0x7febc806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.407 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.406+0000 7febe6000700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febc806ac30 0x7febc806d140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febe80ca110 tx=0x7febd4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:49.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.410+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7febd8055e60 con 0x7febe806bdb0 2024-05-10T04:51:49.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.624+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febe8074720 con 0x7febe806bdb0 2024-05-10T04:51:49.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.625+0000 7febdea00700 1 -- 172.21.15.47:0/3075610708 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7febd80150a0 con 0x7febe806bdb0 2024-05-10T04:51:49.627 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:51:49.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febc806ac30 msgr2=0x7febc806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febc806ac30 0x7febc806d140 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7febe80ca110 tx=0x7febd4009040 comp rx=0 tx=0).stop 2024-05-10T04:51:49.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe806bdb0 msgr2=0x7febe80c1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe806bdb0 0x7febe80c1280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7febe80731e0 tx=0x7febd8004750 comp rx=0 tx=0).stop 2024-05-10T04:51:49.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 shutdown_connections 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febe80c6cc0 0x7febe80bff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febc806ac30 0x7febc806d140 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febe806bdb0 0x7febe80c1280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 --2- 172.21.15.47:0/3075610708 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febe80c5cf0 0x7febe8150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 >> 172.21.15.47:0/3075610708 conn(0x7febe80ca960 msgr2=0x7febe80c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 shutdown_connections 2024-05-10T04:51:49.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.627+0000 7febed800700 1 -- 172.21.15.47:0/3075610708 wait complete. 2024-05-10T04:51:49.655 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-10T04:51:49.688 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:49.704 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:51:49.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.923+0000 7fc56aa00700 1 Processor -- start 2024-05-10T04:51:49.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.923+0000 7fc56aa00700 1 -- start start 2024-05-10T04:51:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc56aa00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fc5641555c0 0x7fc56414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc56aa00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc56406cd90 0x7fc56406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc56aa00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640c53b0 con 0x7fc5640c3460 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc56aa00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc56414fb30 con 0x7fc56406cd90 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc56aa00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640c5f30 con 0x7fc5641555c0 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc56406cd90 0x7fc56406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fc56406cd90 0x7fc56406d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45528/0 (socket says 172.21.15.47:45528) 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563400700 1 -- 172.21.15.47:0/2205171623 learned_addr learned my addr 172.21.15.47:0/2205171623 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563e00700 1 --2- 172.21.15.47:0/2205171623 >> v2:172.21.15.117:3300/0 conn(0x7fc5641555c0 0x7fc56414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563400700 1 -- 172.21.15.47:0/2205171623 >> v2:172.21.15.117:3300/0 conn(0x7fc5641555c0 msgr2=0x7fc56414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563400700 1 --2- 172.21.15.47:0/2205171623 >> v2:172.21.15.117:3300/0 conn(0x7fc5641555c0 0x7fc56414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.925+0000 7fc563400700 1 -- 172.21.15.47:0/2205171623 >> v1:172.21.15.117:6789/0 conn(0x7fc5640c3460 legacy=0x7fc5640c3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.926+0000 7fc563400700 1 -- 172.21.15.47:0/2205171623 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640c63c0 con 0x7fc56406cd90 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.926+0000 7fc563400700 1 --2- 172.21.15.47:0/2205171623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc56406d1a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5640c8520 tx=0x7fc550009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ec523cdc68c6ec server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.926+0000 7fc562a00700 1 -- 172.21.15.47:0/2205171623 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550011830 con 0x7fc56406cd90 2024-05-10T04:51:49.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.926+0000 7fc562a00700 1 -- 172.21.15.47:0/2205171623 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc550011990 con 0x7fc56406cd90 2024-05-10T04:51:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.926+0000 7fc562a00700 1 -- 172.21.15.47:0/2205171623 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc550011d20 con 0x7fc56406cd90 2024-05-10T04:51:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 -- 172.21.15.47:0/2205171623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 msgr2=0x7fc56406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 --2- 172.21.15.47:0/2205171623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc56406d1a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc5640c8520 tx=0x7fc550009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 -- 172.21.15.47:0/2205171623 shutdown_connections 2024-05-10T04:51:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 --2- 172.21.15.47:0/2205171623 >> v2:172.21.15.117:3300/0 conn(0x7fc5641555c0 0x7fc56414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 --2- 172.21.15.47:0/2205171623 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc56406d1a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 -- 172.21.15.47:0/2205171623 >> 172.21.15.47:0/2205171623 conn(0x7fc5640caa30 msgr2=0x7fc5640cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 -- 172.21.15.47:0/2205171623 shutdown_connections 2024-05-10T04:51:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.927+0000 7fc56aa00700 1 -- 172.21.15.47:0/2205171623 wait complete. 2024-05-10T04:51:49.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.929+0000 7fc56aa00700 1 Processor -- start 2024-05-10T04:51:49.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.929+0000 7fc56aa00700 1 -- start start 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc56aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc5640c1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc56aa00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5640c3460 0x7fc5641ee4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc56aa00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5641555c0 0x7fc56413a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc56aa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc564149010 con 0x7fc56406cd90 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc56aa00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5641e1a20 con 0x7fc5641555c0 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc56aa00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5641588a0 con 0x7fc5640c3460 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc5640c1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc5640c1740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45544/0 (socket says 172.21.15.47:45544) 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 -- 172.21.15.47:0/3012967006 learned_addr learned my addr 172.21.15.47:0/3012967006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 -- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5640c3460 msgr2=0x7fc5641ee4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563400700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5640c3460 0x7fc5641ee4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc568a00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5641555c0 0x7fc56413a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5640c3460 0x7fc5641ee4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 -- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5641555c0 msgr2=0x7fc56413a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5641555c0 0x7fc56413a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563e00700 1 -- 172.21.15.47:0/3012967006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc550009550 con 0x7fc56406cd90 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc563400700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5640c3460 0x7fc5641ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.931+0000 7fc568a00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5641555c0 0x7fc56413a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.932+0000 7fc563e00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc5640c1740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc55400e8a0 tx=0x7fc55400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.932+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55400ee40 con 0x7fc56406cd90 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.932+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55400c850 con 0x7fc56406cd90 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.932+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55400cbc0 con 0x7fc56406cd90 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.932+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5641ef210 con 0x7fc56406cd90 2024-05-10T04:51:49.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.932+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc564148dc0 con 0x7fc56406cd90 2024-05-10T04:51:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.933+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc564074720 con 0x7fc56406cd90 2024-05-10T04:51:49.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.934+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fc55400cd20 con 0x7fc56406cd90 2024-05-10T04:51:49.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.936+0000 7fc55be00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fc54406ac30 0x7fc54406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:49.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.936+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc554089210 con 0x7fc56406cd90 2024-05-10T04:51:49.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.936+0000 7fc563400700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fc54406ac30 0x7fc54406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:49.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.937+0000 7fc563400700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fc54406ac30 0x7fc54406d140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc56414eea0 tx=0x7fc550008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:49.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:49.941+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fc554054780 con 0x7fc56406cd90 2024-05-10T04:51:50.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.100+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc554054b50 con 0x7fc56406cd90 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.161+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc5640c6ed0 con 0x7fc56406cd90 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.161+0000 7fc55be00700 1 -- 172.21.15.47:0/3012967006 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc554086710 con 0x7fc56406cd90 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout:[ 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: { 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "poolnum": 1, 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: "poolname": ".mgr" 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-10T04:51:50.163 INFO:teuthology.orchestra.run.smithi047.stdout:] 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fc54406ac30 msgr2=0x7fc54406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fc54406ac30 0x7fc54406d140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc56414eea0 tx=0x7fc550008030 comp rx=0 tx=0).stop 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 msgr2=0x7fc5640c1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc5640c1740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc55400e8a0 tx=0x7fc55400ec60 comp rx=0 tx=0).stop 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 shutdown_connections 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fc5641555c0 0x7fc56413a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fc56406cd90 0x7fc5640c1740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fc54406ac30 0x7fc54406d140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 --2- 172.21.15.47:0/3012967006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fc5640c3460 0x7fc5641ee4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 >> 172.21.15.47:0/3012967006 conn(0x7fc5640caa30 msgr2=0x7fc5640c3870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 shutdown_connections 2024-05-10T04:51:50.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.164+0000 7fc56aa00700 1 -- 172.21.15.47:0/3012967006 wait complete. 2024-05-10T04:51:50.189 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-10T04:51:50.190 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-10T04:51:50.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.460+0000 7f2232400700 1 Processor -- start 2024-05-10T04:51:50.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.460+0000 7f2232400700 1 -- start start 2024-05-10T04:51:50.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f2232400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0ca8e0 0x7f222c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f2232400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f222c0c3780 0x7f222c0c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f2232400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222c0c62b0 con 0x7f222c152bc0 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f2232400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222c0c56a0 con 0x7f222c0c3780 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f2232400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c0c5980 con 0x7f222c0ca8e0 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f222b400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f222c152bc0 0x7f222c155e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:32954/0 (socket says 172.21.15.47:32954) 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f222b400700 1 -- 172.21.15.47:0/2139093190 learned_addr learned my addr 172.21.15.47:0/2139093190 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f222be00700 1 --2- 172.21.15.47:0/2139093190 >> v2:172.21.15.117:3300/0 conn(0x7f222c0c3780 0x7f222c0c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.462+0000 7f2223e00700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0ca8e0 0x7f222c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222aa00700 1 -- 172.21.15.47:0/2139093190 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222548063 0 0) 0x7f222c0c62b0 con 0x7f222c152bc0 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222aa00700 1 -- 172.21.15.47:0/2139093190 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22100035b0 con 0x7f222c152bc0 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222be00700 1 -- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0ca8e0 msgr2=0x7f222c0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222be00700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0ca8e0 0x7f222c0cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222be00700 1 -- 172.21.15.47:0/2139093190 >> v1:172.21.15.47:6789/0 conn(0x7f222c152bc0 legacy=0x7f222c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:50.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222be00700 1 -- 172.21.15.47:0/2139093190 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222c0c5c60 con 0x7f222c0c3780 2024-05-10T04:51:50.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f2223e00700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0ca8e0 0x7f222c0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:50.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.463+0000 7f222be00700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0c3780 0x7f222c0c3b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2224009d90 tx=0x7f222400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96fab34fee3c2b89 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:50.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f222aa00700 1 -- 172.21.15.47:0/2139093190 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222400e070 con 0x7f222c0c3780 2024-05-10T04:51:50.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f222aa00700 1 -- 172.21.15.47:0/2139093190 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222400bb20 con 0x7f222c0c3780 2024-05-10T04:51:50.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f222aa00700 1 -- 172.21.15.47:0/2139093190 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224012430 con 0x7f222c0c3780 2024-05-10T04:51:50.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 -- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0c3780 msgr2=0x7f222c0c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:50.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0c3780 0x7f222c0c3b90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2224009d90 tx=0x7f222400b330 comp rx=0 tx=0).stop 2024-05-10T04:51:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 -- 172.21.15.47:0/2139093190 shutdown_connections 2024-05-10T04:51:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0c3780 0x7f222c0c3b90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 --2- 172.21.15.47:0/2139093190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0ca8e0 0x7f222c0cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 -- 172.21.15.47:0/2139093190 >> 172.21.15.47:0/2139093190 conn(0x7f222c0c7610 msgr2=0x7f222c0c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.464+0000 7f2232400700 1 -- 172.21.15.47:0/2139093190 shutdown_connections 2024-05-10T04:51:50.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.465+0000 7f2232400700 1 -- 172.21.15.47:0/2139093190 wait complete. 2024-05-10T04:51:50.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.467+0000 7f2232400700 1 Processor -- start 2024-05-10T04:51:50.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.467+0000 7f2232400700 1 -- start start 2024-05-10T04:51:50.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2232400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0c3780 0x7f222c151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:50.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2232400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0ca8e0 0x7f222c154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2232400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 0x7f222c144110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2232400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c1560b0 con 0x7f222c152bc0 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2232400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c154e50 con 0x7f222c0ca8e0 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2232400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222c1ef370 con 0x7f222c0c3780 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f222be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 0x7f222c144110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f222be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 0x7f222c144110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45558/0 (socket says 172.21.15.47:45558) 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f222be00700 1 -- 172.21.15.47:0/3176339226 learned_addr learned my addr 172.21.15.47:0/3176339226 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f2223e00700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0ca8e0 0x7f222c154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.468+0000 7f222b400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0c3780 0x7f222c151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f222be00700 1 -- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0c3780 msgr2=0x7f222c151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:50.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f222be00700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0c3780 0x7f222c151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f222be00700 1 -- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0ca8e0 msgr2=0x7f222c154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f222be00700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0ca8e0 0x7f222c154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f222be00700 1 -- 172.21.15.47:0/3176339226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22140094a0 con 0x7f222c152bc0 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f2223e00700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0ca8e0 0x7f222c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f222be00700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 0x7f222c144110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2224014040 tx=0x7f2224004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.469+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22240129f0 con 0x7f222c152bc0 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.470+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2224020070 con 0x7f222c152bc0 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.470+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2224009a70 con 0x7f222c152bc0 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.470+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2224012db0 con 0x7f222c152bc0 2024-05-10T04:51:50.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.470+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c0c1c60 con 0x7f222c152bc0 2024-05-10T04:51:50.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.471+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c0c1e50 con 0x7f222c152bc0 2024-05-10T04:51:50.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.472+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2224004040 con 0x7f222c152bc0 2024-05-10T04:51:50.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.473+0000 7f2223400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f220806ac90 0x7f220806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:50.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.473+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2224022070 con 0x7f222c152bc0 2024-05-10T04:51:50.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.473+0000 7f222b400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f220806ac90 0x7f220806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:50.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.474+0000 7f222b400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f220806ac90 0x7f220806d1a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f221c007fd0 tx=0x7f221c007dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:50.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.478+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2224056200 con 0x7f222c152bc0 2024-05-10T04:51:50.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:50.691+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f222c074720 con 0x7f222c152bc0 2024-05-10T04:51:51.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.105+0000 7f2223400700 1 -- 172.21.15.47:0/3176339226 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2224059820 con 0x7f222c152bc0 2024-05-10T04:51:51.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f220806ac90 msgr2=0x7f220806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:51.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f220806ac90 0x7f220806d1a0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f221c007fd0 tx=0x7f221c007dc0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 msgr2=0x7f222c144110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:51.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 0x7f222c144110 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2224014040 tx=0x7f2224004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 shutdown_connections 2024-05-10T04:51:51.111 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f222c152bc0 0x7f222c144110 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f220806ac90 0x7f220806d1a0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f222c0c3780 0x7f222c151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 --2- 172.21.15.47:0/3176339226 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f222c0ca8e0 0x7f222c154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 >> 172.21.15.47:0/3176339226 conn(0x7f222c0c7610 msgr2=0x7f222c14e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 shutdown_connections 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.109+0000 7f2232400700 1 -- 172.21.15.47:0/3176339226 wait complete. 2024-05-10T04:51:51.112 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' created 2024-05-10T04:51:51.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-10T04:51:51.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.417+0000 7f6c39400700 1 Processor -- start 2024-05-10T04:51:51.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.417+0000 7f6c39400700 1 -- start start 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c39400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6c34152bb0 0x7f6c340c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c39400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 0x7f6c3406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c39400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c3406d640 con 0x7f6c340c6cc0 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c39400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c34152fc0 con 0x7f6c34152bb0 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c39400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c9800 con 0x7f6c3406bdb0 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c32800700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6c340c6cc0 0x7f6c340c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48508/0 (socket says 172.21.15.47:48508) 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.419+0000 7f6c32800700 1 -- 172.21.15.47:0/1266619294 learned_addr learned my addr 172.21.15.47:0/1266619294 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:51.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31e00700 1 --2- 172.21.15.47:0/1266619294 >> v2:172.21.15.117:3300/0 conn(0x7f6c34152bb0 0x7f6c340c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c33200700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 0x7f6c3406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3093205996 0 0) 0x7f6c3406d640 con 0x7f6c340c6cc0 2024-05-10T04:51:51.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c180035b0 con 0x7f6c340c6cc0 2024-05-10T04:51:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1905754705 0 0) 0x7f6c180035b0 con 0x7f6c340c6cc0 2024-05-10T04:51:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 msgr2=0x7f6c3406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 0x7f6c3406c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 >> v2:172.21.15.117:3300/0 conn(0x7f6c34152bb0 msgr2=0x7f6c340c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 --2- 172.21.15.47:0/1266619294 >> v2:172.21.15.117:3300/0 conn(0x7f6c34152bb0 0x7f6c340c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3406c700 con 0x7f6c340c6cc0 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f6c24001670 con 0x7f6c340c6cc0 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 >> v1:172.21.15.47:6789/0 conn(0x7f6c340c6cc0 legacy=0x7f6c340c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 0x7f6c18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18004d90 0x7f6c180051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34152fc0 con 0x7f6c18003a00 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c9800 con 0x7f6c18004d90 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1800bb70 con 0x7f6c3406bdb0 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.420+0000 7f6c32800700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c33200700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18004d90 0x7f6c180051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c31e00700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 0x7f6c18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c32800700 1 -- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 msgr2=0x7f6c18004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:51.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c32800700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c3406bdb0 0x7f6c18004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c32800700 1 -- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18004d90 msgr2=0x7f6c180051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c32800700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c18004d90 0x7f6c180051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c32800700 1 -- 172.21.15.47:0/1266619294 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c180035b0 con 0x7f6c18003a00 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c32800700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c18003e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c320 tx=0x7f6c18005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270a7c9826ca7748 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400ce60 con 0x7f6c18003a00 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24005960 con 0x7f6c18003a00 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.421+0000 7f6c31400700 1 -- 172.21.15.47:0/1266619294 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24005cf0 con 0x7f6c18003a00 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c39400700 1 -- 172.21.15.47:0/1266619294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 msgr2=0x7f6c18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c39400700 1 --2- 172.21.15.47:0/1266619294 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c18003e70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c320 tx=0x7f6c18005880 comp rx=0 tx=0).stop 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c33200700 1 -- 172.21.15.47:0/1266619294 reap_dead start 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c39400700 1 -- 172.21.15.47:0/1266619294 shutdown_connections 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c39400700 1 -- 172.21.15.47:0/1266619294 >> 172.21.15.47:0/1266619294 conn(0x7f6c340ca960 msgr2=0x7f6c340cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:51.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c39400700 1 -- 172.21.15.47:0/1266619294 shutdown_connections 2024-05-10T04:51:51.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.422+0000 7f6c39400700 1 -- 172.21.15.47:0/1266619294 wait complete. 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.424+0000 7f6c39400700 1 Processor -- start 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.425+0000 7f6c39400700 1 -- start start 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c39400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c340c4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c39400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c341e8110 0x7f6c340bed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c39400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c340bf2c0 0x7f6c340c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c39400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340c1780 con 0x7f6c18003a00 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c39400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341eab80 con 0x7f6c341e8110 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c39400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3414f900 con 0x7f6c340bf2c0 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c32800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c340c4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c32800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c340c4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34880/0 (socket says 172.21.15.47:34880) 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.426+0000 7f6c32800700 1 -- 172.21.15.47:0/2545331402 learned_addr learned my addr 172.21.15.47:0/2545331402 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c31e00700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c341e8110 0x7f6c340bed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c32800700 1 -- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c340bf2c0 msgr2=0x7f6c340c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c32800700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c340bf2c0 0x7f6c340c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c32800700 1 -- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c341e8110 msgr2=0x7f6c340bed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c32800700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c341e8110 0x7f6c340bed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:51.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c32800700 1 -- 172.21.15.47:0/2545331402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c340bfaa0 con 0x7f6c18003a00 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c32800700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c340c4620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c910 tx=0x7f6c24001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24000fe0 con 0x7f6c18003a00 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24001680 con 0x7f6c18003a00 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340c1530 con 0x7f6c18003a00 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24004cc0 con 0x7f6c18003a00 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.427+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340be330 con 0x7f6c18003a00 2024-05-10T04:51:51.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.428+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34074720 con 0x7f6c18003a00 2024-05-10T04:51:51.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.429+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c240070d0 con 0x7f6c18003a00 2024-05-10T04:51:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.430+0000 7f6c2aa00700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6c1406ac90 0x7f6c1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.430+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6c2408a8d0 con 0x7f6c18003a00 2024-05-10T04:51:51.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.431+0000 7f6c31e00700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6c1406ac90 0x7f6c1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:51.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.431+0000 7f6c31e00700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6c1406ac90 0x7f6c1406d1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c34150410 tx=0x7f6c20008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:51.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.436+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6c24055c80 con 0x7f6c18003a00 2024-05-10T04:51:51.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:51.650+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f6c340c5cf0 con 0x7f6c18003a00 2024-05-10T04:51:52.120 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.118+0000 7f6c2aa00700 1 -- 172.21.15.47:0/2545331402 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f6c24007da0 con 0x7f6c18003a00 2024-05-10T04:51:52.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.122+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6c1406ac90 msgr2=0x7f6c1406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.122+0000 7f6c39400700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6c1406ac90 0x7f6c1406d1a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6c34150410 tx=0x7f6c20008040 comp rx=0 tx=0).stop 2024-05-10T04:51:52.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.122+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 msgr2=0x7f6c340c4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.122+0000 7f6c39400700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c340c4620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c910 tx=0x7f6c24001a00 comp rx=0 tx=0).stop 2024-05-10T04:51:52.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.124+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 shutdown_connections 2024-05-10T04:51:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.124+0000 7f6c39400700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6c1406ac90 0x7f6c1406d1a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.124+0000 7f6c39400700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6c340bf2c0 0x7f6c340c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.124+0000 7f6c39400700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6c18003a00 0x7f6c340c4620 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.124+0000 7f6c39400700 1 --2- 172.21.15.47:0/2545331402 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6c341e8110 0x7f6c340bed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.124+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 >> 172.21.15.47:0/2545331402 conn(0x7f6c340ca960 msgr2=0x7f6c34158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:52.126 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.125+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 shutdown_connections 2024-05-10T04:51:52.128 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.126+0000 7f6c39400700 1 -- 172.21.15.47:0/2545331402 wait complete. 2024-05-10T04:51:52.131 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' created 2024-05-10T04:51:52.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-10T04:51:52.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.434+0000 7fdacd400700 1 Processor -- start 2024-05-10T04:51:52.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.435+0000 7fdacd400700 1 -- start start 2024-05-10T04:51:52.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.436+0000 7fdacd400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdac8152bb0 0x7fdac80c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.436+0000 7fdacd400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fdac806bdb0 0x7fdac806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.436+0000 7fdacd400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac806d640 con 0x7fdac80c6cc0 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.436+0000 7fdacd400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac8152fc0 con 0x7fdac8152bb0 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.436+0000 7fdacd400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac80c9800 con 0x7fdac806bdb0 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdac8152bb0 0x7fdac80c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fdac8152bb0 0x7fdac80c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34896/0 (socket says 172.21.15.47:34896) 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 -- 172.21.15.47:0/2772326433 learned_addr learned my addr 172.21.15.47:0/2772326433 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac7200700 1 --2- 172.21.15.47:0/2772326433 >> v2:172.21.15.117:3300/0 conn(0x7fdac806bdb0 0x7fdac806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 -- 172.21.15.47:0/2772326433 >> v2:172.21.15.117:3300/0 conn(0x7fdac806bdb0 msgr2=0x7fdac806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 --2- 172.21.15.47:0/2772326433 >> v2:172.21.15.117:3300/0 conn(0x7fdac806bdb0 0x7fdac806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 -- 172.21.15.47:0/2772326433 >> v1:172.21.15.117:6789/0 conn(0x7fdac80c6cc0 legacy=0x7fdac80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 -- 172.21.15.47:0/2772326433 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac806c700 con 0x7fdac8152bb0 2024-05-10T04:51:52.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.437+0000 7fdac5e00700 1 --2- 172.21.15.47:0/2772326433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac80c5cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdac80c8430 tx=0x7fdab4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c400d9c517c598d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:52.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdac5400700 1 -- 172.21.15.47:0/2772326433 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4011830 con 0x7fdac8152bb0 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdac5400700 1 -- 172.21.15.47:0/2772326433 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4011990 con 0x7fdac8152bb0 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdac5400700 1 -- 172.21.15.47:0/2772326433 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4011d20 con 0x7fdac8152bb0 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 -- 172.21.15.47:0/2772326433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 msgr2=0x7fdac80c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 --2- 172.21.15.47:0/2772326433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac80c5cf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdac80c8430 tx=0x7fdab4009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 -- 172.21.15.47:0/2772326433 shutdown_connections 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 --2- 172.21.15.47:0/2772326433 >> v2:172.21.15.117:3300/0 conn(0x7fdac806bdb0 0x7fdac806c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 --2- 172.21.15.47:0/2772326433 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac80c5cf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 -- 172.21.15.47:0/2772326433 >> 172.21.15.47:0/2772326433 conn(0x7fdac80ca960 msgr2=0x7fdac80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.438+0000 7fdacd400700 1 -- 172.21.15.47:0/2772326433 shutdown_connections 2024-05-10T04:51:52.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.439+0000 7fdacd400700 1 -- 172.21.15.47:0/2772326433 wait complete. 2024-05-10T04:51:52.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.441+0000 7fdacd400700 1 Processor -- start 2024-05-10T04:51:52.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.441+0000 7fdacd400700 1 -- start start 2024-05-10T04:51:52.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdacd400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac806bdb0 0x7fdac80bf210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:52.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdacd400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac80c6cc0 0x7fdac814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:52.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdacd400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac81ee320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:52.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdacd400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c5060 con 0x7fdac8152bb0 2024-05-10T04:51:52.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdacd400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80c1b20 con 0x7fdac80c6cc0 2024-05-10T04:51:52.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdacd400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac80bf9d0 con 0x7fdac806bdb0 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdac7200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac81ee320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdac7200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac81ee320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34910/0 (socket says 172.21.15.47:34910) 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.442+0000 7fdac7200700 1 -- 172.21.15.47:0/2797510563 learned_addr learned my addr 172.21.15.47:0/2797510563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac5e00700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac80c6cc0 0x7fdac814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac6800700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac806bdb0 0x7fdac80bf210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac7200700 1 -- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac806bdb0 msgr2=0x7fdac80bf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac7200700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac806bdb0 0x7fdac80bf210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac7200700 1 -- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac80c6cc0 msgr2=0x7fdac814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac7200700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac80c6cc0 0x7fdac814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac7200700 1 -- 172.21.15.47:0/2797510563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab4009550 con 0x7fdac8152bb0 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac5e00700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac80c6cc0 0x7fdac814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdac7200700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac81ee320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdac000efc0 tx=0x7fdac000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:52.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0009ba0 con 0x7fdac8152bb0 2024-05-10T04:51:52.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac000f040 con 0x7fdac8152bb0 2024-05-10T04:51:52.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac0014480 con 0x7fdac8152bb0 2024-05-10T04:51:52.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.443+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac814d210 con 0x7fdac8152bb0 2024-05-10T04:51:52.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.444+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac80bf750 con 0x7fdac8152bb0 2024-05-10T04:51:52.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.445+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac814d930 con 0x7fdac8152bb0 2024-05-10T04:51:52.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.446+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdac00145e0 con 0x7fdac8152bb0 2024-05-10T04:51:52.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.448+0000 7fdabea00700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fdaa806ac90 0x7fdaa806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:52.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.448+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fdac008a370 con 0x7fdac8152bb0 2024-05-10T04:51:52.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.448+0000 7fdac6800700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fdaa806ac90 0x7fdaa806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:52.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.449+0000 7fdac6800700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fdaa806ac90 0x7fdaa806d1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdab8000f60 tx=0x7fdab8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:52.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.452+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fdac0055620 con 0x7fdac8152bb0 2024-05-10T04:51:52.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.716+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fdac8074720 con 0x7fdac8152bb0 2024-05-10T04:51:52.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.723+0000 7fdabea00700 1 -- 172.21.15.47:0/2797510563 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fdac00180c0 con 0x7fdac8152bb0 2024-05-10T04:51:52.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.728+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fdaa806ac90 msgr2=0x7fdaa806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.728+0000 7fdacd400700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fdaa806ac90 0x7fdaa806d1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fdab8000f60 tx=0x7fdab8009040 comp rx=0 tx=0).stop 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.728+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 msgr2=0x7fdac81ee320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.728+0000 7fdacd400700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac81ee320 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdac000efc0 tx=0x7fdac000c3a0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.730+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 shutdown_connections 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.730+0000 7fdacd400700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fdac8152bb0 0x7fdac81ee320 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.730+0000 7fdacd400700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fdaa806ac90 0x7fdaa806d1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.730+0000 7fdacd400700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fdac806bdb0 0x7fdac80bf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.730+0000 7fdacd400700 1 --2- 172.21.15.47:0/2797510563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fdac80c6cc0 0x7fdac814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:52.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.730+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 >> 172.21.15.47:0/2797510563 conn(0x7fdac80ca960 msgr2=0x7fdac80abc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:52.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.731+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 shutdown_connections 2024-05-10T04:51:52.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:52.732+0000 7fdacd400700 1 -- 172.21.15.47:0/2797510563 wait complete. 2024-05-10T04:51:52.742 INFO:teuthology.orchestra.run.smithi047.stderr:new fs with metadata pool 2 and data pool 3 2024-05-10T04:51:52.781 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-10T04:51:52.781 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-10T04:51:53.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.053+0000 7fe5e8600700 1 Processor -- start 2024-05-10T04:51:53.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.053+0000 7fe5e8600700 1 -- start start 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e8600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5e0152bc0 0x7fe5e0155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e8600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e00c62b0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e8600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5e00cb100 con 0x7fe5e00ca8e0 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e8600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e01563a0 con 0x7fe5e0152bc0 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e6600700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe5e00cacf0 0x7fe5e00c3e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48516/0 (socket says 172.21.15.47:48516) 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e6600700 1 -- 172.21.15.47:0/2448448906 learned_addr learned my addr 172.21.15.47:0/2448448906 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:53.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.055+0000 7fe5e5c00700 1 --2- 172.21.15.47:0/2448448906 >> v2:172.21.15.117:3300/0 conn(0x7fe5e0152bc0 0x7fe5e0155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5dfe00700 1 -- 172.21.15.47:0/2448448906 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957087017 0 0) 0x7fe5e00c62b0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5dfe00700 1 -- 172.21.15.47:0/2448448906 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5c80035b0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5e5c00700 1 -- 172.21.15.47:0/2448448906 >> v1:172.21.15.117:6789/0 conn(0x7fe5e00ca8e0 legacy=0x7fe5e00c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5e5c00700 1 -- 172.21.15.47:0/2448448906 >> v1:172.21.15.47:6789/0 conn(0x7fe5e00cacf0 legacy=0x7fe5e00c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5e5c00700 1 -- 172.21.15.47:0/2448448906 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e00c56a0 con 0x7fe5e0152bc0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5e5c00700 1 --2- 172.21.15.47:0/2448448906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e0155e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bc652cf23b593a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.056+0000 7fe5dfe00700 1 -- 172.21.15.47:0/2448448906 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011830 con 0x7fe5e0152bc0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5dfe00700 1 -- 172.21.15.47:0/2448448906 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d4011990 con 0x7fe5e0152bc0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5dfe00700 1 -- 172.21.15.47:0/2448448906 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d4011d20 con 0x7fe5e0152bc0 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 -- 172.21.15.47:0/2448448906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 msgr2=0x7fe5e0155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2448448906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e0155e60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:53.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 -- 172.21.15.47:0/2448448906 shutdown_connections 2024-05-10T04:51:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2448448906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e0155e60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 -- 172.21.15.47:0/2448448906 >> 172.21.15.47:0/2448448906 conn(0x7fe5e00c7610 msgr2=0x7fe5e00c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 -- 172.21.15.47:0/2448448906 shutdown_connections 2024-05-10T04:51:53.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.057+0000 7fe5e8600700 1 -- 172.21.15.47:0/2448448906 wait complete. 2024-05-10T04:51:53.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.059+0000 7fe5e8600700 1 Processor -- start 2024-05-10T04:51:53.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.060+0000 7fe5e8600700 1 -- start start 2024-05-10T04:51:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e8600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ca8e0 0x7fe5e01ec3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e8600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 0x7fe5e006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e8600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e014ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:53.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e8600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00c02e0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e8600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e00af9b0 con 0x7fe5e0152bc0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e8600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e01ebf10 con 0x7fe5e00ca8e0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e5200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 0x7fe5e006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e5200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 0x7fe5e006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34926/0 (socket says 172.21.15.47:34926) 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e5200700 1 -- 172.21.15.47:0/2640096347 learned_addr learned my addr 172.21.15.47:0/2640096347 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e5c00700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ca8e0 0x7fe5e01ec3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.061+0000 7fe5e6600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e014ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e5200700 1 -- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ca8e0 msgr2=0x7fe5e01ec3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e5200700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ca8e0 0x7fe5e01ec3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e5200700 1 -- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 msgr2=0x7fe5e014ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e5200700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e014ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e5200700 1 -- 172.21.15.47:0/2640096347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d40094a0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e6600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:53.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e5200700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 0x7fe5e006cfc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c460 tx=0x7fe5cc00c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0052d0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5cc005430 con 0x7fe5e00cacf0 2024-05-10T04:51:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0038c0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e01eb930 con 0x7fe5e00cacf0 2024-05-10T04:51:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.062+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e01ebba0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.063+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e0074720 con 0x7fe5e00cacf0 2024-05-10T04:51:53.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.065+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe5cc003a20 con 0x7fe5e00cacf0 2024-05-10T04:51:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.065+0000 7fe5dd600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe5c006ac90 0x7fe5c006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.065+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5cc0886c0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.066+0000 7fe5e5c00700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe5c006ac90 0x7fe5c006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:53.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.067+0000 7fe5e5c00700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe5c006ac90 0x7fe5c006d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:53.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.070+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe5cc053820 con 0x7fe5e00cacf0 2024-05-10T04:51:53.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.296+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fe5e014f6e0 con 0x7fe5e00cacf0 2024-05-10T04:51:53.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.729+0000 7fe5dd600700 1 -- 172.21.15.47:0/2640096347 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fe5cc056e40 con 0x7fe5e00cacf0 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe5c006ac90 msgr2=0x7fe5c006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe5c006ac90 0x7fe5c006d1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe5d4009840 tx=0x7fe5d4008030 comp rx=0 tx=0).stop 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 msgr2=0x7fe5e006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 0x7fe5e006cfc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00c460 tx=0x7fe5cc00c770 comp rx=0 tx=0).stop 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 shutdown_connections 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5e0152bc0 0x7fe5e014ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe5c006ac90 0x7fe5c006d1a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5e00ca8e0 0x7fe5e01ec3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 --2- 172.21.15.47:0/2640096347 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5e00cacf0 0x7fe5e006cfc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 >> 172.21.15.47:0/2640096347 conn(0x7fe5e00c7610 msgr2=0x7fe5e0153df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:53.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 shutdown_connections 2024-05-10T04:51:53.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:53.733+0000 7fe5e8600700 1 -- 172.21.15.47:0/2640096347 wait complete. 2024-05-10T04:51:53.763 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-10T04:51:54.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.046+0000 7ff4be600700 1 Processor -- start 2024-05-10T04:51:54.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.046+0000 7ff4be600700 1 -- start start 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.048+0000 7ff4be600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ff4b81529c0 0x7ff4b81558b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.048+0000 7ff4be600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b80af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.048+0000 7ff4be600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80c8740 con 0x7ff4b80c58e0 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.048+0000 7ff4be600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b8156200 con 0x7ff4b81529c0 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.048+0000 7ff4be600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80c8fa0 con 0x7ff4b8155df0 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4bd200700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ff4b80c58e0 0x7ff4b80c9ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48524/0 (socket says 172.21.15.47:48524) 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4bd200700 1 -- 172.21.15.47:0/1573420849 learned_addr learned my addr 172.21.15.47:0/1573420849 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7e00700 1 --2- 172.21.15.47:0/1573420849 >> v2:172.21.15.117:3300/0 conn(0x7ff4b81529c0 0x7ff4b81558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4bdc00700 1 --2- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b80af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7400700 1 -- 172.21.15.47:0/1573420849 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3572362032 0 0) 0x7ff4b80c8740 con 0x7ff4b80c58e0 2024-05-10T04:51:54.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7400700 1 -- 172.21.15.47:0/1573420849 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a00035b0 con 0x7ff4b80c58e0 2024-05-10T04:51:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7e00700 1 -- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 msgr2=0x7ff4b80af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7e00700 1 --2- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b80af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7e00700 1 -- 172.21.15.47:0/1573420849 >> v1:172.21.15.47:6789/0 conn(0x7ff4b80c58e0 legacy=0x7ff4b80c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:54.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.049+0000 7ff4b7e00700 1 -- 172.21.15.47:0/1573420849 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80c9280 con 0x7ff4b81529c0 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.050+0000 7ff4b7e00700 1 --2- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 0x7ff4b81558b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009840 tx=0x7ff4a4009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=abfeb6738f009580 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.050+0000 7ff4b7400700 1 -- 172.21.15.47:0/1573420849 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011830 con 0x7ff4b81529c0 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.050+0000 7ff4b7400700 1 -- 172.21.15.47:0/1573420849 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4011990 con 0x7ff4b81529c0 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.050+0000 7ff4b7400700 1 -- 172.21.15.47:0/1573420849 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011d00 con 0x7ff4b81529c0 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 -- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 msgr2=0x7ff4b81558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 --2- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 0x7ff4b81558b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4009840 tx=0x7ff4a4009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 -- 172.21.15.47:0/1573420849 shutdown_connections 2024-05-10T04:51:54.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 --2- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b80af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:54.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 --2- 172.21.15.47:0/1573420849 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 0x7ff4b81558b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:54.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 -- 172.21.15.47:0/1573420849 >> 172.21.15.47:0/1573420849 conn(0x7ff4b80ac700 msgr2=0x7ff4b80acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:54.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 -- 172.21.15.47:0/1573420849 shutdown_connections 2024-05-10T04:51:54.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.051+0000 7ff4be600700 1 -- 172.21.15.47:0/1573420849 wait complete. 2024-05-10T04:51:54.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.053+0000 7ff4be600700 1 Processor -- start 2024-05-10T04:51:54.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.053+0000 7ff4be600700 1 -- start start 2024-05-10T04:51:54.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4be600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 0x7ff4b81dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:54.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4be600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 0x7ff4b81de880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4be600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4be600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81e1b50 con 0x7ff4b80c58e0 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4be600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8157af0 con 0x7ff4b81529c0 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4be600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8157790 con 0x7ff4b8155df0 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 0x7ff4b81dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 0x7ff4b81dfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34936/0 (socket says 172.21.15.47:34936) 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 -- 172.21.15.47:0/98391434 learned_addr learned my addr 172.21.15.47:0/98391434 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 -- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 msgr2=0x7ff4b814b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 -- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 msgr2=0x7ff4b81de880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 0x7ff4b81de880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:54.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.055+0000 7ff4bd200700 1 -- 172.21.15.47:0/98391434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a40094a0 con 0x7ff4b80c58e0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.056+0000 7ff4bd200700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 0x7ff4b81dfa10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c430 tx=0x7ff4ac00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.056+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac005d70 con 0x7ff4b80c58e0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.056+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0070d0 con 0x7ff4b80c58e0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.056+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b8157d40 con 0x7ff4b80c58e0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.056+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac007480 con 0x7ff4b80c58e0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.056+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b81df610 con 0x7ff4b80c58e0 2024-05-10T04:51:54.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.057+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b80c5e70 con 0x7ff4b80c58e0 2024-05-10T04:51:54.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.058+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4ac0075e0 con 0x7ff4b80c58e0 2024-05-10T04:51:54.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.059+0000 7ff4b4c00700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ff49806acc0 0x7ff49806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:54.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.059+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff4ac088ca0 con 0x7ff4b80c58e0 2024-05-10T04:51:54.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.060+0000 7ff4b7e00700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ff49806acc0 0x7ff49806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:54.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.060+0000 7ff4b7e00700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ff49806acc0 0x7ff49806d1d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4b806bc70 tx=0x7ff4a4010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:54.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.064+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ff4ac053d80 con 0x7ff4b80c58e0 2024-05-10T04:51:54.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:54.283+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff4b8074720 con 0x7ff4b80c58e0 2024-05-10T04:51:56.047 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-05-10T04:51:56.045+0000 7f7224400700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-10T04:51:56.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.136+0000 7ff4b4c00700 1 -- 172.21.15.47:0/98391434 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff4ac017020 con 0x7ff4b80c58e0 2024-05-10T04:51:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.142+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ff49806acc0 msgr2=0x7ff49806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.142+0000 7ff4be600700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ff49806acc0 0x7ff49806d1d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4b806bc70 tx=0x7ff4a4010000 comp rx=0 tx=0).stop 2024-05-10T04:51:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.142+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 msgr2=0x7ff4b81dfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.142+0000 7ff4be600700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 0x7ff4b81dfa10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c430 tx=0x7ff4ac00c7f0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.144+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 shutdown_connections 2024-05-10T04:51:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.144+0000 7ff4be600700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ff49806acc0 0x7ff49806d1d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.144+0000 7ff4be600700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ff4b8155df0 0x7ff4b814b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.144+0000 7ff4be600700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ff4b80c58e0 0x7ff4b81dfa10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.144+0000 7ff4be600700 1 --2- 172.21.15.47:0/98391434 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ff4b81529c0 0x7ff4b81de880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.144+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 >> 172.21.15.47:0/98391434 conn(0x7ff4b80ac700 msgr2=0x7ff4b80c9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:56.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.146+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 shutdown_connections 2024-05-10T04:51:56.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.146+0000 7ff4be600700 1 -- 172.21.15.47:0/98391434 wait complete. 2024-05-10T04:51:56.153 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' created 2024-05-10T04:51:56.181 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-10T04:51:56.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.455+0000 7fd032600700 1 Processor -- start 2024-05-10T04:51:56.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.455+0000 7fd032600700 1 -- start start 2024-05-10T04:51:56.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.457+0000 7fd032600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.457+0000 7fd032600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd02c0ca8e0 0x7fd02c0cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.457+0000 7fd032600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd02c0c62b0 con 0x7fd02c0c3780 2024-05-10T04:51:56.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.457+0000 7fd032600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd02c1563a0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.457+0000 7fd032600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0c56a0 con 0x7fd02c152bc0 2024-05-10T04:51:56.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd023e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd02c0ca8e0 0x7fd02c0cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd02b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd02be00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd02c0c3780 0x7fd02c0c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:51122/0 (socket says 172.21.15.47:51122) 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd02be00700 1 -- 172.21.15.47:0/4104593389 learned_addr learned my addr 172.21.15.47:0/4104593389 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd02b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:60640/0 (socket says 172.21.15.47:60640) 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd023e00700 1 -- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 msgr2=0x7fd02c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd023e00700 1 --2- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd023e00700 1 -- 172.21.15.47:0/4104593389 >> v1:172.21.15.117:6789/0 conn(0x7fd02c0c3780 legacy=0x7fd02c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd023e00700 1 -- 172.21.15.47:0/4104593389 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd02c0c5980 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd02b400700 1 --2- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.458+0000 7fd023e00700 1 --2- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0cacf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd014009840 tx=0x7fd014009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8b971d04adb6271 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd02aa00700 1 -- 172.21.15.47:0/4104593389 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014011830 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd02aa00700 1 -- 172.21.15.47:0/4104593389 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd014011990 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd02aa00700 1 -- 172.21.15.47:0/4104593389 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014011d20 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd032600700 1 -- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0ca8e0 msgr2=0x7fd02c0cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd032600700 1 --2- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0cacf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd014009840 tx=0x7fd014009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:56.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd032600700 1 -- 172.21.15.47:0/4104593389 shutdown_connections 2024-05-10T04:51:56.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd032600700 1 --2- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd032600700 1 --2- 172.21.15.47:0/4104593389 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0cacf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.459+0000 7fd032600700 1 -- 172.21.15.47:0/4104593389 >> 172.21.15.47:0/4104593389 conn(0x7fd02c0c7610 msgr2=0x7fd02c0c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:56.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.460+0000 7fd032600700 1 -- 172.21.15.47:0/4104593389 shutdown_connections 2024-05-10T04:51:56.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.460+0000 7fd032600700 1 -- 172.21.15.47:0/4104593389 wait complete. 2024-05-10T04:51:56.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.462+0000 7fd032600700 1 Processor -- start 2024-05-10T04:51:56.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.462+0000 7fd032600700 1 -- start start 2024-05-10T04:51:56.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd032600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0c3780 0x7fd02c1eea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd032600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd032600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c1edca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd032600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c155d10 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd032600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c0c06b0 con 0x7fd02c0c3780 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd032600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c1ec730 con 0x7fd02c152bc0 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.463+0000 7fd023e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34938/0 (socket says 172.21.15.47:34938) 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 -- 172.21.15.47:0/3063845647 learned_addr learned my addr 172.21.15.47:0/3063845647 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd02be00700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c1edca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd02b400700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0c3780 0x7fd02c1eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 -- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 msgr2=0x7fd02c1edca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c1edca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 -- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0c3780 msgr2=0x7fd02c1eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:56.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0c3780 0x7fd02c1eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:56.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 -- 172.21.15.47:0/3063845647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0094a0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.464+0000 7fd023e00700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0c0b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0140090b0 tx=0x7fd014004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:56.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.465+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0140036a0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.465+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01401e070 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.465+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014003a80 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.465+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0140094a0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.465+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c1ec8d0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.466+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c1ef2d0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.467+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd014003be0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.468+0000 7fd023400700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd00806ac90 0x7fd00806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:56.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.469+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fd01408a5d0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.469+0000 7fd02b400700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd00806ac90 0x7fd00806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:56.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.469+0000 7fd02b400700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd00806ac90 0x7fd00806d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0cb3f0 tx=0x7fd01c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:56.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.474+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd0140554d0 con 0x7fd02c0ca8e0 2024-05-10T04:51:56.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:56.688+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fd02c0c0950 con 0x7fd02c0ca8e0 2024-05-10T04:51:57.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.138+0000 7fd023400700 1 -- 172.21.15.47:0/3063845647 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd014058af0 con 0x7fd02c0ca8e0 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd00806ac90 msgr2=0x7fd00806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd00806ac90 0x7fd00806d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd02c0cb3f0 tx=0x7fd01c009210 comp rx=0 tx=0).stop 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 msgr2=0x7fd02c0c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0c0b00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0140090b0 tx=0x7fd014004750 comp rx=0 tx=0).stop 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 shutdown_connections 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd00806ac90 0x7fd00806d1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd02c152bc0 0x7fd02c1edca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd02c0c3780 0x7fd02c1eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 --2- 172.21.15.47:0/3063845647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd02c0ca8e0 0x7fd02c0c0b00 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0140090b0 tx=0x7fd014004750 comp rx=0 tx=0).stop 2024-05-10T04:51:57.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.143+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 >> 172.21.15.47:0/3063845647 conn(0x7fd02c0c7610 msgr2=0x7fd02c0c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:57.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.145+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 shutdown_connections 2024-05-10T04:51:57.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.149+0000 7fd032600700 1 -- 172.21.15.47:0/3063845647 wait complete. 2024-05-10T04:51:57.159 INFO:teuthology.orchestra.run.smithi047.stderr:set pool 4 allow_ec_overwrites to true 2024-05-10T04:51:57.204 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-10T04:51:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.482+0000 7f5f83e00700 1 Processor -- start 2024-05-10T04:51:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.482+0000 7f5f83e00700 1 -- start start 2024-05-10T04:51:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5f840c59a0 0x7f5f84152980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840ca120 0x7f5f840c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f84155da0 con 0x7f5f840c9030 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f84159080 con 0x7f5f840c59a0 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f841562d0 con 0x7f5f840ca120 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5f840c9030 0x7f5f840c70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48532/0 (socket says 172.21.15.47:48532) 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f83400700 1 -- 172.21.15.47:0/957043751 learned_addr learned my addr 172.21.15.47:0/957043751 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f7be00700 1 --2- 172.21.15.47:0/957043751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840ca120 0x7f5f840c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f82a00700 1 --2- 172.21.15.47:0/957043751 >> v2:172.21.15.117:3300/0 conn(0x7f5f840c59a0 0x7f5f84152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.484+0000 7f5f82000700 1 -- 172.21.15.47:0/957043751 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127808202 0 0) 0x7f5f84155da0 con 0x7f5f840c9030 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f82000700 1 -- 172.21.15.47:0/957043751 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f680035b0 con 0x7f5f840c9030 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f7be00700 1 -- 172.21.15.47:0/957043751 >> v2:172.21.15.117:3300/0 conn(0x7f5f840c59a0 msgr2=0x7f5f84152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f7be00700 1 --2- 172.21.15.47:0/957043751 >> v2:172.21.15.117:3300/0 conn(0x7f5f840c59a0 0x7f5f84152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f7be00700 1 -- 172.21.15.47:0/957043751 >> v1:172.21.15.47:6789/0 conn(0x7f5f840c9030 legacy=0x7f5f840c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f7be00700 1 -- 172.21.15.47:0/957043751 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f840c6cc0 con 0x7f5f840ca120 2024-05-10T04:51:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f7be00700 1 --2- 172.21.15.47:0/957043751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840ca120 0x7f5f840c8af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009840 tx=0x7f5f6c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e359a67f1820d90d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.485+0000 7f5f82000700 1 -- 172.21.15.47:0/957043751 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c011830 con 0x7f5f840ca120 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f82000700 1 -- 172.21.15.47:0/957043751 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c011990 con 0x7f5f840ca120 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f82000700 1 -- 172.21.15.47:0/957043751 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c011d00 con 0x7f5f840ca120 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 -- 172.21.15.47:0/957043751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840ca120 msgr2=0x7f5f840c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 --2- 172.21.15.47:0/957043751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840ca120 0x7f5f840c8af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009840 tx=0x7f5f6c009b50 comp rx=0 tx=0).stop 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 -- 172.21.15.47:0/957043751 shutdown_connections 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 --2- 172.21.15.47:0/957043751 >> v2:172.21.15.117:3300/0 conn(0x7f5f840c59a0 0x7f5f84152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 --2- 172.21.15.47:0/957043751 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840ca120 0x7f5f840c8af0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 -- 172.21.15.47:0/957043751 >> 172.21.15.47:0/957043751 conn(0x7f5f840ac320 msgr2=0x7f5f840ac730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 -- 172.21.15.47:0/957043751 shutdown_connections 2024-05-10T04:51:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.486+0000 7f5f83e00700 1 -- 172.21.15.47:0/957043751 wait complete. 2024-05-10T04:51:57.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.488+0000 7f5f83e00700 1 Processor -- start 2024-05-10T04:51:57.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.489+0000 7f5f83e00700 1 -- start start 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 0x7f5f840bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840c9030 0x7f5f84150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f840ca120 0x7f5f840beac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840c03f0 con 0x7f5f840c59a0 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840bf7e0 con 0x7f5f840ca120 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f840c0600 con 0x7f5f840c9030 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f82a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 0x7f5f840bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f82a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 0x7f5f840bfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34952/0 (socket says 172.21.15.47:34952) 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f82a00700 1 -- 172.21.15.47:0/2305308306 learned_addr learned my addr 172.21.15.47:0/2305308306 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f7be00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840c9030 0x7f5f84150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.490+0000 7f5f83400700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f840ca120 0x7f5f840beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f82a00700 1 -- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840c9030 msgr2=0x7f5f84150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f82a00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840c9030 0x7f5f84150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f82a00700 1 -- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f840ca120 msgr2=0x7f5f840beac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f82a00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f840ca120 0x7f5f840beac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f82a00700 1 -- 172.21.15.47:0/2305308306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0094a0 con 0x7f5f840c59a0 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f83400700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f840ca120 0x7f5f840beac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f82a00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 0x7f5f840bfeb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400e870 tx=0x7f5f7400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74009590 con 0x7f5f840c59a0 2024-05-10T04:51:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f74013680 con 0x7f5f840c59a0 2024-05-10T04:51:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f841eef70 con 0x7f5f840c59a0 2024-05-10T04:51:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f74013a10 con 0x7f5f840c59a0 2024-05-10T04:51:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.491+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f841ee640 con 0x7f5f840c59a0 2024-05-10T04:51:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.492+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f84074720 con 0x7f5f840c59a0 2024-05-10T04:51:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.493+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f74013b70 con 0x7f5f840c59a0 2024-05-10T04:51:57.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.494+0000 7f5f7aa00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5f6006ac90 0x7f5f6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:57.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.494+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f5f74089910 con 0x7f5f840c59a0 2024-05-10T04:51:57.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.495+0000 7f5f7be00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5f6006ac90 0x7f5f6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:57.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.495+0000 7f5f7be00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5f6006ac90 0x7f5f6006d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009840 tx=0x7f5f6c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:57.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.499+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5f74054780 con 0x7f5f840c59a0 2024-05-10T04:51:57.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.764+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f5f840c5570 con 0x7f5f840c59a0 2024-05-10T04:51:57.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.769+0000 7f5f7aa00700 1 -- 172.21.15.47:0/2305308306 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5f74057da0 con 0x7f5f840c59a0 2024-05-10T04:51:57.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5f6006ac90 msgr2=0x7f5f6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5f6006ac90 0x7f5f6006d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009840 tx=0x7f5f6c008030 comp rx=0 tx=0).stop 2024-05-10T04:51:57.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 msgr2=0x7f5f840bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:57.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 0x7f5f840bfeb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5f7400e870 tx=0x7f5f7400eb80 comp rx=0 tx=0).stop 2024-05-10T04:51:57.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 shutdown_connections 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5f840ca120 0x7f5f840beac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5f840c59a0 0x7f5f840bfeb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5f6006ac90 0x7f5f6006d1a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 --2- 172.21.15.47:0/2305308306 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5f840c9030 0x7f5f84150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 >> 172.21.15.47:0/2305308306 conn(0x7f5f840ac320 msgr2=0x7f5f840b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 shutdown_connections 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:57.772+0000 7f5f83e00700 1 -- 172.21.15.47:0/2305308306 wait complete. 2024-05-10T04:51:57.775 INFO:teuthology.orchestra.run.smithi047.stderr:added data pool 4 to fsmap 2024-05-10T04:51:57.799 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:58.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.065+0000 7f7f6ca00700 1 Processor -- start 2024-05-10T04:51:58.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.066+0000 7f7f6ca00700 1 -- start start 2024-05-10T04:51:58.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f6ca00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f7f680c5c40 0x7f7f680c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f6ca00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f680c9270 0x7f7f68158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f6ca00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f6806c7c0 con 0x7f7f68159050 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f6ca00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f6806d060 con 0x7f7f680c9270 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f6ca00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f68159890 con 0x7f7f680c5c40 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f5fe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f680c9270 0x7f7f68158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f5fe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7f680c9270 0x7f7f68158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34956/0 (socket says 172.21.15.47:34956) 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.067+0000 7f7f5fe00700 1 -- 172.21.15.47:0/2374264646 learned_addr learned my addr 172.21.15.47:0/2374264646 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f65e00700 1 --2- 172.21.15.47:0/2374264646 >> v2:172.21.15.117:3300/0 conn(0x7f7f680c5c40 0x7f7f680c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f5fe00700 1 -- 172.21.15.47:0/2374264646 >> v2:172.21.15.117:3300/0 conn(0x7f7f680c5c40 msgr2=0x7f7f680c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f5fe00700 1 --2- 172.21.15.47:0/2374264646 >> v2:172.21.15.117:3300/0 conn(0x7f7f680c5c40 0x7f7f680c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f5fe00700 1 -- 172.21.15.47:0/2374264646 >> v1:172.21.15.117:6789/0 conn(0x7f7f68159050 legacy=0x7f7f681555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f5fe00700 1 -- 172.21.15.47:0/2374264646 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6806ca10 con 0x7f7f680c9270 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f5fe00700 1 --2- 172.21.15.47:0/2374264646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f680c9270 0x7f7f68158b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f6806dc40 tx=0x7f7f50009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279523aa425cf90a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f65400700 1 -- 172.21.15.47:0/2374264646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000b870 con 0x7f7f680c9270 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f65400700 1 -- 172.21.15.47:0/2374264646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f5000b9d0 con 0x7f7f680c9270 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.068+0000 7f7f65400700 1 -- 172.21.15.47:0/2374264646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f5000bd60 con 0x7f7f680c9270 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 -- 172.21.15.47:0/2374264646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f680c9270 msgr2=0x7f7f68158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/2374264646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f680c9270 0x7f7f68158b10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f6806dc40 tx=0x7f7f50009bd0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 -- 172.21.15.47:0/2374264646 shutdown_connections 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/2374264646 >> v2:172.21.15.117:3300/0 conn(0x7f7f680c5c40 0x7f7f680c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/2374264646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f680c9270 0x7f7f68158b10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 -- 172.21.15.47:0/2374264646 >> 172.21.15.47:0/2374264646 conn(0x7f7f680ca940 msgr2=0x7f7f680cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 -- 172.21.15.47:0/2374264646 shutdown_connections 2024-05-10T04:51:58.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.069+0000 7f7f6ca00700 1 -- 172.21.15.47:0/2374264646 wait complete. 2024-05-10T04:51:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.072+0000 7f7f6ca00700 1 Processor -- start 2024-05-10T04:51:58.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.072+0000 7f7f6ca00700 1 -- start start 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f6ca00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f680c5c40 0x7f7f6814bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f6ca00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f680c9270 0x7f7f681582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f6ca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 0x7f7f68154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f6ca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f68155c00 con 0x7f7f68159050 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f6ca00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681557e0 con 0x7f7f680c9270 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f6ca00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f681534e0 con 0x7f7f680c5c40 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f66800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 0x7f7f68154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f66800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 0x7f7f68154ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34972/0 (socket says 172.21.15.47:34972) 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.073+0000 7f7f66800700 1 -- 172.21.15.47:0/4028809435 learned_addr learned my addr 172.21.15.47:0/4028809435 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f5fe00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f680c9270 0x7f7f681582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f65e00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f680c5c40 0x7f7f6814bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f66800700 1 -- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f680c5c40 msgr2=0x7f7f6814bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f66800700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f680c5c40 0x7f7f6814bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f66800700 1 -- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f680c9270 msgr2=0x7f7f681582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f66800700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f680c9270 0x7f7f681582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f66800700 1 -- 172.21.15.47:0/4028809435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f50009550 con 0x7f7f68159050 2024-05-10T04:51:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f65e00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f680c5c40 0x7f7f6814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f66800700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 0x7f7f68154ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000caf0 tx=0x7f7f6000ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60003c00 con 0x7f7f68159050 2024-05-10T04:51:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60003d60 con 0x7f7f68159050 2024-05-10T04:51:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.074+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000aae0 con 0x7f7f68159050 2024-05-10T04:51:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.075+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f68154630 con 0x7f7f68159050 2024-05-10T04:51:58.079 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.075+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f681ef990 con 0x7f7f68159050 2024-05-10T04:51:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.076+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f68074720 con 0x7f7f68159050 2024-05-10T04:51:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.077+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f6000ac40 con 0x7f7f68159050 2024-05-10T04:51:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.078+0000 7f7f5e000700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f4406ac90 0x7f7f4406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.078+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f600896b0 con 0x7f7f68159050 2024-05-10T04:51:58.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.078+0000 7f7f65e00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f4406ac90 0x7f7f4406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.079+0000 7f7f65e00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f4406ac90 0x7f7f4406d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f6806b850 tx=0x7f7f58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.082+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f60054500 con 0x7f7f68159050 2024-05-10T04:51:58.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.346+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f68153f70 con 0x7f7f68159050 2024-05-10T04:51:58.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.347+0000 7f7f5e000700 1 -- 172.21.15.47:0/4028809435 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f7f60057b20 con 0x7f7f68159050 2024-05-10T04:51:58.349 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:58.349 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:51:57.766497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-10T04:51:58.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.349+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f4406ac90 msgr2=0x7f7f4406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.349+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f4406ac90 0x7f7f4406d1a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7f6806b850 tx=0x7f7f58008040 comp rx=0 tx=0).stop 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.349+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 msgr2=0x7f7f68154ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.349+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 0x7f7f68154ac0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7f6000caf0 tx=0x7f7f6000ce00 comp rx=0 tx=0).stop 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 shutdown_connections 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7f68159050 0x7f7f68154ac0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f4406ac90 0x7f7f4406d1a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7f680c5c40 0x7f7f6814bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 --2- 172.21.15.47:0/4028809435 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7f680c9270 0x7f7f681582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 >> 172.21.15.47:0/4028809435 conn(0x7f7f680ca940 msgr2=0x7f7f68151cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 shutdown_connections 2024-05-10T04:51:58.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.350+0000 7f7f6ca00700 1 -- 172.21.15.47:0/4028809435 wait complete. 2024-05-10T04:51:58.353 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-05-10T04:51:58.380 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:58.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.647+0000 7f42abc00700 1 Processor -- start 2024-05-10T04:51:58.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.647+0000 7f42abc00700 1 -- start start 2024-05-10T04:51:58.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.648+0000 7f42abc00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42a41555c0 0x7f42a414f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42abc00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f42a406d1a0 0x7f42a40c3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42abc00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42a40c53b0 con 0x7f42a406cd90 2024-05-10T04:51:58.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42abc00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a414fb30 con 0x7f42a406d1a0 2024-05-10T04:51:58.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42abc00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42a40c5f30 con 0x7f42a41555c0 2024-05-10T04:51:58.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f42a406d1a0 0x7f42a40c3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f42a406d1a0 0x7f42a40c3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34984/0 (socket says 172.21.15.47:34984) 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 -- 172.21.15.47:0/1935167023 learned_addr learned my addr 172.21.15.47:0/1935167023 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f42a41555c0 0x7f42a414f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 -- 172.21.15.47:0/1935167023 >> v2:172.21.15.117:3300/0 conn(0x7f42a41555c0 msgr2=0x7f42a414f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 --2- 172.21.15.47:0/1935167023 >> v2:172.21.15.117:3300/0 conn(0x7f42a41555c0 0x7f42a414f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 -- 172.21.15.47:0/1935167023 >> v1:172.21.15.117:6789/0 conn(0x7f42a406cd90 legacy=0x7f42a40c3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.649+0000 7f42a9c00700 1 -- 172.21.15.47:0/1935167023 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40c63c0 con 0x7f42a406d1a0 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.650+0000 7f42a9c00700 1 --2- 172.21.15.47:0/1935167023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a406d1a0 0x7f42a40c3b70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42a40c8520 tx=0x7f429c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1252f9ffc220b45 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.650+0000 7f42a3400700 1 -- 172.21.15.47:0/1935167023 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00e070 con 0x7f42a406d1a0 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.650+0000 7f42a3400700 1 -- 172.21.15.47:0/1935167023 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c00b910 con 0x7f42a406d1a0 2024-05-10T04:51:58.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.650+0000 7f42a3400700 1 -- 172.21.15.47:0/1935167023 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c00bcc0 con 0x7f42a406d1a0 2024-05-10T04:51:58.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.650+0000 7f42abc00700 1 -- 172.21.15.47:0/1935167023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a406d1a0 msgr2=0x7f42a40c3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.650+0000 7f42abc00700 1 --2- 172.21.15.47:0/1935167023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a406d1a0 0x7f42a40c3b70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f42a40c8520 tx=0x7f429c00b330 comp rx=0 tx=0).stop 2024-05-10T04:51:58.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.651+0000 7f42abc00700 1 -- 172.21.15.47:0/1935167023 shutdown_connections 2024-05-10T04:51:58.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.651+0000 7f42abc00700 1 --2- 172.21.15.47:0/1935167023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a406d1a0 0x7f42a40c3b70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.651+0000 7f42abc00700 1 --2- 172.21.15.47:0/1935167023 >> v2:172.21.15.117:3300/0 conn(0x7f42a41555c0 0x7f42a414f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.651+0000 7f42abc00700 1 -- 172.21.15.47:0/1935167023 >> 172.21.15.47:0/1935167023 conn(0x7f42a40caa30 msgr2=0x7f42a40cae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:58.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.651+0000 7f42abc00700 1 -- 172.21.15.47:0/1935167023 shutdown_connections 2024-05-10T04:51:58.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.651+0000 7f42abc00700 1 -- 172.21.15.47:0/1935167023 wait complete. 2024-05-10T04:51:58.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.653+0000 7f42abc00700 1 Processor -- start 2024-05-10T04:51:58.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.653+0000 7f42abc00700 1 -- start start 2024-05-10T04:51:58.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.654+0000 7f42abc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42a406cd90 0x7f42a4157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.654+0000 7f42abc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a406d1a0 0x7f42a41eee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.654+0000 7f42abc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 0x7f42a41ef360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.654+0000 7f42abc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41ed110 con 0x7f42a41555c0 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.654+0000 7f42abc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a4148bb0 con 0x7f42a406d1a0 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.654+0000 7f42abc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a41efdd0 con 0x7f42a406cd90 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 0x7f42a41ef360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 0x7f42a41ef360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:34990/0 (socket says 172.21.15.47:34990) 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 -- 172.21.15.47:0/1392218620 learned_addr learned my addr 172.21.15.47:0/1392218620 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9200700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42a406cd90 0x7f42a4157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a3e00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a406d1a0 0x7f42a41eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 -- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42a406cd90 msgr2=0x7f42a4157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42a406cd90 0x7f42a4157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 -- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a406d1a0 msgr2=0x7f42a41eee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a406d1a0 0x7f42a41eee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 -- 172.21.15.47:0/1392218620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c009b30 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9200700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42a406cd90 0x7f42a4157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a3e00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a406d1a0 0x7f42a41eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a9c00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 0x7f42a41ef360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f429c012000 tx=0x7f429c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c0092e0 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f429c01b430 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.655+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a41575d0 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.656+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f429c01b7e0 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.656+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a41ef8a0 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.657+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a41eebc0 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.658+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f429c01b940 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.658+0000 7f42a0c00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f428406acc0 0x7f428406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.659+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f429c08a930 con 0x7f42a41555c0 2024-05-10T04:51:58.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.659+0000 7f42a9200700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f428406acc0 0x7f428406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:58.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.660+0000 7f42a9200700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f428406acc0 0x7f428406d1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42a4159c70 tx=0x7f4298008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:58.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.663+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f429c055780 con 0x7f42a41555c0 2024-05-10T04:51:58.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.882+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42a4074720 con 0x7f42a41555c0 2024-05-10T04:51:58.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.883+0000 7f42a0c00700 1 -- 172.21.15.47:0/1392218620 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f429c058da0 con 0x7f42a41555c0 2024-05-10T04:51:58.885 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:58.885 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f428406acc0 msgr2=0x7f428406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f428406acc0 0x7f428406d1d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f42a4159c70 tx=0x7f4298008040 comp rx=0 tx=0).stop 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 msgr2=0x7f42a41ef360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 0x7f42a41ef360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f429c012000 tx=0x7f429c004ad0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 shutdown_connections 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f42a41555c0 0x7f42a41ef360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f428406acc0 0x7f428406d1d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f42a406cd90 0x7f42a4157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 --2- 172.21.15.47:0/1392218620 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f42a406d1a0 0x7f42a41eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:58.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 >> 172.21.15.47:0/1392218620 conn(0x7f42a40caa30 msgr2=0x7f42a40c33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:58.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 shutdown_connections 2024-05-10T04:51:58.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:58.886+0000 7f42abc00700 1 -- 172.21.15.47:0/1392218620 wait complete. 2024-05-10T04:51:58.914 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:51:59.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.183+0000 7f8291e00700 1 Processor -- start 2024-05-10T04:51:59.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.183+0000 7f8291e00700 1 -- start start 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.184+0000 7f8291e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f828c0c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.184+0000 7f8291e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f828c159220 0x7f828c15fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.184+0000 7f8291e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828c06c7c0 con 0x7f828c0c9270 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.184+0000 7f8291e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f828c06d060 con 0x7f828c159220 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.184+0000 7f8291e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c159630 con 0x7f828c0c5c40 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f8283e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f828c0c9270 0x7f828c158b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48540/0 (socket says 172.21.15.47:48540) 2024-05-10T04:51:59.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f8283e00700 1 -- 172.21.15.47:0/3325321239 learned_addr learned my addr 172.21.15.47:0/3325321239 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:51:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828b400700 1 --2- 172.21.15.47:0/3325321239 >> v2:172.21.15.117:3300/0 conn(0x7f828c159220 0x7f828c15fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828aa00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f828c0c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1786265339 0 0) 0x7f828c06c7c0 con 0x7f828c0c9270 2024-05-10T04:51:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82700035b0 con 0x7f828c0c9270 2024-05-10T04:51:59.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 771819042 0 0) 0x7f82700035b0 con 0x7f828c0c9270 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 msgr2=0x7f828c0c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f828c0c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 >> v2:172.21.15.117:3300/0 conn(0x7f828c159220 msgr2=0x7f828c15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 --2- 172.21.15.47:0/3325321239 >> v2:172.21.15.117:3300/0 conn(0x7f828c159220 0x7f828c15fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c159890 con 0x7f828c0c9270 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f8274001670 con 0x7f828c0c9270 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 >> v1:172.21.15.47:6789/0 conn(0x7f828c0c9270 legacy=0x7f828c158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270003a00 0x7f8270003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.185+0000 7f828a000700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8270004850 0x7f8270004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828a000700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f82700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c06d060 con 0x7f8270003a00 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c159630 con 0x7f8270004850 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827000bb40 con 0x7f828c0c5c40 2024-05-10T04:51:59.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270003a00 0x7f8270003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f8283e00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8270004850 0x7f8270004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828b400700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f82700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 -- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 msgr2=0x7f82700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f82700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 -- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8270004850 msgr2=0x7f8270004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8270004850 0x7f8270004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 -- 172.21.15.47:0/3325321239 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82700035b0 con 0x7f8270003a00 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828b400700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f828c0c5c40 0x7f82700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.186+0000 7f828aa00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270003a00 0x7f8270003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f827c009b30 tx=0x7f8270005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e01225dc0eb7032 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00e6c0 con 0x7f8270003a00 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c00e820 con 0x7f8270003a00 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f828a000700 1 -- 172.21.15.47:0/3325321239 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c00eb90 con 0x7f8270003a00 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f8291e00700 1 -- 172.21.15.47:0/3325321239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270003a00 msgr2=0x7f8270003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f8291e00700 1 --2- 172.21.15.47:0/3325321239 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8270003a00 0x7f8270003e70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f827c009b30 tx=0x7f8270005880 comp rx=0 tx=0).stop 2024-05-10T04:51:59.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f828b400700 1 -- 172.21.15.47:0/3325321239 reap_dead start 2024-05-10T04:51:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f8291e00700 1 -- 172.21.15.47:0/3325321239 shutdown_connections 2024-05-10T04:51:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.187+0000 7f8291e00700 1 -- 172.21.15.47:0/3325321239 >> 172.21.15.47:0/3325321239 conn(0x7f828c0ca940 msgr2=0x7f828c0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.188+0000 7f8291e00700 1 -- 172.21.15.47:0/3325321239 shutdown_connections 2024-05-10T04:51:59.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.188+0000 7f8291e00700 1 -- 172.21.15.47:0/3325321239 wait complete. 2024-05-10T04:51:59.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.190+0000 7f8291e00700 1 Processor -- start 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.190+0000 7f8291e00700 1 -- start start 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.191+0000 7f8291e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8270003a00 0x7f828c1eb020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.191+0000 7f8291e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828c156240 0x7f828c157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.191+0000 7f8291e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 0x7f828c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.191+0000 7f8291e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1eb9e0 con 0x7f828c14db80 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.191+0000 7f8291e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f828c0bfc00 con 0x7f828c156240 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.191+0000 7f8291e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f828c1eb560 con 0x7f8270003a00 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 0x7f828c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 0x7f828c14cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35008/0 (socket says 172.21.15.47:35008) 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 -- 172.21.15.47:0/321268065 learned_addr learned my addr 172.21.15.47:0/321268065 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828aa00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8270003a00 0x7f828c1eb020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f8283e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828c156240 0x7f828c157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 -- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8270003a00 msgr2=0x7f828c1eb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8270003a00 0x7f828c1eb020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 -- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828c156240 msgr2=0x7f828c157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828c156240 0x7f828c157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 -- 172.21.15.47:0/321268065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f828c155a80 con 0x7f828c14db80 2024-05-10T04:51:59.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.192+0000 7f828b400700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 0x7f828c14cf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f828c0cb960 tx=0x7f82840114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.193+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828400e030 con 0x7f828c14db80 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.193+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8284011b70 con 0x7f828c14db80 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.193+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8284016470 con 0x7f828c14db80 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.193+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f828c0bfe50 con 0x7f828c14db80 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.193+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828c155d20 con 0x7f828c14db80 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.194+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f828c155eb0 con 0x7f828c14db80 2024-05-10T04:51:59.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.195+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82840165d0 con 0x7f828c14db80 2024-05-10T04:51:59.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.196+0000 7f8283400700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f826806ac90 0x7f826806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.196+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f828400f070 con 0x7f828c14db80 2024-05-10T04:51:59.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.196+0000 7f828aa00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f826806ac90 0x7f826806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.197+0000 7f828aa00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f826806ac90 0x7f826806d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c01f040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:59.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.201+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f828408be60 con 0x7f828c14db80 2024-05-10T04:51:59.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.420+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f828c074720 con 0x7f828c14db80 2024-05-10T04:51:59.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.421+0000 7f8283400700 1 -- 172.21.15.47:0/321268065 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f8284054a80 con 0x7f828c14db80 2024-05-10T04:51:59.423 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:51:59.424 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f826806ac90 msgr2=0x7f826806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f826806ac90 0x7f826806d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f827c000c00 tx=0x7f827c01f040 comp rx=0 tx=0).stop 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 msgr2=0x7f828c14cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 0x7f828c14cf30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f828c0cb960 tx=0x7f82840114b0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 shutdown_connections 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f828c14db80 0x7f828c14cf30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f826806ac90 0x7f826806d1a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8270003a00 0x7f828c1eb020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 --2- 172.21.15.47:0/321268065 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f828c156240 0x7f828c157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 >> 172.21.15.47:0/321268065 conn(0x7f828c0ca940 msgr2=0x7f828c0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 shutdown_connections 2024-05-10T04:51:59.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.424+0000 7f8291e00700 1 -- 172.21.15.47:0/321268065 wait complete. 2024-05-10T04:51:59.469 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:51:59.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.734+0000 7f4586e00700 1 Processor -- start 2024-05-10T04:51:59.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.734+0000 7f4586e00700 1 -- start start 2024-05-10T04:51:59.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4586e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f458006e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4586e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4580071f30 0x7f458014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4586e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4580072690 con 0x7f458014eaa0 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4586e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458014f3f0 con 0x7f4580071f30 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4586e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4580072970 con 0x7f4580152440 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4584e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4580071f30 0x7f458014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4584e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f4580071f30 0x7f458014eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35012/0 (socket says 172.21.15.47:35012) 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.736+0000 7f4584e00700 1 -- 172.21.15.47:0/1860458290 learned_addr learned my addr 172.21.15.47:0/1860458290 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f457fe00700 1 --2- 172.21.15.47:0/1860458290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f458006e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f4584e00700 1 -- 172.21.15.47:0/1860458290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 msgr2=0x7f458006e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f4584e00700 1 --2- 172.21.15.47:0/1860458290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f458006e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f4584e00700 1 -- 172.21.15.47:0/1860458290 >> v1:172.21.15.117:6789/0 conn(0x7f458014eaa0 legacy=0x7f4580071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f4584e00700 1 -- 172.21.15.47:0/1860458290 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4580070d40 con 0x7f4580071f30 2024-05-10T04:51:59.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f4584e00700 1 --2- 172.21.15.47:0/1860458290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4580071f30 0x7f458014eeb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4578009e50 tx=0x7f457800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96253d46755cade server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:59.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f457ea00700 1 -- 172.21.15.47:0/1860458290 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800e070 con 0x7f4580071f30 2024-05-10T04:51:59.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.737+0000 7f457ea00700 1 -- 172.21.15.47:0/1860458290 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457800b910 con 0x7f4580071f30 2024-05-10T04:51:59.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f457ea00700 1 -- 172.21.15.47:0/1860458290 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457800bcc0 con 0x7f4580071f30 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 -- 172.21.15.47:0/1860458290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4580071f30 msgr2=0x7f458014eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 --2- 172.21.15.47:0/1860458290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4580071f30 0x7f458014eeb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4578009e50 tx=0x7f457800b330 comp rx=0 tx=0).stop 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 -- 172.21.15.47:0/1860458290 shutdown_connections 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 --2- 172.21.15.47:0/1860458290 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f4580071f30 0x7f458014eeb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 --2- 172.21.15.47:0/1860458290 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f458006e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 -- 172.21.15.47:0/1860458290 >> 172.21.15.47:0/1860458290 conn(0x7f458006ae30 msgr2=0x7f458006b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 -- 172.21.15.47:0/1860458290 shutdown_connections 2024-05-10T04:51:59.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.738+0000 7f4586e00700 1 -- 172.21.15.47:0/1860458290 wait complete. 2024-05-10T04:51:59.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.741+0000 7f4586e00700 1 Processor -- start 2024-05-10T04:51:59.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.741+0000 7f4586e00700 1 -- start start 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f4586e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4580071f30 0x7f45800aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f4586e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 0x7f45800c4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f4586e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f4580150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f4586e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580151190 con 0x7f458014eaa0 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f4586e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4580151880 con 0x7f4580071f30 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f4586e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800aa9f0 con 0x7f4580152440 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f457f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 0x7f45800c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f457f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 0x7f45800c4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35024/0 (socket says 172.21.15.47:35024) 2024-05-10T04:51:59.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.743+0000 7f457f400700 1 -- 172.21.15.47:0/335428368 learned_addr learned my addr 172.21.15.47:0/335428368 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457fe00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4580071f30 0x7f45800aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f4584e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f4580150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457f400700 1 -- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 msgr2=0x7f4580150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457f400700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f4580150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457f400700 1 -- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4580071f30 msgr2=0x7f45800aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457f400700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4580071f30 0x7f45800aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457f400700 1 -- 172.21.15.47:0/335428368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4578009b30 con 0x7f458014eaa0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457fe00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4580071f30 0x7f45800aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f457f400700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 0x7f45800c4100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f456c00c480 tx=0x7f456c00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0052d0 con 0x7f458014eaa0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456c005430 con 0x7f458014eaa0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4580150320 con 0x7f458014eaa0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.744+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456c0038c0 con 0x7f458014eaa0 2024-05-10T04:51:59.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.745+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45800c4640 con 0x7f458014eaa0 2024-05-10T04:51:59.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.746+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4580150100 con 0x7f458014eaa0 2024-05-10T04:51:59.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.747+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f456c003a20 con 0x7f458014eaa0 2024-05-10T04:51:59.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.747+0000 7f4577e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f456006ac90 0x7f456006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:51:59.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.748+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f456c088b00 con 0x7f458014eaa0 2024-05-10T04:51:59.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.748+0000 7f457fe00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f456006ac90 0x7f456006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:51:59.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.749+0000 7f457fe00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f456006ac90 0x7f456006d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45800aa130 tx=0x7f4570008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:51:59.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:51:59.752+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f456c08ae60 con 0x7f458014eaa0 2024-05-10T04:52:00.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.012+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4580074720 con 0x7f458014eaa0 2024-05-10T04:52:00.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.012+0000 7f4577e00700 1 -- 172.21.15.47:0/335428368 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f456c017090 con 0x7f458014eaa0 2024-05-10T04:52:00.014 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:00.014 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:51:57.766497+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f456006ac90 msgr2=0x7f456006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f456006ac90 0x7f456006d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f45800aa130 tx=0x7f4570008040 comp rx=0 tx=0).stop 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 msgr2=0x7f45800c4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 0x7f45800c4100 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f456c00c480 tx=0x7f456c00c840 comp rx=0 tx=0).stop 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 shutdown_connections 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f456006ac90 0x7f456006d1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f4580152440 0x7f4580150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4580071f30 0x7f45800aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 --2- 172.21.15.47:0/335428368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f458014eaa0 0x7f45800c4100 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 >> 172.21.15.47:0/335428368 conn(0x7f458006ae30 msgr2=0x7f4580148340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:00.017 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 shutdown_connections 2024-05-10T04:52:00.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.015+0000 7f4586e00700 1 -- 172.21.15.47:0/335428368 wait complete. 2024-05-10T04:52:00.018 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 7 2024-05-10T04:52:00.044 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:00.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.314+0000 7ffa3ec00700 1 Processor -- start 2024-05-10T04:52:00.316 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.315+0000 7ffa3ec00700 1 -- start start 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa3ec00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa380c5c40 0x7ffa380c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa3ec00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7ffa38159220 0x7ffa3815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa3ec00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa3806c7c0 con 0x7ffa380c9270 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa3ec00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa3806d060 con 0x7ffa380c5c40 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa3ec00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa38159630 con 0x7ffa38159220 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa37e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa380c5c40 0x7ffa380c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa37400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7ffa380c9270 0x7ffa38158b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:48542/0 (socket says 172.21.15.47:48542) 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.316+0000 7ffa37e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7ffa380c5c40 0x7ffa380c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35030/0 (socket says 172.21.15.47:35030) 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa37400700 1 -- 172.21.15.47:0/3143929457 learned_addr learned my addr 172.21.15.47:0/3143929457 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa3cc00700 1 --2- 172.21.15.47:0/3143929457 >> v2:172.21.15.117:3300/0 conn(0x7ffa38159220 0x7ffa3815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa37e00700 1 -- 172.21.15.47:0/3143929457 >> v2:172.21.15.117:3300/0 conn(0x7ffa38159220 msgr2=0x7ffa3815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa37e00700 1 --2- 172.21.15.47:0/3143929457 >> v2:172.21.15.117:3300/0 conn(0x7ffa38159220 0x7ffa3815fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.319 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa37e00700 1 -- 172.21.15.47:0/3143929457 >> v1:172.21.15.47:6789/0 conn(0x7ffa380c9270 legacy=0x7ffa38158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa37e00700 1 -- 172.21.15.47:0/3143929457 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa38159890 con 0x7ffa380c5c40 2024-05-10T04:52:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa3cc00700 1 --2- 172.21.15.47:0/3143929457 >> v2:172.21.15.117:3300/0 conn(0x7ffa38159220 0x7ffa3815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:00.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.317+0000 7ffa37e00700 1 --2- 172.21.15.47:0/3143929457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa380c5c40 0x7ffa380c8d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa381566b0 tx=0x7ffa28009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2926edf3d1051065 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa36a00700 1 -- 172.21.15.47:0/3143929457 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28011830 con 0x7ffa380c5c40 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa36a00700 1 -- 172.21.15.47:0/3143929457 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa28011990 con 0x7ffa380c5c40 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa36a00700 1 -- 172.21.15.47:0/3143929457 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa28011d20 con 0x7ffa380c5c40 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 -- 172.21.15.47:0/3143929457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa380c5c40 msgr2=0x7ffa380c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/3143929457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa380c5c40 0x7ffa380c8d30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffa381566b0 tx=0x7ffa28009b20 comp rx=0 tx=0).stop 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 -- 172.21.15.47:0/3143929457 shutdown_connections 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/3143929457 >> v2:172.21.15.117:3300/0 conn(0x7ffa38159220 0x7ffa3815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/3143929457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa380c5c40 0x7ffa380c8d30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 -- 172.21.15.47:0/3143929457 >> 172.21.15.47:0/3143929457 conn(0x7ffa380ca940 msgr2=0x7ffa380cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 -- 172.21.15.47:0/3143929457 shutdown_connections 2024-05-10T04:52:00.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.318+0000 7ffa3ec00700 1 -- 172.21.15.47:0/3143929457 wait complete. 2024-05-10T04:52:00.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.321+0000 7ffa3ec00700 1 Processor -- start 2024-05-10T04:52:00.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.321+0000 7ffa3ec00700 1 -- start start 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3ec00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa380c5c40 0x7ffa380af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3ec00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa380c9270 0x7ffa381ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3ec00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 0x7ffa381e2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3ec00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa38154680 con 0x7ffa38159220 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3ec00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380c30d0 con 0x7ffa380c9270 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3ec00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa380c1ec0 con 0x7ffa380c5c40 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 0x7ffa381e2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 0x7ffa381e2030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35038/0 (socket says 172.21.15.47:35038) 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa3cc00700 1 -- 172.21.15.47:0/2106383031 learned_addr learned my addr 172.21.15.47:0/2106383031 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa37e00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa380c5c40 0x7ffa380af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.323+0000 7ffa37400700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa380c9270 0x7ffa381ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3cc00700 1 -- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa380c5c40 msgr2=0x7ffa380af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3cc00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa380c5c40 0x7ffa380af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3cc00700 1 -- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa380c9270 msgr2=0x7ffa381ebe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3cc00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa380c9270 0x7ffa381ebe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3cc00700 1 -- 172.21.15.47:0/2106383031 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280094a0 con 0x7ffa38159220 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3cc00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 0x7ffa381e2030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000cd20 tx=0x7ffa3000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000ce70 con 0x7ffa38159220 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa3000f480 con 0x7ffa38159220 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa3000f850 con 0x7ffa38159220 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa380c3240 con 0x7ffa38159220 2024-05-10T04:52:00.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.324+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa381eb9c0 con 0x7ffa38159220 2024-05-10T04:52:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.325+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa380aa3d0 con 0x7ffa38159220 2024-05-10T04:52:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.326+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa3000b040 con 0x7ffa38159220 2024-05-10T04:52:00.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.327+0000 7ffa2fe00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ffa1806ac90 0x7ffa1806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:00.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.327+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffa30089c70 con 0x7ffa38159220 2024-05-10T04:52:00.329 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.328+0000 7ffa37e00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ffa1806ac90 0x7ffa1806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:00.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.329+0000 7ffa37e00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ffa1806ac90 0x7ffa1806d1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa381566b0 tx=0x7ffa28008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:00.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.332+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7ffa30054b50 con 0x7ffa38159220 2024-05-10T04:52:00.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.545+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa380cb670 con 0x7ffa38159220 2024-05-10T04:52:00.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.547+0000 7ffa2fe00700 1 -- 172.21.15.47:0/2106383031 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7ffa3001d020 con 0x7ffa38159220 2024-05-10T04:52:00.549 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:00.549 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ffa1806ac90 msgr2=0x7ffa1806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ffa1806ac90 0x7ffa1806d1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa381566b0 tx=0x7ffa28008030 comp rx=0 tx=0).stop 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 msgr2=0x7ffa381e2030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 0x7ffa381e2030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa3000cd20 tx=0x7ffa3000a560 comp rx=0 tx=0).stop 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 shutdown_connections 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7ffa38159220 0x7ffa381e2030 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7ffa1806ac90 0x7ffa1806d1a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7ffa380c5c40 0x7ffa380af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 --2- 172.21.15.47:0/2106383031 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7ffa380c9270 0x7ffa381ebe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 >> 172.21.15.47:0/2106383031 conn(0x7ffa380ca940 msgr2=0x7ffa3814eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:00.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 shutdown_connections 2024-05-10T04:52:00.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:00.549+0000 7ffa3ec00700 1 -- 172.21.15.47:0/2106383031 wait complete. 2024-05-10T04:52:00.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:51:52.718987+0000', 'modified': '2024-05-10T04:51:57.766497+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/2356260099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 2356260099}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 2356260099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2024-05-10T04:52:00.980 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:52:00.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T04:52:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.252+0000 7f0424600700 1 Processor -- start 2024-05-10T04:52:01.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.252+0000 7f0424600700 1 -- start start 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0424600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f041c06c4c0 0x7f041c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0424600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c06d640 con 0x7f041c0c6cc0 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0424600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f041c0c9800 con 0x7f041c152bb0 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0424600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f041c152fc0 con 0x7f041c06c4c0 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0421c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f041c0c6cc0 0x7f041c0c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57012/0 (socket says 172.21.15.47:57012) 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0421c00700 1 -- 172.21.15.47:0/2941426375 learned_addr learned my addr 172.21.15.47:0/2941426375 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:01.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f0422600700 1 --2- 172.21.15.47:0/2941426375 >> v2:172.21.15.117:3300/0 conn(0x7f041c06c4c0 0x7f041c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532518248 0 0) 0x7f041c06d640 con 0x7f041c0c6cc0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.254+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04040035b0 con 0x7f041c0c6cc0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1520885025 0 0) 0x7f04040035b0 con 0x7f041c0c6cc0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 >> v2:172.21.15.117:3300/0 conn(0x7f041c06c4c0 msgr2=0x7f041c0c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 --2- 172.21.15.47:0/2941426375 >> v2:172.21.15.117:3300/0 conn(0x7f041c06c4c0 0x7f041c0c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 >> v1:172.21.15.117:6789/0 conn(0x7f041c152bb0 legacy=0x7f041c06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c0c8910 con 0x7f041c0c6cc0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f0410001670 con 0x7f041c0c6cc0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 >> v1:172.21.15.47:6789/0 conn(0x7f041c0c6cc0 legacy=0x7f041c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0404003a00 0x7f0404003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0404004850 0x7f0404004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04040052c0 0x7f040400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c152fc0 con 0x7f04040052c0 2024-05-10T04:52:01.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f040400c250 con 0x7f0404004850 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040400c410 con 0x7f0404003a00 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f0422600700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04040052c0 0x7f040400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f0421c00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0404003a00 0x7f0404003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.255+0000 7f0421200700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0404004850 0x7f0404004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0421c00700 1 -- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0404004850 msgr2=0x7f0404004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0421c00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0404004850 0x7f0404004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0421c00700 1 -- 172.21.15.47:0/2941426375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04040052c0 msgr2=0x7f040400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0421c00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04040052c0 0x7f040400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0421c00700 1 -- 172.21.15.47:0/2941426375 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04040035b0 con 0x7f0404003a00 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0422600700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f04040052c0 0x7f040400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0422600700 1 -- 172.21.15.47:0/2941426375 reap_dead start 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f0421c00700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0404003a00 0x7f0404003e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f041000c240 tx=0x7f0404005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1dcac4655f4a383 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041000cd80 con 0x7f0404003a00 2024-05-10T04:52:01.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410005960 con 0x7f0404003a00 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.256+0000 7f041be00700 1 -- 172.21.15.47:0/2941426375 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410005d10 con 0x7f0404003a00 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 -- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0404003a00 msgr2=0x7f0404003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0404003a00 0x7f0404003e30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f041000c240 tx=0x7f0404005880 comp rx=0 tx=0).stop 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 -- 172.21.15.47:0/2941426375 shutdown_connections 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 --2- 172.21.15.47:0/2941426375 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0404003a00 0x7f0404003e30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 -- 172.21.15.47:0/2941426375 >> 172.21.15.47:0/2941426375 conn(0x7f041c0ca960 msgr2=0x7f041c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 -- 172.21.15.47:0/2941426375 shutdown_connections 2024-05-10T04:52:01.262 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.257+0000 7f0424600700 1 -- 172.21.15.47:0/2941426375 wait complete. 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.259+0000 7f0424600700 1 Processor -- start 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.259+0000 7f0424600700 1 -- start start 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0424600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 0x7f041c1e81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0424600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f041c0c1530 0x7f041c1ee900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0424600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f041c0c0060 0x7f041c155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0424600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0c35e0 con 0x7f0404003a00 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0424600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0c5080 con 0x7f041c0c1530 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0424600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041c0bf410 con 0x7f041c0c0060 2024-05-10T04:52:01.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 0x7f041c1e81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 0x7f041c1e81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55902/0 (socket says 172.21.15.47:55902) 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 -- 172.21.15.47:0/280613053 learned_addr learned my addr 172.21.15.47:0/280613053 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 -- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f041c0c0060 msgr2=0x7f041c155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0422600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f041c0c0060 0x7f041c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421200700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f041c0c1530 0x7f041c1ee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f041c0c0060 0x7f041c155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 -- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f041c0c1530 msgr2=0x7f041c1ee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f041c0c1530 0x7f041c1ee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421c00700 1 -- 172.21.15.47:0/280613053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f041c1eaff0 con 0x7f0404003a00 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0421200700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f041c0c1530 0x7f041c1ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:01.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.261+0000 7f0422600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f041c0c0060 0x7f041c155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.262+0000 7f0421c00700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 0x7f041c1e81a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0410005f50 tx=0x7f0410001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.262+0000 7f0419600700 1 -- 172.21.15.47:0/280613053 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410001780 con 0x7f0404003a00 2024-05-10T04:52:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.262+0000 7f0419600700 1 -- 172.21.15.47:0/280613053 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410004870 con 0x7f0404003a00 2024-05-10T04:52:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.262+0000 7f0419600700 1 -- 172.21.15.47:0/280613053 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410004c20 con 0x7f0404003a00 2024-05-10T04:52:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.262+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f041c0bf580 con 0x7f0404003a00 2024-05-10T04:52:01.267 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.262+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c1ee470 con 0x7f0404003a00 2024-05-10T04:52:01.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.264+0000 7f0419600700 1 -- 172.21.15.47:0/280613053 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0410005020 con 0x7f0404003a00 2024-05-10T04:52:01.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.265+0000 7f0419600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f03fc06ac90 0x7f03fc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.265+0000 7f0419600700 1 -- 172.21.15.47:0/280613053 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f041008a520 con 0x7f0404003a00 2024-05-10T04:52:01.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.266+0000 7f0421200700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f03fc06ac90 0x7f03fc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.268 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.266+0000 7f0421200700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f03fc06ac90 0x7f03fc06d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f041c1ebb00 tx=0x7f0408009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.267+0000 7f043c46bb80 1 Processor -- start 2024-05-10T04:52:01.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.268+0000 7f043c46bb80 1 -- start start 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f368bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f39c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f043c46bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f291250 con 0x56485f2305f0 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f28ea50 con 0x56485f39c850 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56485f28a340 con 0x56485f36b170 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f0421c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f368bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f0421c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f368bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55916/0 (socket says 172.21.15.47:55916) 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.269+0000 7f0421c00700 1 -- 172.21.15.47:0/2462007154 learned_addr learned my addr 172.21.15.47:0/2462007154 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421200700 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f39c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0422600700 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421c00700 1 -- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 msgr2=0x56485f39c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421c00700 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f39c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421c00700 1 -- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 msgr2=0x56485f387800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421c00700 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421c00700 1 -- 172.21.15.47:0/2462007154 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56485f07d790 con 0x56485f2305f0 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f0421c00700 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f368bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0410015040 tx=0x7f0410058b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=766f68243e8089c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f040e000700 1 -- 172.21.15.47:0/2462007154 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041005c070 con 0x56485f2305f0 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f040e000700 1 -- 172.21.15.47:0/2462007154 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041005cef0 con 0x56485f2305f0 2024-05-10T04:52:01.273 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.270+0000 7f040e000700 1 -- 172.21.15.47:0/2462007154 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04100614b0 con 0x56485f2305f0 2024-05-10T04:52:01.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 -- 172.21.15.47:0/2462007154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 msgr2=0x56485f368bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f368bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0410015040 tx=0x7f0410058b50 comp rx=0 tx=0).stop 2024-05-10T04:52:01.274 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 -- 172.21.15.47:0/2462007154 shutdown_connections 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f368bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 --2- 172.21.15.47:0/2462007154 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f39c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 -- 172.21.15.47:0/2462007154 >> 172.21.15.47:0/2462007154 conn(0x56485f2d4cf0 msgr2=0x56485f367bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 -- 172.21.15.47:0/2462007154 shutdown_connections 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.271+0000 7f043c46bb80 1 -- 172.21.15.47:0/2462007154 wait complete. 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.272+0000 7f043c46bb80 1 -- start start 2024-05-10T04:52:01.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.273+0000 7f043c46bb80 1 Processor -- start 2024-05-10T04:52:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3a6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f386220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f226490 con 0x56485f36b170 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f226130 con 0x56485f39c850 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56485f07e390 con 0x56485f2305f0 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f043c46bb80 10 client.0 _ll_register_callbacks cb 0x56485f0915a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f0421200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f386220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f0421200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f386220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55928/0 (socket says 172.21.15.47:55928) 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f0421200700 1 -- 172.21.15.47:0/1096434190 learned_addr learned my addr 172.21.15.47:0/1096434190 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f0421c00700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3a6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.275+0000 7f0422600700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0421200700 1 -- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 msgr2=0x56485f3a6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0421200700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3a6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0421200700 1 -- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 msgr2=0x56485f3a09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0421200700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3a09b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0421200700 1 -- 172.21.15.47:0/1096434190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f041c1ee470 con 0x56485f36b170 2024-05-10T04:52:01.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0422600700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0421200700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f386220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f041c0ca4a0 tx=0x7f0408007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1a45d0c7548c0e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0402a00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0402a00700 1 -- 172.21.15.47:0/1096434190 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408027070 con 0x56485f36b170 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0402a00700 1 -- 172.21.15.47:0/1096434190 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f040801c070 con 0x56485f36b170 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56485f35c630 con 0x56485f36b170 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f0402a00700 1 -- 172.21.15.47:0/1096434190 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0408014a70 con 0x56485f36b170 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f043c46bb80 10 client.4404 fetch_fsmap learned FSMap version 7 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.276+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56485f16a0a0 con 0x56485f36b170 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f0402a00700 1 -- 172.21.15.47:0/1096434190 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56485f35c630 con 0x56485f36b170 2024-05-10T04:52:01.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f0402a00700 1 -- 172.21.15.47:0/1096434190 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0408014bd0 con 0x56485f36b170 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f043c46bb80 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f043c46bb80 10 client.4404 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f043c46bb80 20 client.4404 populate_metadata read hostname 'smithi047' 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f39cc60 0x56485f39d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f043c46bb80 4 client.4404 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 --> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56485f0c3040 con 0x56485f39cc60 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.277+0000 7f0421c00700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f39cc60 0x56485f39d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.278+0000 7f0421c00700 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f39cc60 0x56485f39d070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74934ae511e89504 server_cookie=65298810fea3b7ed in_seq=0 out_seq=0 2024-05-10T04:52:01.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.278+0000 7f0402a00700 10 client.4404 ms_handle_connect on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:01.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.279+0000 7f0402a00700 1 -- 172.21.15.47:0/1096434190 <== mds.0 v2:172.21.15.117:6836/2356260099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56485f0c3040 con 0x56485f39cc60 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.279+0000 7f0402a00700 10 client.4404 handle_command_reply: tid=0 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 client.4404 shutdown 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 msgr2=0x56485f386220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f386220 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f041c0ca4a0 tx=0x7f0408007d30 comp rx=0 tx=0).stop 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 shutdown_connections 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f39cc60 0x56485f39d070 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3a09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3a6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f0402a00700 0 client.4404 ms_handle_reset on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:01.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1096434190 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f386220 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 >> 172.21.15.47:0/1096434190 conn(0x56485f2d4cf0 msgr2=0x56485f366530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 shutdown_connections 2024-05-10T04:52:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 1 -- 172.21.15.47:0/1096434190 wait complete. 2024-05-10T04:52:01.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.280+0000 7f043c46bb80 20 client.4404 trim_cache size 0 max 16384 2024-05-10T04:52:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.300+0000 7f043c46bb80 1 Processor -- start 2024-05-10T04:52:01.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.300+0000 7f043c46bb80 1 -- start start 2024-05-10T04:52:01.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f364ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f366650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f043c46bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f35ea30 con 0x56485f2305f0 2024-05-10T04:52:01.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f386de0 con 0x56485f39c850 2024-05-10T04:52:01.304 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56485f3a39f0 con 0x56485f36b170 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f0421c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f364ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f0421c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f364ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55938/0 (socket says 172.21.15.47:55938) 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.301+0000 7f0421c00700 1 -- 172.21.15.47:0/1909949701 learned_addr learned my addr 172.21.15.47:0/1909949701 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f0421c00700 1 -- 172.21.15.47:0/1909949701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 msgr2=0x56485f366650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f0421c00700 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f366650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f0421c00700 1 -- 172.21.15.47:0/1909949701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 msgr2=0x56485f3b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f0421c00700 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f0421c00700 1 -- 172.21.15.47:0/1909949701 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56485f3a3b90 con 0x56485f2305f0 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f0421c00700 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f364ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0410015040 tx=0x7f0410007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dcf1e643a6dadc9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f040ea00700 1 -- 172.21.15.47:0/1909949701 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041005c040 con 0x56485f2305f0 2024-05-10T04:52:01.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f040ea00700 1 -- 172.21.15.47:0/1909949701 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0410004d80 con 0x56485f2305f0 2024-05-10T04:52:01.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.302+0000 7f040ea00700 1 -- 172.21.15.47:0/1909949701 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041005f0c0 con 0x56485f2305f0 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 -- 172.21.15.47:0/1909949701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 msgr2=0x56485f364ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f364ee0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0410015040 tx=0x7f0410007040 comp rx=0 tx=0).stop 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 -- 172.21.15.47:0/1909949701 shutdown_connections 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f3b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f2305f0 0x56485f364ee0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1909949701 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f36b170 0x56485f366650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 -- 172.21.15.47:0/1909949701 >> 172.21.15.47:0/1909949701 conn(0x56485f2d4cf0 msgr2=0x56485f363e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 -- 172.21.15.47:0/1909949701 shutdown_connections 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.303+0000 7f043c46bb80 1 -- 172.21.15.47:0/1909949701 wait complete. 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.304+0000 7f043c46bb80 1 -- start start 2024-05-10T04:52:01.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.304+0000 7f043c46bb80 1 Processor -- start 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f39af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f388130 con 0x56485f36b170 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x56485f3b55a0 con 0x56485f39c850 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x56485f3b6190 con 0x56485f2305f0 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f043c46bb80 10 client.0 _ll_register_callbacks cb 0x7f04080053f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f39af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f39af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55950/0 (socket says 172.21.15.47:55950) 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 -- 172.21.15.47:0/1431900107 learned_addr learned my addr 172.21.15.47:0/1431900107 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 -- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 msgr2=0x56485f3bbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 -- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 msgr2=0x56485f387410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:01.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.306+0000 7f0421200700 1 -- 172.21.15.47:0/1431900107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56485f07d790 con 0x56485f36b170 2024-05-10T04:52:01.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0421200700 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f39af40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56485f3a6e90 tx=0x7f0408014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5495141cbc6404be server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.312 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0402a00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0402a00700 1 -- 172.21.15.47:0/1431900107 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0408027030 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0402a00700 1 -- 172.21.15.47:0/1431900107 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0408039dc0 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f041005cef0 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0402a00700 1 -- 172.21.15.47:0/1431900107 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04080146e0 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 10 client.4410 fetch_fsmap learned FSMap version 7 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x56485f250690 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0402a00700 1 -- 172.21.15.47:0/1431900107 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041005cef0 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f0402a00700 1 -- 172.21.15.47:0/1431900107 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0408001ac0 con 0x56485f36b170 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 10 client.4410 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 20 client.4410 populate_metadata read hostname 'smithi047' 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.307+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f40d4a0 0x56485f413020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.308+0000 7f043c46bb80 4 client.4410 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:52:01.313 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.308+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 --> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56485f0ff0c0 con 0x56485f40d4a0 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.308+0000 7f0421c00700 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f40d4a0 0x56485f413020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.308+0000 7f0421c00700 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f40d4a0 0x56485f413020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3c0c0e598abb88 server_cookie=ca02428c0cb8402b in_seq=0 out_seq=0 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.308+0000 7f0402a00700 10 client.4410 ms_handle_connect on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f0402a00700 1 -- 172.21.15.47:0/1431900107 <== mds.0 v2:172.21.15.117:6836/2356260099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x56485f0ff0c0 con 0x56485f40d4a0 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f0402a00700 10 client.4410 handle_command_reply: tid=0 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 client.4410 shutdown 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 msgr2=0x56485f39af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f39af40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56485f3a6e90 tx=0x7f0408014000 comp rx=0 tx=0).stop 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 shutdown_connections 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x56485f40d4a0 0x56485f413020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x56485f39c850 0x56485f387410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x56485f2305f0 0x56485f3bbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.314 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 --2- 172.21.15.47:0/1431900107 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x56485f36b170 0x56485f39af40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 >> 172.21.15.47:0/1431900107 conn(0x56485f2d4cf0 msgr2=0x56485f365670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f0402a00700 0 client.4410 ms_handle_reset on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 shutdown_connections 2024-05-10T04:52:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 1 -- 172.21.15.47:0/1431900107 wait complete. 2024-05-10T04:52:01.315 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.309+0000 7f043c46bb80 20 client.4410 trim_cache size 0 max 16384 2024-05-10T04:52:01.318 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T04:52:01.318 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "63debaa4-fa23-4f28-8f14-9786e692137f", 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4272, 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 8.5882025249999998, 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 7, 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 26, 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 25, 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 16.269220270999998 2024-05-10T04:52:01.319 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T04:52:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f03fc06ac90 msgr2=0x7f03fc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f03fc06ac90 0x7f03fc06d1a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f041c1ebb00 tx=0x7f0408009040 comp rx=0 tx=0).stop 2024-05-10T04:52:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 msgr2=0x7f041c1e81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 0x7f041c1e81a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0410005f50 tx=0x7f0410001980 comp rx=0 tx=0).stop 2024-05-10T04:52:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 shutdown_connections 2024-05-10T04:52:01.320 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f03fc06ac90 0x7f03fc06d1a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f041c0c0060 0x7f041c155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0404003a00 0x7f041c1e81a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 --2- 172.21.15.47:0/280613053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f041c0c1530 0x7f041c1ee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 >> 172.21.15.47:0/280613053 conn(0x7f041c0ca960 msgr2=0x7f041c151f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 shutdown_connections 2024-05-10T04:52:01.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.310+0000 7f0424600700 1 -- 172.21.15.47:0/280613053 wait complete. 2024-05-10T04:52:01.335 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:52:01.336 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:01.336 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:52:01.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.603+0000 7fe743800700 1 Processor -- start 2024-05-10T04:52:01.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.603+0000 7fe743800700 1 -- start start 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe743800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe73c0c9440 0x7fe73c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe743800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06c7c0 con 0x7fe73c0c5c40 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe743800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe73c06d060 con 0x7fe73c159050 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe743800700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe73c159890 con 0x7fe73c0c9440 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe740e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe73c0c5c40 0x7fe73c0c8d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57026/0 (socket says 172.21.15.47:57026) 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe740e00700 1 -- 172.21.15.47:0/13682308 learned_addr learned my addr 172.21.15.47:0/13682308 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe73be00700 1 --2- 172.21.15.47:0/13682308 >> v2:172.21.15.47:3300/0 conn(0x7fe73c0c9440 0x7fe73c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe73b400700 1 -- 172.21.15.47:0/13682308 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1228063737 0 0) 0x7fe73c06c7c0 con 0x7fe73c0c5c40 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe73b400700 1 -- 172.21.15.47:0/13682308 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7240035b0 con 0x7fe73c0c5c40 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe73be00700 1 -- 172.21.15.47:0/13682308 >> v1:172.21.15.117:6789/0 conn(0x7fe73c159050 legacy=0x7fe73c15fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.608 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe73be00700 1 -- 172.21.15.47:0/13682308 >> v1:172.21.15.47:6789/0 conn(0x7fe73c0c5c40 legacy=0x7fe73c0c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.605+0000 7fe73be00700 1 -- 172.21.15.47:0/13682308 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c06ca10 con 0x7fe73c0c9440 2024-05-10T04:52:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.606+0000 7fe73be00700 1 --2- 172.21.15.47:0/13682308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c9440 0x7fe73c158b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe728009840 tx=0x7fe728009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df2e1bd91baf24d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.606+0000 7fe73b400700 1 -- 172.21.15.47:0/13682308 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728011830 con 0x7fe73c0c9440 2024-05-10T04:52:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.606+0000 7fe73b400700 1 -- 172.21.15.47:0/13682308 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe728011990 con 0x7fe73c0c9440 2024-05-10T04:52:01.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.606+0000 7fe73b400700 1 -- 172.21.15.47:0/13682308 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe728011d20 con 0x7fe73c0c9440 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 -- 172.21.15.47:0/13682308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c9440 msgr2=0x7fe73c158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 --2- 172.21.15.47:0/13682308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c9440 0x7fe73c158b10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe728009840 tx=0x7fe728009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 -- 172.21.15.47:0/13682308 shutdown_connections 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 --2- 172.21.15.47:0/13682308 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c9440 0x7fe73c158b10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 -- 172.21.15.47:0/13682308 >> 172.21.15.47:0/13682308 conn(0x7fe73c0ca940 msgr2=0x7fe73c0cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 -- 172.21.15.47:0/13682308 shutdown_connections 2024-05-10T04:52:01.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.607+0000 7fe743800700 1 -- 172.21.15.47:0/13682308 wait complete. 2024-05-10T04:52:01.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.609+0000 7fe743800700 1 Processor -- start 2024-05-10T04:52:01.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.609+0000 7fe743800700 1 -- start start 2024-05-10T04:52:01.615 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe743800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 0x7fe73c1ee950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe743800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe73c0c9440 0x7fe73c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe743800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe73c159050 0x7fe73c14ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe743800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c152f90 con 0x7fe73c0c5c40 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe743800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c155030 con 0x7fe73c159050 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe743800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe73c153100 con 0x7fe73c0c9440 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 0x7fe73c1ee950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 0x7fe73c1ee950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55964/0 (socket says 172.21.15.47:55964) 2024-05-10T04:52:01.616 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 -- 172.21.15.47:0/2027791043 learned_addr learned my addr 172.21.15.47:0/2027791043 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe741800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe73c159050 0x7fe73c14ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe73be00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe73c0c9440 0x7fe73c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 -- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe73c0c9440 msgr2=0x7fe73c154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe73c0c9440 0x7fe73c154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 -- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe73c159050 msgr2=0x7fe73c14ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe73c159050 0x7fe73c14ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.611+0000 7fe740e00700 1 -- 172.21.15.47:0/2027791043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7280094a0 con 0x7fe73c0c5c40 2024-05-10T04:52:01.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.612+0000 7fe740e00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 0x7fe73c1ee950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe730001eb0 tx=0x7fe73000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.612+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe730005d70 con 0x7fe73c0c5c40 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.612+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000ce70 con 0x7fe73c0c5c40 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.612+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7300072d0 con 0x7fe73c0c5c40 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.612+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe73c1ef370 con 0x7fe73c0c5c40 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.612+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe73c153b10 con 0x7fe73c0c5c40 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.613+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe73c154160 con 0x7fe73c0c5c40 2024-05-10T04:52:01.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.614+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe730007430 con 0x7fe73c0c5c40 2024-05-10T04:52:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.615+0000 7fe738c00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe71c06ac90 0x7fe71c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:01.619 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.615+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe730088a00 con 0x7fe73c0c5c40 2024-05-10T04:52:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.615+0000 7fe73be00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe71c06ac90 0x7fe71c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:01.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.616+0000 7fe73be00700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe71c06ac90 0x7fe71c06d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe728009fd0 tx=0x7fe728008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:01.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.620+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe7300538e0 con 0x7fe73c0c5c40 2024-05-10T04:52:01.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.880+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe73c153960 con 0x7fe73c0c5c40 2024-05-10T04:52:01.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.880+0000 7fe738c00700 1 -- 172.21.15.47:0/2027791043 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe730017070 con 0x7fe73c0c5c40 2024-05-10T04:52:01.882 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T04:52:01.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe71c06ac90 msgr2=0x7fe71c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe71c06ac90 0x7fe71c06d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe728009fd0 tx=0x7fe728008030 comp rx=0 tx=0).stop 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 msgr2=0x7fe73c1ee950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 0x7fe73c1ee950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe730001eb0 tx=0x7fe73000c7b0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 shutdown_connections 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe73c159050 0x7fe73c14ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe73c0c5c40 0x7fe73c1ee950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe71c06ac90 0x7fe71c06d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 --2- 172.21.15.47:0/2027791043 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe73c0c9440 0x7fe73c154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 >> 172.21.15.47:0/2027791043 conn(0x7fe73c0ca940 msgr2=0x7fe73c06bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 shutdown_connections 2024-05-10T04:52:01.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:01.883+0000 7fe743800700 1 -- 172.21.15.47:0/2027791043 wait complete. 2024-05-10T04:52:01.911 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-10T04:52:01.911 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:52:01.912 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T04:52:01.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:01.913 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-10T04:52:01.958 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:52:01.958 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:52:01.958 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:52:01.958 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:01.959 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-10T04:52:01.959 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:01.959 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:01.959 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:01.959 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42496sec preferred_lft 42496sec 2024-05-10T04:52:01.960 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-05-10T04:52:01.961 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:01.961 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:01.961 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:01.961 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-10T04:52:01.962 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:52:01.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:01.962 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:01.962 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:01.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:52:01.962 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-10T04:52:01.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-10T04:52:01.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:52:01.963 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:02.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:02.437 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:52:02.548 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-10T04:52:02.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:02.555 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-10T04:52:02.614 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-10T04:52:02.615 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:52:02.615 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T04:52:02.615 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T04:52:02.615 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:52:02.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:02.616 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:02.616 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:02.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T04:52:02.616 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T04:52:02.617 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T04:52:02.617 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:03.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:03.291 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-10T04:52:03.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:03.337 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-10T04:52:03.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:03.422 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:03.422 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:03.422 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T04:52:03.422 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-10T04:52:03.422 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:03.599 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-10T04:52:03.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-10T04:52:03.600 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:03.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:03.916 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:03.916 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:03.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-10T04:52:03.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:52:03.916 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:04.084 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-10T04:52:04.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:52:04.084 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:04.128 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-10T04:52:04.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:52:04.128 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:04.212 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-10T04:52:04.319 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:52:04.319 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T04:52:04.384 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T04:52:04.386 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T04:52:04.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:04.391 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-10T04:52:04.435 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-10T04:52:04.435 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-10T04:52:04.479 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-10T04:52:04.549 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:52:04.549 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T04:52:04.616 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T04:52:04.619 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T04:52:04.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:04.620 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-10T04:52:04.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:2024-05-10T04:52:04.718+0000 7f32402bd5c0 -1 init, newargv = 0x5611b9804280 newargc=15 2024-05-10T04:52:04.720 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[49447]: starting ceph client 2024-05-10T04:52:04.731 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[49447]: starting fuse 2024-05-10T04:52:05.765 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-10T04:52:05.841 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:52:05.841 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T04:52:05.908 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T04:52:05.911 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T04:52:05.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:05.911 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-10T04:52:05.956 INFO:teuthology.orchestra.run.smithi047.stdout:45 2024-05-10T04:52:05.956 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-10T04:52:05.957 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.admin")) 2024-05-10T04:52:05.958 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-10T04:52:06.138 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.admin.49447.asok 2024-05-10T04:52:06.316 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.49447.asok 2024-05-10T04:52:06.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:06.316 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.49447.asok status 2024-05-10T04:52:06.613 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T04:52:06.613 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-10T04:52:06.613 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "50174015a7e79f951b988949abe236791f52d4da", 2024-05-10T04:52:06.613 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable)", 2024-05-10T04:52:06.613 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "admin", 2024-05-10T04:52:06.613 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "49447", 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4428, 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4428 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:06.614 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2948563711 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "172.21.15.47:0", 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 2948563711 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4428 172.21.15.47:0/2948563711", 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "172.21.15.47:0/2948563711", 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-10T04:52:06.615 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 7, 2024-05-10T04:52:06.616 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 26, 2024-05-10T04:52:06.616 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 0, 2024-05-10T04:52:06.616 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-10T04:52:06.616 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-10T04:52:06.616 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T04:52:06.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:06.634 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-10T04:52:06.634 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:06.679 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-10T04:52:06.679 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:06.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:06.679 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:06.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:06.788 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-10T04:52:06.925 INFO:teuthology.orchestra.run.smithi047.stdout:# file: . 2024-05-10T04:52:06.925 INFO:teuthology.orchestra.run.smithi047.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-10T04:52:06.925 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:06.926 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:52:06.926 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:06.971 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:07.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.278+0000 7f1abe200700 1 Processor -- start 2024-05-10T04:52:07.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.278+0000 7f1abe200700 1 -- start start 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1abe200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ab80c23b0 0x7f1ab8155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1abe200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1ab8155bb0 0x7f1ab8155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1abe200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab80c17d0 con 0x7f1ab8152d40 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1abe200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80c30c0 con 0x7f1ab80c23b0 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1abe200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab80726d0 con 0x7f1ab8155bb0 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1aafe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ab80c23b0 0x7f1ab8155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1aafe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1ab80c23b0 0x7f1ab8155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55966/0 (socket says 172.21.15.47:55966) 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.280+0000 7f1aafe00700 1 -- 172.21.15.47:0/2810979366 learned_addr learned my addr 172.21.15.47:0/2810979366 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:07.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1ab7e00700 1 --2- 172.21.15.47:0/2810979366 >> v2:172.21.15.117:3300/0 conn(0x7f1ab8155bb0 0x7f1ab8155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1aafe00700 1 -- 172.21.15.47:0/2810979366 >> v2:172.21.15.117:3300/0 conn(0x7f1ab8155bb0 msgr2=0x7f1ab8155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1aafe00700 1 --2- 172.21.15.47:0/2810979366 >> v2:172.21.15.117:3300/0 conn(0x7f1ab8155bb0 0x7f1ab8155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1aafe00700 1 -- 172.21.15.47:0/2810979366 >> v1:172.21.15.117:6789/0 conn(0x7f1ab8152d40 legacy=0x7f1ab806abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1aafe00700 1 -- 172.21.15.47:0/2810979366 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab80c1ab0 con 0x7f1ab80c23b0 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1aafe00700 1 --2- 172.21.15.47:0/2810979366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab80c23b0 0x7f1ab8155670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80c1210 tx=0x7f1aa0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16375e64c15ce9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1ab6a00700 1 -- 172.21.15.47:0/2810979366 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0004230 con 0x7f1ab80c23b0 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1ab6a00700 1 -- 172.21.15.47:0/2810979366 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0004390 con 0x7f1ab80c23b0 2024-05-10T04:52:07.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.281+0000 7f1ab6a00700 1 -- 172.21.15.47:0/2810979366 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa00036a0 con 0x7f1ab80c23b0 2024-05-10T04:52:07.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 -- 172.21.15.47:0/2810979366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab80c23b0 msgr2=0x7f1ab8155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 --2- 172.21.15.47:0/2810979366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab80c23b0 0x7f1ab8155670 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1ab80c1210 tx=0x7f1aa0009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 -- 172.21.15.47:0/2810979366 shutdown_connections 2024-05-10T04:52:07.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 --2- 172.21.15.47:0/2810979366 >> v2:172.21.15.117:3300/0 conn(0x7f1ab8155bb0 0x7f1ab8155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 --2- 172.21.15.47:0/2810979366 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab80c23b0 0x7f1ab8155670 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.285 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 -- 172.21.15.47:0/2810979366 >> 172.21.15.47:0/2810979366 conn(0x7f1ab80c4220 msgr2=0x7f1ab80c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 -- 172.21.15.47:0/2810979366 shutdown_connections 2024-05-10T04:52:07.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.282+0000 7f1abe200700 1 -- 172.21.15.47:0/2810979366 wait complete. 2024-05-10T04:52:07.286 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.284+0000 7f1abe200700 1 Processor -- start 2024-05-10T04:52:07.287 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.285+0000 7f1abe200700 1 -- start start 2024-05-10T04:52:07.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1abe200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab80c23b0 0x7f1ab80c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1abe200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab8152d40 0x7f1ab814d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1abe200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 0x7f1ab80c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1abe200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab814d900 con 0x7f1ab8155bb0 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1abe200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab81464f0 con 0x7f1ab80c23b0 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1abe200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab80c52f0 con 0x7f1ab8152d40 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1ab7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 0x7f1ab80c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1ab7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 0x7f1ab80c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55974/0 (socket says 172.21.15.47:55974) 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1ab7e00700 1 -- 172.21.15.47:0/468928157 learned_addr learned my addr 172.21.15.47:0/468928157 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1ab7400700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab80c23b0 0x7f1ab80c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.286+0000 7f1aafe00700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab8152d40 0x7f1ab814d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1ab7e00700 1 -- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab8152d40 msgr2=0x7f1ab814d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1ab7e00700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab8152d40 0x7f1ab814d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1ab7e00700 1 -- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab80c23b0 msgr2=0x7f1ab80c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1ab7e00700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab80c23b0 0x7f1ab80c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1ab7e00700 1 -- 172.21.15.47:0/468928157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0009550 con 0x7f1ab8155bb0 2024-05-10T04:52:07.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1ab7e00700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 0x7f1ab80c7890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0007d70 tx=0x7f1ab000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab000ecd0 con 0x7f1ab8155bb0 2024-05-10T04:52:07.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab000ee50 con 0x7f1ab8155bb0 2024-05-10T04:52:07.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab80c70e0 con 0x7f1ab8155bb0 2024-05-10T04:52:07.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.287+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0014660 con 0x7f1ab8155bb0 2024-05-10T04:52:07.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.288+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab81ebee0 con 0x7f1ab8155bb0 2024-05-10T04:52:07.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.289+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab8074720 con 0x7f1ab8155bb0 2024-05-10T04:52:07.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.290+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ab00147c0 con 0x7f1ab8155bb0 2024-05-10T04:52:07.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.291+0000 7f1aaf400700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1a9406ac90 0x7f1a9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.291+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ab0089c10 con 0x7f1ab8155bb0 2024-05-10T04:52:07.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.291+0000 7f1ab7400700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1a9406ac90 0x7f1a9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.292+0000 7f1ab7400700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1a9406ac90 0x7f1a9406d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8006fd0 tx=0x7f1aa80090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.296+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1ab0054a50 con 0x7f1ab8155bb0 2024-05-10T04:52:07.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.511+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ab81557a0 con 0x7f1ab8155bb0 2024-05-10T04:52:07.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.512+0000 7f1aaf400700 1 -- 172.21.15.47:0/468928157 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f1ab0058070 con 0x7f1ab8155bb0 2024-05-10T04:52:07.515 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:07.515 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1a9406ac90 msgr2=0x7f1a9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1a9406ac90 0x7f1a9406d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1aa8006fd0 tx=0x7f1aa80090e0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 msgr2=0x7f1ab80c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 0x7f1ab80c7890 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1ab0007d70 tx=0x7f1ab000e3c0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 shutdown_connections 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab8155bb0 0x7f1ab80c7890 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab80c23b0 0x7f1ab80c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1a9406ac90 0x7f1a9406d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 --2- 172.21.15.47:0/468928157 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1ab8152d40 0x7f1ab814d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 >> 172.21.15.47:0/468928157 conn(0x7f1ab80c4220 msgr2=0x7f1ab8154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 shutdown_connections 2024-05-10T04:52:07.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.515+0000 7f1abe200700 1 -- 172.21.15.47:0/468928157 wait complete. 2024-05-10T04:52:07.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T04:52:07.541 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:52:07.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.810+0000 7f47c4600700 1 Processor -- start 2024-05-10T04:52:07.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.810+0000 7f47c4600700 1 -- start start 2024-05-10T04:52:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.811+0000 7f47c4600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc152bb0 0x7f47bc0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47c4600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc06d640 con 0x7f47bc0c6cc0 2024-05-10T04:52:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47c4600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47bc0c9800 con 0x7f47bc06bdb0 2024-05-10T04:52:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47c4600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc152fc0 con 0x7f47bc152bb0 2024-05-10T04:52:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47c1c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f47bc0c6cc0 0x7f47bc0c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57034/0 (socket says 172.21.15.47:57034) 2024-05-10T04:52:07.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47c1c00700 1 -- 172.21.15.47:0/2348392489 learned_addr learned my addr 172.21.15.47:0/2348392489 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47c1200700 1 --2- 172.21.15.47:0/2348392489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc152bb0 0x7f47bc0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293789751 0 0) 0x7f47bc06d640 con 0x7f47bc0c6cc0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.812+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a40035b0 con 0x7f47bc0c6cc0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3964621447 0 0) 0x7f47bc0c9800 con 0x7f47bc06bdb0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47bc06d640 con 0x7f47bc06bdb0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 494598236 0 0) 0x7f47a40035b0 con 0x7f47bc0c6cc0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47c1200700 1 -- 172.21.15.47:0/2348392489 >> v1:172.21.15.117:6789/0 conn(0x7f47bc06bdb0 legacy=0x7f47bc06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47c1200700 1 -- 172.21.15.47:0/2348392489 >> v1:172.21.15.47:6789/0 conn(0x7f47bc0c6cc0 legacy=0x7f47bc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47c1200700 1 -- 172.21.15.47:0/2348392489 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0c8910 con 0x7f47bc152bb0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47c1200700 1 --2- 172.21.15.47:0/2348392489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc152bb0 0x7f47bc0c5cf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009870 tx=0x7f47a8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44e06e0f4132ca95 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0001670 con 0x7f47bc152bb0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8004030 con 0x7f47bc152bb0 2024-05-10T04:52:07.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.813+0000 7f47bbe00700 1 -- 172.21.15.47:0/2348392489 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80043c0 con 0x7f47bc152bb0 2024-05-10T04:52:07.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 -- 172.21.15.47:0/2348392489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc152bb0 msgr2=0x7f47bc0c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 --2- 172.21.15.47:0/2348392489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc152bb0 0x7f47bc0c5cf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009870 tx=0x7f47a8009b80 comp rx=0 tx=0).stop 2024-05-10T04:52:07.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 -- 172.21.15.47:0/2348392489 shutdown_connections 2024-05-10T04:52:07.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 --2- 172.21.15.47:0/2348392489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc152bb0 0x7f47bc0c5cf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 -- 172.21.15.47:0/2348392489 >> 172.21.15.47:0/2348392489 conn(0x7f47bc0ca960 msgr2=0x7f47bc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:07.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 -- 172.21.15.47:0/2348392489 shutdown_connections 2024-05-10T04:52:07.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.814+0000 7f47c4600700 1 -- 172.21.15.47:0/2348392489 wait complete. 2024-05-10T04:52:07.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.816+0000 7f47c4600700 1 Processor -- start 2024-05-10T04:52:07.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.816+0000 7f47c4600700 1 -- start start 2024-05-10T04:52:07.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c4600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 0x7f47bc14ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c4600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc0c6cc0 0x7f47bc14b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c4600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc152bb0 0x7f47bc1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c4600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc156800 con 0x7f47bc06bdb0 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c4600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0bec00 con 0x7f47bc152bb0 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c4600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47bc0beee0 con 0x7f47bc0c6cc0 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 0x7f47bc14ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 0x7f47bc14ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55976/0 (socket says 172.21.15.47:55976) 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c1c00700 1 -- 172.21.15.47:0/2151786718 learned_addr learned my addr 172.21.15.47:0/2151786718 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c1200700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc0c6cc0 0x7f47bc14b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c2600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc152bb0 0x7f47bc1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.818+0000 7f47c1c00700 1 -- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc0c6cc0 msgr2=0x7f47bc14b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c1c00700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc0c6cc0 0x7f47bc14b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c1c00700 1 -- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc152bb0 msgr2=0x7f47bc1536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:07.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c1c00700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc152bb0 0x7f47bc1536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c1c00700 1 -- 172.21.15.47:0/2151786718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80094a0 con 0x7f47bc06bdb0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c1c00700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 0x7f47bc14ce20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c520 tx=0x7f47b000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004c80 con 0x7f47bc06bdb0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b0004de0 con 0x7f47bc06bdb0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0007310 con 0x7f47bc06bdb0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47bc154100 con 0x7f47bc06bdb0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.819+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47bc0be2e0 con 0x7f47bc06bdb0 2024-05-10T04:52:07.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.820+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47bc0bf0a0 con 0x7f47bc06bdb0 2024-05-10T04:52:07.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.822+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f47b0007470 con 0x7f47bc06bdb0 2024-05-10T04:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.822+0000 7f47b9600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f479c06ac90 0x7f479c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.823+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47b0089340 con 0x7f47bc06bdb0 2024-05-10T04:52:07.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.823+0000 7f47c1200700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f479c06ac90 0x7f479c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:07.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.823+0000 7f47c1200700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f479c06ac90 0x7f479c06d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009870 tx=0x7f47a8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:07.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:07.827+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f47b0054190 con 0x7f47bc06bdb0 2024-05-10T04:52:08.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.042+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47bc074720 con 0x7f47bc06bdb0 2024-05-10T04:52:08.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.042+0000 7f47b9600700 1 -- 172.21.15.47:0/2151786718 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f47b00577b0 con 0x7f47bc06bdb0 2024-05-10T04:52:08.044 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f479c06ac90 msgr2=0x7f479c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f479c06ac90 0x7f479c06d1a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009870 tx=0x7f47a8008030 comp rx=0 tx=0).stop 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 msgr2=0x7f47bc14ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 0x7f47bc14ce20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47b000c520 tx=0x7f47b000c830 comp rx=0 tx=0).stop 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 shutdown_connections 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f47bc152bb0 0x7f47bc1536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f47bc06bdb0 0x7f47bc14ce20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f479c06ac90 0x7f479c06d1a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 --2- 172.21.15.47:0/2151786718 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f47bc0c6cc0 0x7f47bc14b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 >> 172.21.15.47:0/2151786718 conn(0x7f47bc0ca960 msgr2=0x7f47bc152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 shutdown_connections 2024-05-10T04:52:08.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.045+0000 7f47c4600700 1 -- 172.21.15.47:0/2151786718 wait complete. 2024-05-10T04:52:08.073 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:52:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.345+0000 7fa22d600700 1 Processor -- start 2024-05-10T04:52:08.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.346+0000 7fa22d600700 1 -- start start 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.347+0000 7fa22d600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2280c6cc0 0x7fa228152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.347+0000 7fa22d600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa2280c5cf0 0x7fa2280c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.347+0000 7fa22d600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22806d640 con 0x7fa2280c92d0 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.347+0000 7fa22d600700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280c9800 con 0x7fa2280c6cc0 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.347+0000 7fa22d600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2280c8910 con 0x7fa2280c5cf0 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.347+0000 7fa226a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2280c6cc0 0x7fa228152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa2280c6cc0 0x7fa228152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55982/0 (socket says 172.21.15.47:55982) 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 -- 172.21.15.47:0/1890980281 learned_addr learned my addr 172.21.15.47:0/1890980281 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226000700 1 --2- 172.21.15.47:0/1890980281 >> v2:172.21.15.117:3300/0 conn(0x7fa2280c5cf0 0x7fa2280c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 -- 172.21.15.47:0/1890980281 >> v2:172.21.15.117:3300/0 conn(0x7fa2280c5cf0 msgr2=0x7fa2280c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 --2- 172.21.15.47:0/1890980281 >> v2:172.21.15.117:3300/0 conn(0x7fa2280c5cf0 0x7fa2280c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 -- 172.21.15.47:0/1890980281 >> v1:172.21.15.47:6789/0 conn(0x7fa2280c92d0 legacy=0x7fa22806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 -- 172.21.15.47:0/1890980281 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2280c6100 con 0x7fa2280c6cc0 2024-05-10T04:52:08.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.348+0000 7fa226a00700 1 --2- 172.21.15.47:0/1890980281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c6cc0 0x7fa228152bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2280ca790 tx=0x7fa218009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fe4a87f1a9b5c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa225600700 1 -- 172.21.15.47:0/1890980281 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800b870 con 0x7fa2280c6cc0 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa225600700 1 -- 172.21.15.47:0/1890980281 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21800b9d0 con 0x7fa2280c6cc0 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa225600700 1 -- 172.21.15.47:0/1890980281 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21800bd60 con 0x7fa2280c6cc0 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 -- 172.21.15.47:0/1890980281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c6cc0 msgr2=0x7fa228152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 --2- 172.21.15.47:0/1890980281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c6cc0 0x7fa228152bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2280ca790 tx=0x7fa218009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 -- 172.21.15.47:0/1890980281 shutdown_connections 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 --2- 172.21.15.47:0/1890980281 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c6cc0 0x7fa228152bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 --2- 172.21.15.47:0/1890980281 >> v2:172.21.15.117:3300/0 conn(0x7fa2280c5cf0 0x7fa2280c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 -- 172.21.15.47:0/1890980281 >> 172.21.15.47:0/1890980281 conn(0x7fa2280ca960 msgr2=0x7fa2280cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.349+0000 7fa22d600700 1 -- 172.21.15.47:0/1890980281 shutdown_connections 2024-05-10T04:52:08.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.350+0000 7fa22d600700 1 -- 172.21.15.47:0/1890980281 wait complete. 2024-05-10T04:52:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.352+0000 7fa22d600700 1 Processor -- start 2024-05-10T04:52:08.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.352+0000 7fa22d600700 1 -- start start 2024-05-10T04:52:08.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa22d600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2280c5cf0 0x7fa228153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa22d600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280c6cc0 0x7fa2280ab530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa22d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 0x7fa228143ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa22d600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280c2c40 con 0x7fa2280c92d0 2024-05-10T04:52:08.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa22d600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281eb280 con 0x7fa2280c6cc0 2024-05-10T04:52:08.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa22d600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2280ac300 con 0x7fa2280c5cf0 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa227400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 0x7fa228143ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa227400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 0x7fa228143ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55996/0 (socket says 172.21.15.47:55996) 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.353+0000 7fa227400700 1 -- 172.21.15.47:0/2004474658 learned_addr learned my addr 172.21.15.47:0/2004474658 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa226000700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280c6cc0 0x7fa2280ab530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa226a00700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2280c5cf0 0x7fa228153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa227400700 1 -- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2280c5cf0 msgr2=0x7fa228153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa227400700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2280c5cf0 0x7fa228153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa227400700 1 -- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280c6cc0 msgr2=0x7fa2280ab530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa227400700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280c6cc0 0x7fa2280ab530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa227400700 1 -- 172.21.15.47:0/2004474658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218009550 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa226a00700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2280c5cf0 0x7fa228153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa227400700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 0x7fa228143ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa22000cbc0 tx=0x7fa22000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220003c00 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa220003d60 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa228153c00 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22000ab90 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.354+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281eb490 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.356+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa228074720 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.357+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa22000acf0 con 0x7fa2280c92d0 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.358+0000 7fa21ea00700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa20806ac90 0x7fa20806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.358+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2200896a0 con 0x7fa2280c92d0 2024-05-10T04:52:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.358+0000 7fa226a00700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa20806ac90 0x7fa20806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.359+0000 7fa226a00700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa20806ac90 0x7fa20806d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa218000c00 tx=0x7fa218008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.363+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa220054580 con 0x7fa2280c92d0 2024-05-10T04:52:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.576+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa2280c8b70 con 0x7fa2280c92d0 2024-05-10T04:52:08.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.577+0000 7fa21ea00700 1 -- 172.21.15.47:0/2004474658 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa220057ba0 con 0x7fa2280c92d0 2024-05-10T04:52:08.578 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa20806ac90 msgr2=0x7fa20806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa20806ac90 0x7fa20806d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa218000c00 tx=0x7fa218008030 comp rx=0 tx=0).stop 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 msgr2=0x7fa228143ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 0x7fa228143ec0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa22000cbc0 tx=0x7fa22000cf80 comp rx=0 tx=0).stop 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 shutdown_connections 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa2280c92d0 0x7fa228143ec0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa20806ac90 0x7fa20806d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa2280c5cf0 0x7fa228153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 --2- 172.21.15.47:0/2004474658 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa2280c6cc0 0x7fa2280ab530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 >> 172.21.15.47:0/2004474658 conn(0x7fa2280ca960 msgr2=0x7fa2280c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 shutdown_connections 2024-05-10T04:52:08.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.579+0000 7fa22d600700 1 -- 172.21.15.47:0/2004474658 wait complete. 2024-05-10T04:52:08.606 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:52:08.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.880+0000 7f7579000700 1 Processor -- start 2024-05-10T04:52:08.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.880+0000 7f7579000700 1 -- start start 2024-05-10T04:52:08.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.881+0000 7f7579000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f7574152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.881+0000 7f7579000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f757406bdb0 0x7f757406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.881+0000 7f7579000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757406d640 con 0x7f75740c5cf0 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.881+0000 7f7579000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75740c9800 con 0x7f757406bdb0 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.881+0000 7f7579000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757406c700 con 0x7f75740c6cc0 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f757406bdb0 0x7f757406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f757406bdb0 0x7f757406c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56008/0 (socket says 172.21.15.47:56008) 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 -- 172.21.15.47:0/2364467032 learned_addr learned my addr 172.21.15.47:0/2364467032 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:08.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7571e00700 1 --2- 172.21.15.47:0/2364467032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f7574152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 -- 172.21.15.47:0/2364467032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 msgr2=0x7f7574152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 --2- 172.21.15.47:0/2364467032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f7574152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 -- 172.21.15.47:0/2364467032 >> v1:172.21.15.117:6789/0 conn(0x7f75740c5cf0 legacy=0x7f75740c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7570a00700 1 -- 172.21.15.47:0/2364467032 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118381066 0 0) 0x7f757406d640 con 0x7f75740c5cf0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.882+0000 7f7572800700 1 -- 172.21.15.47:0/2364467032 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75740c6100 con 0x7f757406bdb0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.883+0000 7f7572800700 1 --2- 172.21.15.47:0/2364467032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f757406c1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f756c009e50 tx=0x7f756c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adafa0c0140976d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.883+0000 7f7570a00700 1 -- 172.21.15.47:0/2364467032 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00e070 con 0x7f757406bdb0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.883+0000 7f7570a00700 1 -- 172.21.15.47:0/2364467032 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c00b910 con 0x7f757406bdb0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.883+0000 7f7570a00700 1 -- 172.21.15.47:0/2364467032 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00bcc0 con 0x7f757406bdb0 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 -- 172.21.15.47:0/2364467032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 msgr2=0x7f757406c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 --2- 172.21.15.47:0/2364467032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f757406c1c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f756c009e50 tx=0x7f756c00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 -- 172.21.15.47:0/2364467032 shutdown_connections 2024-05-10T04:52:08.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 --2- 172.21.15.47:0/2364467032 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f757406c1c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 --2- 172.21.15.47:0/2364467032 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f7574152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 -- 172.21.15.47:0/2364467032 >> 172.21.15.47:0/2364467032 conn(0x7f75740ca960 msgr2=0x7f75740cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 -- 172.21.15.47:0/2364467032 shutdown_connections 2024-05-10T04:52:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.884+0000 7f7579000700 1 -- 172.21.15.47:0/2364467032 wait complete. 2024-05-10T04:52:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.886+0000 7f7579000700 1 Processor -- start 2024-05-10T04:52:08.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.886+0000 7f7579000700 1 -- start start 2024-05-10T04:52:08.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.887+0000 7f7579000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f75741e8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.887+0000 7f7579000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75740c5cf0 0x7f75741eb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.887+0000 7f7579000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f757414be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.887+0000 7f7579000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757414a3b0 con 0x7f757406bdb0 2024-05-10T04:52:08.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.887+0000 7f7579000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7574147c90 con 0x7f75740c5cf0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.887+0000 7f7579000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757414b1e0 con 0x7f75740c6cc0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f75741e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f75741e8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56010/0 (socket says 172.21.15.47:56010) 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 -- 172.21.15.47:0/2196195660 learned_addr learned my addr 172.21.15.47:0/2196195660 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571400700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75740c5cf0 0x7f75741eb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7572800700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f757414be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 -- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 msgr2=0x7f757414be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f757414be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 -- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75740c5cf0 msgr2=0x7f75741eb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75740c5cf0 0x7f75741eb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 -- 172.21.15.47:0/2196195660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009b30 con 0x7f757406bdb0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.888+0000 7f7571e00700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f75741e8310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f756400e870 tx=0x7f756400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.889+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7564009590 con 0x7f757406bdb0 2024-05-10T04:52:08.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.889+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756400ee70 con 0x7f757406bdb0 2024-05-10T04:52:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.889+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756400ca50 con 0x7f757406bdb0 2024-05-10T04:52:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.889+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757414af00 con 0x7f757406bdb0 2024-05-10T04:52:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.889+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757414a890 con 0x7f757406bdb0 2024-05-10T04:52:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.890+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7574074720 con 0x7f757406bdb0 2024-05-10T04:52:08.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.891+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f756400cbb0 con 0x7f757406bdb0 2024-05-10T04:52:08.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.892+0000 7f756a000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f755406ac90 0x7f755406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:08.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.892+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7564089620 con 0x7f757406bdb0 2024-05-10T04:52:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.892+0000 7f7571400700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f755406ac90 0x7f755406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:08.894 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.893+0000 7f7571400700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f755406ac90 0x7f755406d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75741512b0 tx=0x7f7560009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:08.898 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:08.897+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7564054510 con 0x7f757406bdb0 2024-05-10T04:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.112+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f75740c8b70 con 0x7f757406bdb0 2024-05-10T04:52:09.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.112+0000 7f756a000700 1 -- 172.21.15.47:0/2196195660 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f756400ce60 con 0x7f757406bdb0 2024-05-10T04:52:09.114 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f755406ac90 msgr2=0x7f755406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f755406ac90 0x7f755406d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75741512b0 tx=0x7f7560009040 comp rx=0 tx=0).stop 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 msgr2=0x7f75741e8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f75741e8310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f756400e870 tx=0x7f756400ec30 comp rx=0 tx=0).stop 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 shutdown_connections 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f755406ac90 0x7f755406d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f75740c6cc0 0x7f757414be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f757406bdb0 0x7f75741e8310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 --2- 172.21.15.47:0/2196195660 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f75740c5cf0 0x7f75741eb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 >> 172.21.15.47:0/2196195660 conn(0x7f75740ca960 msgr2=0x7f75740abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 shutdown_connections 2024-05-10T04:52:09.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.115+0000 7f7579000700 1 -- 172.21.15.47:0/2196195660 wait complete. 2024-05-10T04:52:09.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T04:52:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.413+0000 7f9acd600700 1 Processor -- start 2024-05-10T04:52:09.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.413+0000 7f9acd600700 1 -- start start 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9acd600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c6cc0 0x7f9ac8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9acd600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9ac80c5cf0 0x7f9ac80c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9acd600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac806d640 con 0x7f9ac80c92d0 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9acd600700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80c9800 con 0x7f9ac80c5cf0 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9acd600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80c8910 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9ac80c5cf0 0x7f9ac80c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9ac80c5cf0 0x7f9ac80c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56020/0 (socket says 172.21.15.47:56020) 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 -- 172.21.15.47:0/4220850122 learned_addr learned my addr 172.21.15.47:0/4220850122 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6a00700 1 --2- 172.21.15.47:0/4220850122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c6cc0 0x7f9ac8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 -- 172.21.15.47:0/4220850122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c6cc0 msgr2=0x7f9ac8152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:09.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 --2- 172.21.15.47:0/4220850122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c6cc0 0x7f9ac8152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 -- 172.21.15.47:0/4220850122 >> v1:172.21.15.117:6789/0 conn(0x7f9ac80c92d0 legacy=0x7f9ac806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.415+0000 7f9ac6000700 1 -- 172.21.15.47:0/4220850122 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80c6100 con 0x7f9ac80c5cf0 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.416+0000 7f9ac6000700 1 --2- 172.21.15.47:0/4220850122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c5cf0 0x7f9ac80c8d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40098f0 tx=0x7f9ab4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825522c63d69b077 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.416+0000 7f9ac5600700 1 -- 172.21.15.47:0/4220850122 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011830 con 0x7f9ac80c5cf0 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.416+0000 7f9ac5600700 1 -- 172.21.15.47:0/4220850122 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab4011990 con 0x7f9ac80c5cf0 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.416+0000 7f9ac5600700 1 -- 172.21.15.47:0/4220850122 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4011d20 con 0x7f9ac80c5cf0 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 -- 172.21.15.47:0/4220850122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c5cf0 msgr2=0x7f9ac80c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 --2- 172.21.15.47:0/4220850122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c5cf0 0x7f9ac80c8d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ab40098f0 tx=0x7f9ab4009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 -- 172.21.15.47:0/4220850122 shutdown_connections 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 --2- 172.21.15.47:0/4220850122 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c6cc0 0x7f9ac8152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 --2- 172.21.15.47:0/4220850122 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c5cf0 0x7f9ac80c8d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 -- 172.21.15.47:0/4220850122 >> 172.21.15.47:0/4220850122 conn(0x7f9ac80ca960 msgr2=0x7f9ac80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 -- 172.21.15.47:0/4220850122 shutdown_connections 2024-05-10T04:52:09.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.417+0000 7f9acd600700 1 -- 172.21.15.47:0/4220850122 wait complete. 2024-05-10T04:52:09.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.419+0000 7f9acd600700 1 Processor -- start 2024-05-10T04:52:09.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.419+0000 7f9acd600700 1 -- start start 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9acd600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c5cf0 0x7f9ac81446c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9acd600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 0x7f9ac81553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9acd600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac80c92d0 0x7f9ac81465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9acd600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80ca1e0 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9acd600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81499d0 con 0x7f9ac80c92d0 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9acd600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81ef6e0 con 0x7f9ac80c5cf0 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 0x7f9ac81553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 0x7f9ac81553f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56036/0 (socket says 172.21.15.47:56036) 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 -- 172.21.15.47:0/2895525254 learned_addr learned my addr 172.21.15.47:0/2895525254 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6a00700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c5cf0 0x7f9ac81446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac7400700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac80c92d0 0x7f9ac81465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 -- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c5cf0 msgr2=0x7f9ac81446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c5cf0 0x7f9ac81446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 -- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac80c92d0 msgr2=0x7f9ac81465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac80c92d0 0x7f9ac81465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac6000700 1 -- 172.21.15.47:0/2895525254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab4009550 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.421+0000 7f9ac7400700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac80c92d0 0x7f9ac81465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.422+0000 7f9ac6000700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 0x7f9ac81553f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4014040 tx=0x7f9ab4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.422+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab40036a0 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.422+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab401e070 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.422+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4003a60 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.422+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8156030 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.422+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac81ebe00 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.423+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac8074720 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.424+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ab4003bc0 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.425+0000 7f9abea00700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9aa806ace0 0x7f9aa806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.425+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ab408a5a0 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.426+0000 7f9ac6a00700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9aa806ace0 0x7f9aa806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.427+0000 7f9ac6a00700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9aa806ace0 0x7f9aa806d1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009ad0 tx=0x7f9ab8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.430+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9ab4055500 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.647+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9ac80c8b70 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.648+0000 7f9abea00700 1 -- 172.21.15.47:0/2895525254 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9ab4058b20 con 0x7f9ac80c6cc0 2024-05-10T04:52:09.650 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9aa806ace0 msgr2=0x7f9aa806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9aa806ace0 0x7f9aa806d1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8009ad0 tx=0x7f9ab8008040 comp rx=0 tx=0).stop 2024-05-10T04:52:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 msgr2=0x7f9ac81553f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 0x7f9ac81553f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4014040 tx=0x7f9ab4004750 comp rx=0 tx=0).stop 2024-05-10T04:52:09.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 shutdown_connections 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9ac80c92d0 0x7f9ac81465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9aa806ace0 0x7f9aa806d1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9ac80c5cf0 0x7f9ac81446c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 --2- 172.21.15.47:0/2895525254 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9ac80c6cc0 0x7f9ac81553f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.650+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 >> 172.21.15.47:0/2895525254 conn(0x7f9ac80ca960 msgr2=0x7f9ac8156b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.651+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 shutdown_connections 2024-05-10T04:52:09.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.651+0000 7f9acd600700 1 -- 172.21.15.47:0/2895525254 wait complete. 2024-05-10T04:52:09.677 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:52:09.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.945+0000 7f7fb8c00700 1 Processor -- start 2024-05-10T04:52:09.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.945+0000 7f7fb8c00700 1 -- start start 2024-05-10T04:52:09.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.946+0000 7f7fb8c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7fb4152bb0 0x7f7fb40c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.946+0000 7f7fb8c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb406d640 con 0x7f7fb406bdb0 2024-05-10T04:52:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fb8c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40c9800 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fb8c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb4152fc0 con 0x7f7fb4152bb0 2024-05-10T04:52:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fabe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7fb4152bb0 0x7f7fb40c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fb2800700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7fb406bdb0 0x7f7fb406c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57052/0 (socket says 172.21.15.47:57052) 2024-05-10T04:52:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fb2800700 1 -- 172.21.15.47:0/3622927125 learned_addr learned my addr 172.21.15.47:0/3622927125 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:09.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fabe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7fb4152bb0 0x7f7fb40c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56048/0 (socket says 172.21.15.47:56048) 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fabe00700 1 -- 172.21.15.47:0/3622927125 >> v1:172.21.15.117:6789/0 conn(0x7f7fb40c6cc0 legacy=0x7f7fb40c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fabe00700 1 -- 172.21.15.47:0/3622927125 >> v1:172.21.15.47:6789/0 conn(0x7f7fb406bdb0 legacy=0x7f7fb406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fabe00700 1 -- 172.21.15.47:0/3622927125 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb40c8910 con 0x7f7fb4152bb0 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.947+0000 7f7fb1400700 1 -- 172.21.15.47:0/3622927125 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862212136 0 0) 0x7f7fb40c9800 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.948+0000 7f7fabe00700 1 --2- 172.21.15.47:0/3622927125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb4152bb0 0x7f7fb40c5cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009840 tx=0x7f7f9c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fa1cf4df211d7d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.948+0000 7f7fb1400700 1 -- 172.21.15.47:0/3622927125 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c011830 con 0x7f7fb4152bb0 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.948+0000 7f7fb1400700 1 -- 172.21.15.47:0/3622927125 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c011990 con 0x7f7fb4152bb0 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.948+0000 7f7fb1400700 1 -- 172.21.15.47:0/3622927125 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c011d20 con 0x7f7fb4152bb0 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.948+0000 7f7fb8c00700 1 -- 172.21.15.47:0/3622927125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb4152bb0 msgr2=0x7f7fb40c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.948+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/3622927125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb4152bb0 0x7f7fb40c5cf0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c009840 tx=0x7f7f9c009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.949+0000 7f7fb8c00700 1 -- 172.21.15.47:0/3622927125 shutdown_connections 2024-05-10T04:52:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.949+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/3622927125 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb4152bb0 0x7f7fb40c5cf0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.949+0000 7f7fb8c00700 1 -- 172.21.15.47:0/3622927125 >> 172.21.15.47:0/3622927125 conn(0x7f7fb40ca960 msgr2=0x7f7fb40cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.949+0000 7f7fb8c00700 1 -- 172.21.15.47:0/3622927125 shutdown_connections 2024-05-10T04:52:09.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.949+0000 7f7fb8c00700 1 -- 172.21.15.47:0/3622927125 wait complete. 2024-05-10T04:52:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.951+0000 7f7fb8c00700 1 Processor -- start 2024-05-10T04:52:09.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.952+0000 7f7fb8c00700 1 -- start start 2024-05-10T04:52:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.953+0000 7f7fb8c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fb406bdb0 0x7f7fb4154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.956 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.953+0000 7f7fb8c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 0x7f7fb4157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.953+0000 7f7fb8c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fb4152bb0 0x7f7fb414a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.953+0000 7f7fb8c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c3500 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.953+0000 7f7fb8c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4154530 con 0x7f7fb406bdb0 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.953+0000 7f7fb8c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41eb620 con 0x7f7fb4152bb0 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 0x7f7fb4157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 0x7f7fb4157af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56054/0 (socket says 172.21.15.47:56054) 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 -- 172.21.15.47:0/613134863 learned_addr learned my addr 172.21.15.47:0/613134863 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fb2800700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fb4152bb0 0x7f7fb414a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fb1e00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fb406bdb0 0x7f7fb4154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 -- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fb4152bb0 msgr2=0x7f7fb414a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fb4152bb0 0x7f7fb414a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 -- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fb406bdb0 msgr2=0x7f7fb4154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fb406bdb0 0x7f7fb4154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 -- 172.21.15.47:0/613134863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0094a0 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.954+0000 7f7fabe00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 0x7f7fb4157af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c014040 tx=0x7f7f9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.955+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c01a7e0 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.955+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c01a940 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.955+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb4155320 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.955+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c01acb0 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.958 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.955+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb41ef0e0 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.956+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4154c30 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.959 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.957+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7f9c022070 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.958+0000 7f7faa000700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f9006ac90 0x7f7f9006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:09.960 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.958+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f9c08a7c0 con 0x7f7fb40c6cc0 2024-05-10T04:52:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.959+0000 7f7fb1e00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f9006ac90 0x7f7f9006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:09.961 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.959+0000 7f7fb1e00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f9006ac90 0x7f7f9006d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4000f60 tx=0x7f7fa4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:09.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:09.963+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7f9c0556a0 con 0x7f7fb40c6cc0 2024-05-10T04:52:10.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.196+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7fb4074720 con 0x7f7fb40c6cc0 2024-05-10T04:52:10.198 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.196+0000 7f7faa000700 1 -- 172.21.15.47:0/613134863 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7f9c058cc0 con 0x7f7fb40c6cc0 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f9006ac90 msgr2=0x7f7f9006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f9006ac90 0x7f7f9006d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4000f60 tx=0x7f7fa4009040 comp rx=0 tx=0).stop 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 msgr2=0x7f7fb4157af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 0x7f7fb4157af0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c014040 tx=0x7f7f9c004750 comp rx=0 tx=0).stop 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 shutdown_connections 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7f9006ac90 0x7f7f9006d1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7fb4152bb0 0x7f7fb414a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7fb406bdb0 0x7f7fb4154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 --2- 172.21.15.47:0/613134863 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7fb40c6cc0 0x7f7fb4157af0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 >> 172.21.15.47:0/613134863 conn(0x7f7fb40ca960 msgr2=0x7f7fb4152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 shutdown_connections 2024-05-10T04:52:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.199+0000 7f7fb8c00700 1 -- 172.21.15.47:0/613134863 wait complete. 2024-05-10T04:52:10.202 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-10T04:52:10.228 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:52:10.229 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:10.273 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:10.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.580+0000 7f9af7200700 1 Processor -- start 2024-05-10T04:52:10.582 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.580+0000 7f9af7200700 1 -- start start 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af7200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9af00c5c40 0x7f9af00c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af7200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9af0159220 0x7f9af015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af7200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af006c7c0 con 0x7f9af00c9270 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af7200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af006d060 con 0x7f9af0159220 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af7200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af0159630 con 0x7f9af00c5c40 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af5200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9af0159220 0x7f9af015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af5200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9af0159220 0x7f9af015fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56058/0 (socket says 172.21.15.47:56058) 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9af5200700 1 -- 172.21.15.47:0/1219038044 learned_addr learned my addr 172.21.15.47:0/1219038044 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:10.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.582+0000 7f9aefe00700 1 --2- 172.21.15.47:0/1219038044 >> v2:172.21.15.117:3300/0 conn(0x7f9af00c5c40 0x7f9af00c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.583+0000 7f9af5200700 1 -- 172.21.15.47:0/1219038044 >> v2:172.21.15.117:3300/0 conn(0x7f9af00c5c40 msgr2=0x7f9af00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.583+0000 7f9af5200700 1 --2- 172.21.15.47:0/1219038044 >> v2:172.21.15.117:3300/0 conn(0x7f9af00c5c40 0x7f9af00c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.583+0000 7f9af5200700 1 -- 172.21.15.47:0/1219038044 >> v1:172.21.15.117:6789/0 conn(0x7f9af00c9270 legacy=0x7f9af0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.583+0000 7f9af5200700 1 -- 172.21.15.47:0/1219038044 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af0159890 con 0x7f9af0159220 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.583+0000 7f9af5200700 1 --2- 172.21.15.47:0/1219038044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af0159220 0x7f9af015fe40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9af006dc40 tx=0x7f9ae800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e8cfb7b5973c55 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.583+0000 7f9aeea00700 1 -- 172.21.15.47:0/1219038044 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800e070 con 0x7f9af0159220 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9aeea00700 1 -- 172.21.15.47:0/1219038044 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae800b910 con 0x7f9af0159220 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9aeea00700 1 -- 172.21.15.47:0/1219038044 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae800bcc0 con 0x7f9af0159220 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 -- 172.21.15.47:0/1219038044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af0159220 msgr2=0x7f9af015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 --2- 172.21.15.47:0/1219038044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af0159220 0x7f9af015fe40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9af006dc40 tx=0x7f9ae800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 -- 172.21.15.47:0/1219038044 shutdown_connections 2024-05-10T04:52:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 --2- 172.21.15.47:0/1219038044 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af0159220 0x7f9af015fe40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 --2- 172.21.15.47:0/1219038044 >> v2:172.21.15.117:3300/0 conn(0x7f9af00c5c40 0x7f9af00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 -- 172.21.15.47:0/1219038044 >> 172.21.15.47:0/1219038044 conn(0x7f9af00ca940 msgr2=0x7f9af00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 -- 172.21.15.47:0/1219038044 shutdown_connections 2024-05-10T04:52:10.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.584+0000 7f9af7200700 1 -- 172.21.15.47:0/1219038044 wait complete. 2024-05-10T04:52:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.586+0000 7f9af7200700 1 Processor -- start 2024-05-10T04:52:10.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.587+0000 7f9af7200700 1 -- start start 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9af7200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 0x7f9af00c19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9af7200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9af00c9270 0x7f9af01e2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9af7200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9af0159220 0x7f9af00c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9af7200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af00c24e0 con 0x7f9af00c5c40 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9af7200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af0158e10 con 0x7f9af0159220 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9af7200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af01ebf00 con 0x7f9af00c9270 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9aefe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 0x7f9af00c19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9aefe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 0x7f9af00c19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56062/0 (socket says 172.21.15.47:56062) 2024-05-10T04:52:10.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.588+0000 7f9aefe00700 1 -- 172.21.15.47:0/1536279394 learned_addr learned my addr 172.21.15.47:0/1536279394 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aefe00700 1 -- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9af00c9270 msgr2=0x7f9af01e2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aef400700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9af00c9270 0x7f9af01e2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9af5200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9af0159220 0x7f9af00c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aefe00700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9af00c9270 0x7f9af01e2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aefe00700 1 -- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9af0159220 msgr2=0x7f9af00c29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aefe00700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9af0159220 0x7f9af00c29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aefe00700 1 -- 172.21.15.47:0/1536279394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ae8009b30 con 0x7f9af00c5c40 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9af5200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9af0159220 0x7f9af00c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aef400700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9af00c9270 0x7f9af01e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9aefe00700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 0x7f9af00c19f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000e840 tx=0x7f9ae000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0009590 con 0x7f9af00c5c40 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae0013680 con 0x7f9af00c5c40 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae0013a10 con 0x7f9af00c5c40 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af0159060 con 0x7f9af00c5c40 2024-05-10T04:52:10.592 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.589+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af01eb5d0 con 0x7f9af00c5c40 2024-05-10T04:52:10.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.590+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af0074720 con 0x7f9af00c5c40 2024-05-10T04:52:10.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.592+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9ae0013b70 con 0x7f9af00c5c40 2024-05-10T04:52:10.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.592+0000 7f9ae7e00700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9ad006acc0 0x7f9ad006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:10.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.592+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ae00894f0 con 0x7f9af00c5c40 2024-05-10T04:52:10.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.593+0000 7f9aef400700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9ad006acc0 0x7f9ad006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:10.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.593+0000 7f9aef400700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9ad006acc0 0x7f9ad006d1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9af01524e0 tx=0x7f9adc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:10.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.597+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9ae0054470 con 0x7f9af00c5c40 2024-05-10T04:52:10.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.811+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9af01ec070 con 0x7f9af00c5c40 2024-05-10T04:52:10.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.812+0000 7f9ae7e00700 1 -- 172.21.15.47:0/1536279394 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f9ae0057a90 con 0x7f9af00c5c40 2024-05-10T04:52:10.814 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:10.815 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:10.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9ad006acc0 msgr2=0x7f9ad006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9ad006acc0 0x7f9ad006d1d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9af01524e0 tx=0x7f9adc009040 comp rx=0 tx=0).stop 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 msgr2=0x7f9af00c19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 0x7f9af00c19f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9ae000e840 tx=0x7f9ae000ec00 comp rx=0 tx=0).stop 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 shutdown_connections 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9af0159220 0x7f9af00c29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9af00c5c40 0x7f9af00c19f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9ad006acc0 0x7f9ad006d1d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 --2- 172.21.15.47:0/1536279394 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9af00c9270 0x7f9af01e2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 >> 172.21.15.47:0/1536279394 conn(0x7f9af00ca940 msgr2=0x7f9af00c7290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 shutdown_connections 2024-05-10T04:52:10.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:10.815+0000 7f9af7200700 1 -- 172.21.15.47:0/1536279394 wait complete. 2024-05-10T04:52:10.842 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T04:52:10.843 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:52:11.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.111+0000 7f1d03400700 1 Processor -- start 2024-05-10T04:52:11.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.111+0000 7f1d03400700 1 -- start start 2024-05-10T04:52:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d03400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1cfc0c6cc0 0x7f1cfc152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d03400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d03400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1cfc0c92d0 0x7f1cfc06bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d03400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc06d640 con 0x7f1cfc0c92d0 2024-05-10T04:52:11.115 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d03400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0c6100 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d03400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0c9800 con 0x7f1cfc0c5cf0 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d01400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1cfc0c92d0 0x7f1cfc06bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d01400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1cfc0c92d0 0x7f1cfc06bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49866/0 (socket says 172.21.15.47:49866) 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d01400700 1 -- 172.21.15.47:0/178395911 learned_addr learned my addr 172.21.15.47:0/178395911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1d00a00700 1 --2- 172.21.15.47:0/178395911 >> v2:172.21.15.117:3300/0 conn(0x7f1cfc0c6cc0 0x7f1cfc152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.113+0000 7f1cfbe00700 1 --2- 172.21.15.47:0/178395911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1d01400700 1 -- 172.21.15.47:0/178395911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c5cf0 msgr2=0x7f1cfc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1d01400700 1 --2- 172.21.15.47:0/178395911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1d01400700 1 -- 172.21.15.47:0/178395911 >> v2:172.21.15.117:3300/0 conn(0x7f1cfc0c6cc0 msgr2=0x7f1cfc152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1d01400700 1 --2- 172.21.15.47:0/178395911 >> v2:172.21.15.117:3300/0 conn(0x7f1cfc0c6cc0 0x7f1cfc152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1d01400700 1 -- 172.21.15.47:0/178395911 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0c8910 con 0x7f1cfc0c92d0 2024-05-10T04:52:11.116 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1d01400700 1 --2- 172.21.15.47:0/178395911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c92d0 0x7f1cfc06bdb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc08c3a0 tx=0x7f1cf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff877ed63329c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.117 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1cfb400700 1 -- 172.21.15.47:0/178395911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400e070 con 0x7f1cfc0c92d0 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1cfb400700 1 -- 172.21.15.47:0/178395911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400b910 con 0x7f1cfc0c92d0 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.114+0000 7f1cfb400700 1 -- 172.21.15.47:0/178395911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400bcc0 con 0x7f1cfc0c92d0 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 -- 172.21.15.47:0/178395911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c92d0 msgr2=0x7f1cfc06bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 --2- 172.21.15.47:0/178395911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c92d0 0x7f1cfc06bdb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc08c3a0 tx=0x7f1cf400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 -- 172.21.15.47:0/178395911 shutdown_connections 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 --2- 172.21.15.47:0/178395911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c92d0 0x7f1cfc06bdb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 --2- 172.21.15.47:0/178395911 >> v2:172.21.15.117:3300/0 conn(0x7f1cfc0c6cc0 0x7f1cfc152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 --2- 172.21.15.47:0/178395911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 -- 172.21.15.47:0/178395911 >> 172.21.15.47:0/178395911 conn(0x7f1cfc0ca960 msgr2=0x7f1cfc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 -- 172.21.15.47:0/178395911 shutdown_connections 2024-05-10T04:52:11.118 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.115+0000 7f1d03400700 1 -- 172.21.15.47:0/178395911 wait complete. 2024-05-10T04:52:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.117+0000 7f1d03400700 1 Processor -- start 2024-05-10T04:52:11.119 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.117+0000 7f1d03400700 1 -- start start 2024-05-10T04:52:11.121 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d03400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d03400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 0x7f1cfc14a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d03400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c92d0 0x7f1cfc14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d03400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0c35e0 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d03400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc14b3e0 con 0x7f1cfc0c5cf0 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d03400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc153410 con 0x7f1cfc0c92d0 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 0x7f1cfc14a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 0x7f1cfc14a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49880/0 (socket says 172.21.15.47:49880) 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 -- 172.21.15.47:0/2787908006 learned_addr learned my addr 172.21.15.47:0/2787908006 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d00a00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1d01400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c92d0 0x7f1cfc14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 -- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c92d0 msgr2=0x7f1cfc14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c92d0 0x7f1cfc14cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.122 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 -- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cfc0c5cf0 msgr2=0x7f1cfc0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.119+0000 7f1cfbe00700 1 -- 172.21.15.47:0/2787908006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4009b30 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.120+0000 7f1cfbe00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 0x7f1cfc14a950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800e8a0 tx=0x7f1ce800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.120+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8013680 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.120+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce80137e0 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.120+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8013b70 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.120+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc1ec250 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.120+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc1eb2f0 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.123 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.121+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc074720 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.122+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ce8013cd0 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.124 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.123+0000 7f1cf8c00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1cdc06acc0 0x7f1cdc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.123+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ce8089800 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.124+0000 7f1d00a00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1cdc06acc0 0x7f1cdc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.125 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.124+0000 7f1d00a00700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1cdc06acc0 0x7f1cdc06d1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009ac0 tx=0x7f1cf0009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.128+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1ce8054650 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.344+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cfc1eb4e0 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.344+0000 7f1cf8c00700 1 -- 172.21.15.47:0/2787908006 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ce8057c70 con 0x7f1cfc0c6cc0 2024-05-10T04:52:11.346 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1cdc06acc0 msgr2=0x7f1cdc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1cdc06acc0 0x7f1cdc06d1d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1cf0009ac0 tx=0x7f1cf0009210 comp rx=0 tx=0).stop 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 msgr2=0x7f1cfc14a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 0x7f1cfc14a950 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800e8a0 tx=0x7f1ce800ebb0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 shutdown_connections 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1cdc06acc0 0x7f1cdc06d1d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1cfc0c92d0 0x7f1cfc14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1cfc0c5cf0 0x7f1cfc0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 --2- 172.21.15.47:0/2787908006 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1cfc0c6cc0 0x7f1cfc14a950 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 >> 172.21.15.47:0/2787908006 conn(0x7f1cfc0ca960 msgr2=0x7f1cfc156d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 shutdown_connections 2024-05-10T04:52:11.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.347+0000 7f1d03400700 1 -- 172.21.15.47:0/2787908006 wait complete. 2024-05-10T04:52:11.375 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:52:11.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.646+0000 7f8992600700 1 Processor -- start 2024-05-10T04:52:11.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.646+0000 7f8992600700 1 -- start start 2024-05-10T04:52:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.647+0000 7f8992600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f898c0c6cc0 0x7f898c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f8992600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f898c06bdb0 0x7f898c06c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f8992600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f898c06d640 con 0x7f898c0c5cf0 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f8992600700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c0c9800 con 0x7f898c06bdb0 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f8992600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f898c06c700 con 0x7f898c0c6cc0 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f898c06bdb0 0x7f898c06c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f898c06bdb0 0x7f898c06c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49886/0 (socket says 172.21.15.47:49886) 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 -- 172.21.15.47:0/539821508 learned_addr learned my addr 172.21.15.47:0/539821508 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:11.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898b400700 1 --2- 172.21.15.47:0/539821508 >> v2:172.21.15.117:3300/0 conn(0x7f898c0c6cc0 0x7f898c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 -- 172.21.15.47:0/539821508 >> v2:172.21.15.117:3300/0 conn(0x7f898c0c6cc0 msgr2=0x7f898c152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 --2- 172.21.15.47:0/539821508 >> v2:172.21.15.117:3300/0 conn(0x7f898c0c6cc0 0x7f898c152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 -- 172.21.15.47:0/539821508 >> v1:172.21.15.117:6789/0 conn(0x7f898c0c5cf0 legacy=0x7f898c0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.651 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.648+0000 7f898be00700 1 -- 172.21.15.47:0/539821508 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f898c0c6100 con 0x7f898c06bdb0 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.649+0000 7f898be00700 1 --2- 172.21.15.47:0/539821508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c06bdb0 0x7f898c06c1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f898c08c3a0 tx=0x7f898400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e33aabaa34d1585b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.649+0000 7f898a000700 1 -- 172.21.15.47:0/539821508 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898400e070 con 0x7f898c06bdb0 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.649+0000 7f898a000700 1 -- 172.21.15.47:0/539821508 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f898400b910 con 0x7f898c06bdb0 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.649+0000 7f898a000700 1 -- 172.21.15.47:0/539821508 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898400bcc0 con 0x7f898c06bdb0 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 -- 172.21.15.47:0/539821508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c06bdb0 msgr2=0x7f898c06c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 --2- 172.21.15.47:0/539821508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c06bdb0 0x7f898c06c1c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f898c08c3a0 tx=0x7f898400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 -- 172.21.15.47:0/539821508 shutdown_connections 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 --2- 172.21.15.47:0/539821508 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c06bdb0 0x7f898c06c1c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 --2- 172.21.15.47:0/539821508 >> v2:172.21.15.117:3300/0 conn(0x7f898c0c6cc0 0x7f898c152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 -- 172.21.15.47:0/539821508 >> 172.21.15.47:0/539821508 conn(0x7f898c0ca960 msgr2=0x7f898c0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 -- 172.21.15.47:0/539821508 shutdown_connections 2024-05-10T04:52:11.652 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.650+0000 7f8992600700 1 -- 172.21.15.47:0/539821508 wait complete. 2024-05-10T04:52:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.653+0000 7f8992600700 1 Processor -- start 2024-05-10T04:52:11.654 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.653+0000 7f8992600700 1 -- start start 2024-05-10T04:52:11.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.654+0000 7f8992600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898c06bdb0 0x7f898c0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.654+0000 7f8992600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 0x7f898c155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.654+0000 7f8992600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898c0c6cc0 0x7f898c0c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.654+0000 7f8992600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c0c4700 con 0x7f898c0c5cf0 2024-05-10T04:52:11.660 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f8992600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898c156100 con 0x7f898c0c6cc0 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f8992600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f898c155260 con 0x7f898c06bdb0 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 0x7f898c155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 0x7f898c155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49892/0 (socket says 172.21.15.47:49892) 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 -- 172.21.15.47:0/2826577647 learned_addr learned my addr 172.21.15.47:0/2826577647 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898b400700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898c06bdb0 0x7f898c0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898be00700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898c0c6cc0 0x7f898c0c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 -- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898c06bdb0 msgr2=0x7f898c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.661 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898c06bdb0 0x7f898c0c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 -- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898c0c6cc0 msgr2=0x7f898c0c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898c0c6cc0 0x7f898c0c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.655+0000 7f898aa00700 1 -- 172.21.15.47:0/2826577647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8984009b30 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.656+0000 7f898aa00700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 0x7f898c155680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f897800c450 tx=0x7f897800c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.656+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780052d0 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.656+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8978005430 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.656+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c154380 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.656+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89780038c0 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.656+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f898c154940 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.657+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f898c154b00 con 0x7f898c0c5cf0 2024-05-10T04:52:11.662 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.658+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8978003a20 con 0x7f898c0c5cf0 2024-05-10T04:52:11.663 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.659+0000 7f8983400700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f896c06acc0 0x7f896c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:11.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.659+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f89780887d0 con 0x7f898c0c5cf0 2024-05-10T04:52:11.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.660+0000 7f898b400700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f896c06acc0 0x7f896c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:11.664 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.661+0000 7f898b400700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f896c06acc0 0x7f896c06d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f897c009b40 tx=0x7f897c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:11.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.665+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8978053730 con 0x7f898c0c5cf0 2024-05-10T04:52:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.880+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f898c1541e0 con 0x7f898c0c5cf0 2024-05-10T04:52:11.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.881+0000 7f8983400700 1 -- 172.21.15.47:0/2826577647 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f898c1541e0 con 0x7f898c0c5cf0 2024-05-10T04:52:11.882 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:11.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f896c06acc0 msgr2=0x7f896c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f896c06acc0 0x7f896c06d1d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f897c009b40 tx=0x7f897c009210 comp rx=0 tx=0).stop 2024-05-10T04:52:11.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 msgr2=0x7f898c155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:11.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 0x7f898c155680 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f897800c450 tx=0x7f897800c760 comp rx=0 tx=0).stop 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 shutdown_connections 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f898c0c6cc0 0x7f898c0c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f896c06acc0 0x7f896c06d1d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f898c06bdb0 0x7f898c0c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 --2- 172.21.15.47:0/2826577647 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f898c0c5cf0 0x7f898c155680 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 >> 172.21.15.47:0/2826577647 conn(0x7f898c0ca960 msgr2=0x7f898c156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.883+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 shutdown_connections 2024-05-10T04:52:11.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:11.884+0000 7f8992600700 1 -- 172.21.15.47:0/2826577647 wait complete. 2024-05-10T04:52:11.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.180+0000 7fd243200700 1 Processor -- start 2024-05-10T04:52:12.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.180+0000 7fd243200700 1 -- start start 2024-05-10T04:52:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd243200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd23c0c6d90 0x7fd23c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd243200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cad00 0x7fd23c0c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd243200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0c31e0 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.184 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd243200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0c50e0 con 0x7fd23c0c6d90 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd243200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0cb110 con 0x7fd23c0cad00 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd23be00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd23c0c6d90 0x7fd23c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd23be00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd23c0c6d90 0x7fd23c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49904/0 (socket says 172.21.15.47:49904) 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd23be00700 1 -- 172.21.15.47:0/2784411455 learned_addr learned my addr 172.21.15.47:0/2784411455 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.182+0000 7fd241200700 1 --2- 172.21.15.47:0/2784411455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cad00 0x7fd23c0c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23be00700 1 -- 172.21.15.47:0/2784411455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cad00 msgr2=0x7fd23c0c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23be00700 1 --2- 172.21.15.47:0/2784411455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cad00 0x7fd23c0c3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23be00700 1 -- 172.21.15.47:0/2784411455 >> v1:172.21.15.117:6789/0 conn(0x7fd23c0ca8f0 legacy=0x7fd23c0c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23be00700 1 -- 172.21.15.47:0/2784411455 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0c5340 con 0x7fd23c0c6d90 2024-05-10T04:52:12.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23be00700 1 --2- 172.21.15.47:0/2784411455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0c6d90 0x7fd23c155ef0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0098f0 tx=0x7fd22c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06343baa85cb51e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23aa00700 1 -- 172.21.15.47:0/2784411455 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011830 con 0x7fd23c0c6d90 2024-05-10T04:52:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23aa00700 1 -- 172.21.15.47:0/2784411455 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd22c011990 con 0x7fd23c0c6d90 2024-05-10T04:52:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.183+0000 7fd23aa00700 1 -- 172.21.15.47:0/2784411455 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22c011d20 con 0x7fd23c0c6d90 2024-05-10T04:52:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 -- 172.21.15.47:0/2784411455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0c6d90 msgr2=0x7fd23c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 --2- 172.21.15.47:0/2784411455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0c6d90 0x7fd23c155ef0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0098f0 tx=0x7fd22c009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 -- 172.21.15.47:0/2784411455 shutdown_connections 2024-05-10T04:52:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 --2- 172.21.15.47:0/2784411455 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0cad00 0x7fd23c0c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 --2- 172.21.15.47:0/2784411455 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0c6d90 0x7fd23c155ef0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 -- 172.21.15.47:0/2784411455 >> 172.21.15.47:0/2784411455 conn(0x7fd23c0c7620 msgr2=0x7fd23c0c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 -- 172.21.15.47:0/2784411455 shutdown_connections 2024-05-10T04:52:12.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.184+0000 7fd243200700 1 -- 172.21.15.47:0/2784411455 wait complete. 2024-05-10T04:52:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.186+0000 7fd243200700 1 Processor -- start 2024-05-10T04:52:12.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.186+0000 7fd243200700 1 -- start start 2024-05-10T04:52:12.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd243200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c6d90 0x7fd23c0c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd243200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 0x7fd23c0c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd243200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0cad00 0x7fd23c1542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd243200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c156840 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd243200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c159480 con 0x7fd23c0cad00 2024-05-10T04:52:12.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd243200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c1ebc50 con 0x7fd23c0c6d90 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd23b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 0x7fd23c0c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd23b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 0x7fd23c0c18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49908/0 (socket says 172.21.15.47:49908) 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd23b400700 1 -- 172.21.15.47:0/525567485 learned_addr learned my addr 172.21.15.47:0/525567485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd23be00700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c6d90 0x7fd23c0c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.188+0000 7fd241200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0cad00 0x7fd23c1542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd23b400700 1 -- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c6d90 msgr2=0x7fd23c0c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd23b400700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c6d90 0x7fd23c0c0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd23b400700 1 -- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0cad00 msgr2=0x7fd23c1542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd23b400700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0cad00 0x7fd23c1542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd23b400700 1 -- 172.21.15.47:0/525567485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c009550 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd241200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0cad00 0x7fd23c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd23b400700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 0x7fd23c0c18b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c430 tx=0x7fd22800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280052d0 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd228005430 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c1569b0 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2280038c0 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.189+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c158750 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.191+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c074720 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.192+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd228003a20 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.192+0000 7fd233e00700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd21c06acc0 0x7fd21c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.193+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd228057bc0 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.193+0000 7fd23be00700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd21c06acc0 0x7fd21c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.194+0000 7fd23be00700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd21c06acc0 0x7fd21c06d1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0098f0 tx=0x7fd22c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.199 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.198+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd228053800 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.410+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd23c06dba0 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.412 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.410+0000 7fd233e00700 1 -- 172.21.15.47:0/525567485 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd228017070 con 0x7fd23c0ca8f0 2024-05-10T04:52:12.412 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd21c06acc0 msgr2=0x7fd21c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd21c06acc0 0x7fd21c06d1d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0098f0 tx=0x7fd22c008030 comp rx=0 tx=0).stop 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 msgr2=0x7fd23c0c18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 0x7fd23c0c18b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd22800c430 tx=0x7fd22800c740 comp rx=0 tx=0).stop 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 shutdown_connections 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd23c0cad00 0x7fd23c1542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd21c06acc0 0x7fd21c06d1d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd23c0c6d90 0x7fd23c0c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 --2- 172.21.15.47:0/525567485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd23c0ca8f0 0x7fd23c0c18b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 >> 172.21.15.47:0/525567485 conn(0x7fd23c0c7620 msgr2=0x7fd23c14a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 shutdown_connections 2024-05-10T04:52:12.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.413+0000 7fd243200700 1 -- 172.21.15.47:0/525567485 wait complete. 2024-05-10T04:52:12.439 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T04:52:12.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.711+0000 7f6386200700 1 Processor -- start 2024-05-10T04:52:12.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.712+0000 7f6386200700 1 -- start start 2024-05-10T04:52:12.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.713+0000 7f6386200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6380158bb0 0x7f638006e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.713+0000 7f6386200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f638006f2b0 con 0x7f638006abf0 2024-05-10T04:52:12.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.713+0000 7f6386200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63800c0e50 con 0x7f638006ed60 2024-05-10T04:52:12.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.713+0000 7f6386200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f638006fee0 con 0x7f6380158bb0 2024-05-10T04:52:12.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.713+0000 7f637fe00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f638006abf0 0x7f638015ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54674/0 (socket says 172.21.15.47:54674) 2024-05-10T04:52:12.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637fe00700 1 -- 172.21.15.47:0/4001540826 learned_addr learned my addr 172.21.15.47:0/4001540826 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637f400700 1 --2- 172.21.15.47:0/4001540826 >> v2:172.21.15.47:3300/0 conn(0x7f6380158bb0 0x7f638006e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158502718 0 0) 0x7f638006f2b0 con 0x7f638006abf0 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63640035b0 con 0x7f638006abf0 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734098971 0 0) 0x7f63800c0e50 con 0x7f638006ed60 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f638006f2b0 con 0x7f638006ed60 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637f400700 1 -- 172.21.15.47:0/4001540826 >> v1:172.21.15.117:6789/0 conn(0x7f638006ed60 legacy=0x7f6380155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637f400700 1 -- 172.21.15.47:0/4001540826 >> v1:172.21.15.47:6789/0 conn(0x7f638006abf0 legacy=0x7f638015ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637f400700 1 -- 172.21.15.47:0/4001540826 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638006f500 con 0x7f6380158bb0 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.714+0000 7f637f400700 1 --2- 172.21.15.47:0/4001540826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f638006e680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6370009840 tx=0x7f6370009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb999777d2ec04e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370011830 con 0x7f6380158bb0 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6370011990 con 0x7f6380158bb0 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f637ea00700 1 -- 172.21.15.47:0/4001540826 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6370011d20 con 0x7f6380158bb0 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f6386200700 1 -- 172.21.15.47:0/4001540826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 msgr2=0x7f638006e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f6386200700 1 --2- 172.21.15.47:0/4001540826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f638006e680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6370009840 tx=0x7f6370009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:12.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f6386200700 1 -- 172.21.15.47:0/4001540826 shutdown_connections 2024-05-10T04:52:12.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.715+0000 7f6386200700 1 --2- 172.21.15.47:0/4001540826 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f638006e680 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.716+0000 7f6386200700 1 -- 172.21.15.47:0/4001540826 >> 172.21.15.47:0/4001540826 conn(0x7f638006c330 msgr2=0x7f63800a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:12.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.716+0000 7f6386200700 1 -- 172.21.15.47:0/4001540826 shutdown_connections 2024-05-10T04:52:12.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.716+0000 7f6386200700 1 -- 172.21.15.47:0/4001540826 wait complete. 2024-05-10T04:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.718+0000 7f6386200700 1 Processor -- start 2024-05-10T04:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.718+0000 7f6386200700 1 -- start start 2024-05-10T04:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.719+0000 7f6386200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638006abf0 0x7f638014ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.719+0000 7f6386200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638006ed60 0x7f63801ef120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.719+0000 7f6386200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f63801ebae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.719+0000 7f6386200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638006fac0 con 0x7f6380158bb0 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.719+0000 7f6386200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63801eb850 con 0x7f638006ed60 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.719+0000 7f6386200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63800a8d60 con 0x7f638006abf0 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f63801ebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f63801ebae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49934/0 (socket says 172.21.15.47:49934) 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 -- 172.21.15.47:0/276941167 learned_addr learned my addr 172.21.15.47:0/276941167 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637f400700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638006abf0 0x7f638014ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f6377e00700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638006ed60 0x7f63801ef120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 -- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638006abf0 msgr2=0x7f638014ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638006abf0 0x7f638014ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 -- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638006ed60 msgr2=0x7f63801ef120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638006ed60 0x7f63801ef120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 -- 172.21.15.47:0/276941167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700094a0 con 0x7f6380158bb0 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f6377e00700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638006ed60 0x7f63801ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.720+0000 7f637fe00700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f63801ebae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f637800cb10 tx=0x7f637800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.721+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637800ab00 con 0x7f6380158bb0 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.721+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637800ac60 con 0x7f6380158bb0 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.721+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378012400 con 0x7f6380158bb0 2024-05-10T04:52:12.726 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.721+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638014bf20 con 0x7f6380158bb0 2024-05-10T04:52:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.721+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63800a9590 con 0x7f6380158bb0 2024-05-10T04:52:12.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.722+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63801eea80 con 0x7f6380158bb0 2024-05-10T04:52:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.723+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f637801b3b0 con 0x7f6380158bb0 2024-05-10T04:52:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.724+0000 7f6377400700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f635c06ac90 0x7f635c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:12.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.724+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63780891c0 con 0x7f6380158bb0 2024-05-10T04:52:12.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.724+0000 7f637f400700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f635c06ac90 0x7f635c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:12.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.725+0000 7f637f400700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f635c06ac90 0x7f635c06d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6370009fd0 tx=0x7f637001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:12.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.729+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f63780541f0 con 0x7f6380158bb0 2024-05-10T04:52:12.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.944+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6380074720 con 0x7f6380158bb0 2024-05-10T04:52:12.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.944+0000 7f6377400700 1 -- 172.21.15.47:0/276941167 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6378057810 con 0x7f6380158bb0 2024-05-10T04:52:12.946 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f635c06ac90 msgr2=0x7f635c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f635c06ac90 0x7f635c06d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6370009fd0 tx=0x7f637001c040 comp rx=0 tx=0).stop 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 msgr2=0x7f63801ebae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f63801ebae0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f637800cb10 tx=0x7f637800ced0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 shutdown_connections 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6380158bb0 0x7f63801ebae0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f635c06ac90 0x7f635c06d1a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f638006abf0 0x7f638014ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 --2- 172.21.15.47:0/276941167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f638006ed60 0x7f63801ef120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:12.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 >> 172.21.15.47:0/276941167 conn(0x7f638006c330 msgr2=0x7f63800c6450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:12.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 shutdown_connections 2024-05-10T04:52:12.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:12.947+0000 7f6386200700 1 -- 172.21.15.47:0/276941167 wait complete. 2024-05-10T04:52:12.973 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:52:13.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.247+0000 7fcb13000700 1 Processor -- start 2024-05-10T04:52:13.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.247+0000 7fcb13000700 1 -- start start 2024-05-10T04:52:13.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.248+0000 7fcb13000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c06ded0 0x7fcb0c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.248+0000 7fcb13000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb0c1570b0 0x7fcb0c0c2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.248+0000 7fcb13000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb0c06e4b0 con 0x7fcb0c0c2410 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.248+0000 7fcb13000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0c0c2d60 con 0x7fcb0c1570b0 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.248+0000 7fcb13000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c0aa1d0 con 0x7fcb0c06ded0 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb0c1570b0 0x7fcb0c0c2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcb0c1570b0 0x7fcb0c0c2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49944/0 (socket says 172.21.15.47:49944) 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 -- 172.21.15.47:0/2618432613 learned_addr learned my addr 172.21.15.47:0/2618432613 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb0b400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fcb0c0c2410 0x7fcb0c1569a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54682/0 (socket says 172.21.15.47:54682) 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb0be00700 1 --2- 172.21.15.47:0/2618432613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c06ded0 0x7fcb0c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 -- 172.21.15.47:0/2618432613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c06ded0 msgr2=0x7fcb0c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 --2- 172.21.15.47:0/2618432613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c06ded0 0x7fcb0c1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 -- 172.21.15.47:0/2618432613 >> v1:172.21.15.47:6789/0 conn(0x7fcb0c0c2410 legacy=0x7fcb0c1569a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 -- 172.21.15.47:0/2618432613 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0c1534c0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.249+0000 7fcb11000700 1 --2- 172.21.15.47:0/2618432613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c0c2820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009e50 tx=0x7fcb0400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7972c2bd54d50819 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb0aa00700 1 -- 172.21.15.47:0/2618432613 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400e070 con 0x7fcb0c1570b0 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb0aa00700 1 -- 172.21.15.47:0/2618432613 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0400b9c0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb0aa00700 1 -- 172.21.15.47:0/2618432613 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0400bd70 con 0x7fcb0c1570b0 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb13000700 1 -- 172.21.15.47:0/2618432613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 msgr2=0x7fcb0c0c2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb13000700 1 --2- 172.21.15.47:0/2618432613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c0c2820 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009e50 tx=0x7fcb0400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb13000700 1 -- 172.21.15.47:0/2618432613 shutdown_connections 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb13000700 1 --2- 172.21.15.47:0/2618432613 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c0c2820 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.250+0000 7fcb13000700 1 --2- 172.21.15.47:0/2618432613 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c06ded0 0x7fcb0c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.251+0000 7fcb13000700 1 -- 172.21.15.47:0/2618432613 >> 172.21.15.47:0/2618432613 conn(0x7fcb0c0a8ae0 msgr2=0x7fcb0c0a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.251+0000 7fcb13000700 1 -- 172.21.15.47:0/2618432613 shutdown_connections 2024-05-10T04:52:13.253 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.251+0000 7fcb13000700 1 -- 172.21.15.47:0/2618432613 wait complete. 2024-05-10T04:52:13.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.253+0000 7fcb13000700 1 Processor -- start 2024-05-10T04:52:13.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.253+0000 7fcb13000700 1 -- start start 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.254+0000 7fcb13000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c06ded0 0x7fcb0c0bfcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.254+0000 7fcb13000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c2410 0x7fcb0c071600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.254+0000 7fcb13000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.254+0000 7fcb13000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c072570 con 0x7fcb0c1570b0 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.254+0000 7fcb13000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c1ebca0 con 0x7fcb0c06ded0 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.254+0000 7fcb13000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0c070e90 con 0x7fcb0c0c2410 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c155b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49946/0 (socket says 172.21.15.47:49946) 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb0b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c2410 0x7fcb0c071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 -- 172.21.15.47:0/2511324203 learned_addr learned my addr 172.21.15.47:0/2511324203 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb0be00700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c06ded0 0x7fcb0c0bfcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 -- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c2410 msgr2=0x7fcb0c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.257 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c2410 0x7fcb0c071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 -- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c06ded0 msgr2=0x7fcb0c0bfcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c06ded0 0x7fcb0c0bfcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 -- 172.21.15.47:0/2511324203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04009b30 con 0x7fcb0c1570b0 2024-05-10T04:52:13.258 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.255+0000 7fcb11000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c155b90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb04012000 tx=0x7fcb04004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.256+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04003ea0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.256+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb040048e0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.256+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0401c680 con 0x7fcb0c1570b0 2024-05-10T04:52:13.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.256+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb0c071170 con 0x7fcb0c1570b0 2024-05-10T04:52:13.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.256+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb0c072a60 con 0x7fcb0c1570b0 2024-05-10T04:52:13.259 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.257+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb0c074720 con 0x7fcb0c1570b0 2024-05-10T04:52:13.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.258+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcb0401c7e0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.259+0000 7fcb03e00700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaec06acc0 0x7fcaec06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.260 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.259+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb0408b0f0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.259+0000 7fcb0be00700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaec06acc0 0x7fcaec06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.261 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.260+0000 7fcb0be00700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaec06acc0 0x7fcaec06d1d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0c3060 tx=0x7fcafc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.265 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.264+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcb04055fd0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.491+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb0c06f3e0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.492+0000 7fcb03e00700 1 -- 172.21.15.47:0/2511324203 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb040595f0 con 0x7fcb0c1570b0 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaec06acc0 msgr2=0x7fcaec06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaec06acc0 0x7fcaec06d1d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0c3060 tx=0x7fcafc008040 comp rx=0 tx=0).stop 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 msgr2=0x7fcb0c155b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c155b90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcb04012000 tx=0x7fcb04004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 shutdown_connections 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcb0c1570b0 0x7fcb0c155b90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcb0c06ded0 0x7fcb0c0bfcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaec06acc0 0x7fcaec06d1d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 --2- 172.21.15.47:0/2511324203 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcb0c0c2410 0x7fcb0c071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 >> 172.21.15.47:0/2511324203 conn(0x7fcb0c0a8ae0 msgr2=0x7fcb0c0c6840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:13.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 shutdown_connections 2024-05-10T04:52:13.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.494+0000 7fcb13000700 1 -- 172.21.15.47:0/2511324203 wait complete. 2024-05-10T04:52:13.497 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-10T04:52:13.520 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-05-10T04:52:13.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:13.520 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-10T04:52:13.584 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi047.stderr:ceph-fuse[49447]: fuse finished with error 0 and tester_r 0 2024-05-10T04:52:13.588 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:52:13.638 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:52:13.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:13.639 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-10T04:52:13.696 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:13.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.963+0000 7efde5c00700 1 Processor -- start 2024-05-10T04:52:13.965 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.963+0000 7efde5c00700 1 -- start start 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.964+0000 7efde5c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efde00c9440 0x7efde0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.964+0000 7efde5c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efde0159050 0x7efde015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efde5c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde006c7c0 con 0x7efde00c5c40 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efde5c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde006d060 con 0x7efde00c9440 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efde5c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde0159890 con 0x7efde0159050 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efdde000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efde00c9440 0x7efde0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efddea00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efde00c5c40 0x7efde00c8d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54690/0 (socket says 172.21.15.47:54690) 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efdde000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efde00c9440 0x7efde0158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49962/0 (socket says 172.21.15.47:49962) 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efddea00700 1 -- 172.21.15.47:0/3104113656 learned_addr learned my addr 172.21.15.47:0/3104113656 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:13.974 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efddf400700 1 --2- 172.21.15.47:0/3104113656 >> v2:172.21.15.117:3300/0 conn(0x7efde0159050 0x7efde015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efdde000700 1 -- 172.21.15.47:0/3104113656 >> v2:172.21.15.117:3300/0 conn(0x7efde0159050 msgr2=0x7efde015fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efdde000700 1 --2- 172.21.15.47:0/3104113656 >> v2:172.21.15.117:3300/0 conn(0x7efde0159050 0x7efde015fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efdde000700 1 -- 172.21.15.47:0/3104113656 >> v1:172.21.15.47:6789/0 conn(0x7efde00c5c40 legacy=0x7efde00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efdde000700 1 -- 172.21.15.47:0/3104113656 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde006ca10 con 0x7efde00c9440 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.965+0000 7efddd600700 1 -- 172.21.15.47:0/3104113656 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108973866 0 0) 0x7efde006c7c0 con 0x7efde00c5c40 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.966+0000 7efdde000700 1 --2- 172.21.15.47:0/3104113656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde00c9440 0x7efde0158b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efde01566b0 tx=0x7efdcc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9598b23be15a9e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.966+0000 7efddd600700 1 -- 172.21.15.47:0/3104113656 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc011830 con 0x7efde00c9440 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.966+0000 7efddd600700 1 -- 172.21.15.47:0/3104113656 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc011990 con 0x7efde00c9440 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.966+0000 7efddd600700 1 -- 172.21.15.47:0/3104113656 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc011d20 con 0x7efde00c9440 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.966+0000 7efde5c00700 1 -- 172.21.15.47:0/3104113656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde00c9440 msgr2=0x7efde0158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.966+0000 7efde5c00700 1 --2- 172.21.15.47:0/3104113656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde00c9440 0x7efde0158b10 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7efde01566b0 tx=0x7efdcc009b20 comp rx=0 tx=0).stop 2024-05-10T04:52:13.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.967+0000 7efde5c00700 1 -- 172.21.15.47:0/3104113656 shutdown_connections 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.967+0000 7efde5c00700 1 --2- 172.21.15.47:0/3104113656 >> v2:172.21.15.117:3300/0 conn(0x7efde0159050 0x7efde015fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.967+0000 7efde5c00700 1 --2- 172.21.15.47:0/3104113656 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde00c9440 0x7efde0158b10 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.967+0000 7efde5c00700 1 -- 172.21.15.47:0/3104113656 >> 172.21.15.47:0/3104113656 conn(0x7efde00ca940 msgr2=0x7efde00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.967+0000 7efde5c00700 1 -- 172.21.15.47:0/3104113656 shutdown_connections 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.967+0000 7efde5c00700 1 -- 172.21.15.47:0/3104113656 wait complete. 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.969+0000 7efde5c00700 1 Processor -- start 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.969+0000 7efde5c00700 1 -- start start 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.970+0000 7efde5c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efde00c5c40 0x7efde01ee530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.970+0000 7efde5c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efde00c9440 0x7efde00c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.970+0000 7efde5c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 0x7efde01544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.970+0000 7efde5c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0148a30 con 0x7efde0159050 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.970+0000 7efde5c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde00c3440 con 0x7efde00c9440 2024-05-10T04:52:13.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.970+0000 7efde5c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde00c4c60 con 0x7efde00c5c40 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 0x7efde01544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efdde000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efde00c9440 0x7efde00c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 0x7efde01544f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49966/0 (socket says 172.21.15.47:49966) 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 -- 172.21.15.47:0/4042949957 learned_addr learned my addr 172.21.15.47:0/4042949957 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddea00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efde00c5c40 0x7efde01ee530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 -- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efde00c5c40 msgr2=0x7efde01ee530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efde00c5c40 0x7efde01ee530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 -- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efde00c9440 msgr2=0x7efde00c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efde00c9440 0x7efde00c2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 -- 172.21.15.47:0/4042949957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0094a0 con 0x7efde0159050 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efddf400700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 0x7efde01544f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efdd800efc0 tx=0x7efdd8009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.971+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8009b20 con 0x7efde0159050 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.972+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd800f040 con 0x7efde0159050 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.972+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd800cd20 con 0x7efde0159050 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.972+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde0155ae0 con 0x7efde0159050 2024-05-10T04:52:13.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.972+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde00c4eb0 con 0x7efde0159050 2024-05-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.973+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde0074720 con 0x7efde0159050 2024-05-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.974+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efdd8014480 con 0x7efde0159050 2024-05-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.975+0000 7efdd6a00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efdc006ac90 0x7efdc006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.975+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efdd808a170 con 0x7efde0159050 2024-05-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.975+0000 7efddea00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efdc006ac90 0x7efdc006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:13.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.976+0000 7efddea00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efdc006ac90 0x7efdc006d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdd0000f60 tx=0x7efdd0007c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:13.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:13.979+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efdd8054fc0 con 0x7efde0159050 2024-05-10T04:52:14.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.194+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efde00c8b10 con 0x7efde0159050 2024-05-10T04:52:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.196+0000 7efdd6a00700 1 -- 172.21.15.47:0/4042949957 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7efdd80585e0 con 0x7efde0159050 2024-05-10T04:52:14.198 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:14.198 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efdc006ac90 msgr2=0x7efdc006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efdc006ac90 0x7efdc006d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efdd0000f60 tx=0x7efdd0007c90 comp rx=0 tx=0).stop 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 msgr2=0x7efde01544f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 0x7efde01544f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efdd800efc0 tx=0x7efdd8009f60 comp rx=0 tx=0).stop 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 shutdown_connections 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efde0159050 0x7efde01544f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efdc006ac90 0x7efdc006d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efde00c5c40 0x7efde01ee530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 --2- 172.21.15.47:0/4042949957 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efde00c9440 0x7efde00c2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 >> 172.21.15.47:0/4042949957 conn(0x7efde00ca940 msgr2=0x7efde00c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 shutdown_connections 2024-05-10T04:52:14.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.199+0000 7efde5c00700 1 -- 172.21.15.47:0/4042949957 wait complete. 2024-05-10T04:52:14.230 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:14.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.496+0000 7f7be7600700 1 Processor -- start 2024-05-10T04:52:14.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.496+0000 7f7be7600700 1 -- start start 2024-05-10T04:52:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be7600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0159220 0x7f7be0160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be7600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be006c7c0 con 0x7f7be00c5c40 2024-05-10T04:52:14.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be7600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be006d060 con 0x7f7be00c9440 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be7600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0159630 con 0x7f7be0159220 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be4c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f7be00c5c40 0x7f7be00c8d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54698/0 (socket says 172.21.15.47:54698) 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be4c00700 1 -- 172.21.15.47:0/2349081215 learned_addr learned my addr 172.21.15.47:0/2349081215 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7be5600700 1 --2- 172.21.15.47:0/2349081215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0159220 0x7f7be0160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 537167393 0 0) 0x7f7be006c7c0 con 0x7f7be00c5c40 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.497+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bc80035b0 con 0x7f7be00c5c40 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932707455 0 0) 0x7f7be006d060 con 0x7f7be00c9440 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be006c7c0 con 0x7f7be00c9440 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792004983 0 0) 0x7f7bc80035b0 con 0x7f7be00c5c40 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7be5600700 1 -- 172.21.15.47:0/2349081215 >> v1:172.21.15.117:6789/0 conn(0x7f7be00c9440 legacy=0x7f7be0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7be5600700 1 -- 172.21.15.47:0/2349081215 >> v1:172.21.15.47:6789/0 conn(0x7f7be00c5c40 legacy=0x7f7be00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7be5600700 1 -- 172.21.15.47:0/2349081215 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be0159890 con 0x7f7be0159220 2024-05-10T04:52:14.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7be5600700 1 --2- 172.21.15.47:0/2349081215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0159220 0x7f7be0160e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009dc0 tx=0x7f7bd800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b69d4771450eed1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800e070 con 0x7f7be0159220 2024-05-10T04:52:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd8003a20 con 0x7f7be0159220 2024-05-10T04:52:14.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.498+0000 7f7bdf400700 1 -- 172.21.15.47:0/2349081215 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4001670 con 0x7f7be0159220 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 -- 172.21.15.47:0/2349081215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0159220 msgr2=0x7f7be0160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 --2- 172.21.15.47:0/2349081215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0159220 0x7f7be0160e50 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8009dc0 tx=0x7f7bd800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 -- 172.21.15.47:0/2349081215 shutdown_connections 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 --2- 172.21.15.47:0/2349081215 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be0159220 0x7f7be0160e50 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 -- 172.21.15.47:0/2349081215 >> 172.21.15.47:0/2349081215 conn(0x7f7be00ca940 msgr2=0x7f7be00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 -- 172.21.15.47:0/2349081215 shutdown_connections 2024-05-10T04:52:14.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.499+0000 7f7be7600700 1 -- 172.21.15.47:0/2349081215 wait complete. 2024-05-10T04:52:14.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.502+0000 7f7be7600700 1 Processor -- start 2024-05-10T04:52:14.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.502+0000 7f7be7600700 1 -- start start 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be7600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 0x7f7be00c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be7600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be00c9440 0x7f7be01ef0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be7600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0159220 0x7f7be01539e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be7600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0153620 con 0x7f7be00c5c40 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be7600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0154730 con 0x7f7be0159220 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be7600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be0155220 con 0x7f7be00c9440 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be4c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 0x7f7be00c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be4c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 0x7f7be00c3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49968/0 (socket says 172.21.15.47:49968) 2024-05-10T04:52:14.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.503+0000 7f7be4c00700 1 -- 172.21.15.47:0/1500753905 learned_addr learned my addr 172.21.15.47:0/1500753905 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be5600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0159220 0x7f7be01539e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7bdfe00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be00c9440 0x7f7be01ef0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be4c00700 1 -- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be00c9440 msgr2=0x7f7be01ef0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be4c00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be00c9440 0x7f7be01ef0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be4c00700 1 -- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0159220 msgr2=0x7f7be01539e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be4c00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0159220 0x7f7be01539e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be4c00700 1 -- 172.21.15.47:0/1500753905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd8009a70 con 0x7f7be00c5c40 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7bdfe00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be00c9440 0x7f7be01ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be4c00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 0x7f7be00c3da0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c500 tx=0x7f7bd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4004c80 con 0x7f7be00c5c40 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4004de0 con 0x7f7be00c5c40 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd40072f0 con 0x7f7be00c5c40 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.504+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be0153410 con 0x7f7be00c5c40 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.505+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be0154c60 con 0x7f7be00c5c40 2024-05-10T04:52:14.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.505+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be01eef40 con 0x7f7be00c5c40 2024-05-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.507+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bd4007450 con 0x7f7be00c5c40 2024-05-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.507+0000 7f7bdcc00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7bc006ac90 0x7f7bc006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.508+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7bd4089450 con 0x7f7be00c5c40 2024-05-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.508+0000 7f7bdfe00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7bc006ac90 0x7f7bc006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:14.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.509+0000 7f7bdfe00700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7bc006ac90 0x7f7bc006d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7be00c0c20 tx=0x7f7bcc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:14.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.512+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7bd40542a0 con 0x7f7be00c5c40 2024-05-10T04:52:14.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.729+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7be0074720 con 0x7f7be00c5c40 2024-05-10T04:52:14.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.730+0000 7f7bdcc00700 1 -- 172.21.15.47:0/1500753905 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f7bd40578c0 con 0x7f7be00c5c40 2024-05-10T04:52:14.732 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:14.732 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7bc006ac90 msgr2=0x7f7bc006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7bc006ac90 0x7f7bc006d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7be00c0c20 tx=0x7f7bcc009040 comp rx=0 tx=0).stop 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 msgr2=0x7f7be00c3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 0x7f7be00c3da0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bd400c500 tx=0x7f7bd400c8c0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 shutdown_connections 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7be0159220 0x7f7be01539e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7be00c5c40 0x7f7be00c3da0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f7bc006ac90 0x7f7bc006d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 --2- 172.21.15.47:0/1500753905 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7be00c9440 0x7f7be01ef0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 >> 172.21.15.47:0/1500753905 conn(0x7f7be00ca940 msgr2=0x7f7be00c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 shutdown_connections 2024-05-10T04:52:14.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:14.733+0000 7f7be7600700 1 -- 172.21.15.47:0/1500753905 wait complete. 2024-05-10T04:52:14.759 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.029+0000 7fd1e0000700 1 Processor -- start 2024-05-10T04:52:15.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.030+0000 7fd1e0000700 1 -- start start 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1e0000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd1d80c6cc0 0x7fd1d8152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1e0000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c5cf0 0x7fd1d80c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1e0000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd1d80c92d0 0x7fd1d806bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1e0000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d806d640 con 0x7fd1d80c6cc0 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1e0000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d80c6100 con 0x7fd1d80c92d0 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1e0000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c9800 con 0x7fd1d80c5cf0 2024-05-10T04:52:15.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1dd600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd1d80c6cc0 0x7fd1d8152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1dd600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd1d80c6cc0 0x7fd1d8152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49970/0 (socket says 172.21.15.47:49970) 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.031+0000 7fd1dd600700 1 -- 172.21.15.47:0/1804478412 learned_addr learned my addr 172.21.15.47:0/1804478412 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dcc00700 1 --2- 172.21.15.47:0/1804478412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c5cf0 0x7fd1d80c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1de000700 1 --2- 172.21.15.47:0/1804478412 >> v2:172.21.15.117:3300/0 conn(0x7fd1d80c92d0 0x7fd1d806bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dd600700 1 -- 172.21.15.47:0/1804478412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c5cf0 msgr2=0x7fd1d80c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dd600700 1 --2- 172.21.15.47:0/1804478412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c5cf0 0x7fd1d80c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dd600700 1 -- 172.21.15.47:0/1804478412 >> v2:172.21.15.117:3300/0 conn(0x7fd1d80c92d0 msgr2=0x7fd1d806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dd600700 1 --2- 172.21.15.47:0/1804478412 >> v2:172.21.15.117:3300/0 conn(0x7fd1d80c92d0 0x7fd1d806bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dd600700 1 -- 172.21.15.47:0/1804478412 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d80c8910 con 0x7fd1d80c6cc0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1dd600700 1 --2- 172.21.15.47:0/1804478412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c6cc0 0x7fd1d8152bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80c19c0 tx=0x7fd1cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f5bcf098ba1462 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1d7e00700 1 -- 172.21.15.47:0/1804478412 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00b870 con 0x7fd1d80c6cc0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.032+0000 7fd1d7e00700 1 -- 172.21.15.47:0/1804478412 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1cc00b9d0 con 0x7fd1d80c6cc0 2024-05-10T04:52:15.035 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1d7e00700 1 -- 172.21.15.47:0/1804478412 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc00bd60 con 0x7fd1d80c6cc0 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 -- 172.21.15.47:0/1804478412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c6cc0 msgr2=0x7fd1d8152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 --2- 172.21.15.47:0/1804478412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c6cc0 0x7fd1d8152bb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd1d80c19c0 tx=0x7fd1cc009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 -- 172.21.15.47:0/1804478412 shutdown_connections 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 --2- 172.21.15.47:0/1804478412 >> v2:172.21.15.117:3300/0 conn(0x7fd1d80c92d0 0x7fd1d806bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 --2- 172.21.15.47:0/1804478412 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c6cc0 0x7fd1d8152bb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 --2- 172.21.15.47:0/1804478412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c5cf0 0x7fd1d80c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 -- 172.21.15.47:0/1804478412 >> 172.21.15.47:0/1804478412 conn(0x7fd1d80ca960 msgr2=0x7fd1d80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 -- 172.21.15.47:0/1804478412 shutdown_connections 2024-05-10T04:52:15.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.033+0000 7fd1e0000700 1 -- 172.21.15.47:0/1804478412 wait complete. 2024-05-10T04:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.035+0000 7fd1e0000700 1 Processor -- start 2024-05-10T04:52:15.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.036+0000 7fd1e0000700 1 -- start start 2024-05-10T04:52:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1e0000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1d80c5cf0 0x7fd1d81ebc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1e0000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c6cc0 0x7fd1d80c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1e0000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 0x7fd1d8155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1e0000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d81eb810 con 0x7fd1d80c92d0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1e0000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80bfbc0 con 0x7fd1d80c5cf0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1e0000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d80c20f0 con 0x7fd1d80c6cc0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1de000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 0x7fd1d8155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1de000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 0x7fd1d8155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:49982/0 (socket says 172.21.15.47:49982) 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1de000700 1 -- 172.21.15.47:0/772256564 learned_addr learned my addr 172.21.15.47:0/772256564 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1dd600700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1d80c5cf0 0x7fd1d81ebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.037+0000 7fd1dcc00700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c6cc0 0x7fd1d80c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1de000700 1 -- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c6cc0 msgr2=0x7fd1d80c4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1de000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c6cc0 0x7fd1d80c4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1de000700 1 -- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1d80c5cf0 msgr2=0x7fd1d81ebc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1de000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1d80c5cf0 0x7fd1d81ebc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1de000700 1 -- 172.21.15.47:0/772256564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1cc009550 con 0x7fd1d80c92d0 2024-05-10T04:52:15.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1de000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 0x7fd1d8155700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009fd0 tx=0x7fd1d000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0007ea0 con 0x7fd1d80c92d0 2024-05-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d000ed30 con 0x7fd1d80c92d0 2024-05-10T04:52:15.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d80c3b30 con 0x7fd1d80c92d0 2024-05-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.038+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d000eea0 con 0x7fd1d80c92d0 2024-05-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.039+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d80c3df0 con 0x7fd1d80c92d0 2024-05-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.040+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d80c4cc0 con 0x7fd1d80c92d0 2024-05-10T04:52:15.041 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.041+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd1d0014660 con 0x7fd1d80c92d0 2024-05-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.042+0000 7fd1d5600700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd1b806ac90 0x7fd1b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:15.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.042+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd1d0089cd0 con 0x7fd1d80c92d0 2024-05-10T04:52:15.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.043+0000 7fd1dd600700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd1b806ac90 0x7fd1b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:15.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.043+0000 7fd1dd600700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd1b806ac90 0x7fd1b806d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc014040 tx=0x7fd1cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:15.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.047+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd1d0054b20 con 0x7fd1d80c92d0 2024-05-10T04:52:15.310 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:15.309+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd1d8074720 con 0x7fd1d80c92d0 2024-05-10T04:52:16.213 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.212+0000 7fd1d5600700 1 -- 172.21.15.47:0/772256564 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd1d0058140 con 0x7fd1d80c92d0 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd1b806ac90 msgr2=0x7fd1b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd1b806ac90 0x7fd1b806d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc014040 tx=0x7fd1cc008030 comp rx=0 tx=0).stop 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 msgr2=0x7fd1d8155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 0x7fd1d8155700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009fd0 tx=0x7fd1d000e3c0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 shutdown_connections 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd1d80c92d0 0x7fd1d8155700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd1d80c5cf0 0x7fd1d81ebc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd1b806ac90 0x7fd1b806d1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 --2- 172.21.15.47:0/772256564 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd1d80c6cc0 0x7fd1d80c4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 >> 172.21.15.47:0/772256564 conn(0x7fd1d80ca960 msgr2=0x7fd1d8152010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 shutdown_connections 2024-05-10T04:52:16.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.216+0000 7fd1e0000700 1 -- 172.21.15.47:0/772256564 wait complete. 2024-05-10T04:52:16.245 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-05-10T04:52:16.245 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-10T04:52:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.520+0000 7f8b68c00700 1 Processor -- start 2024-05-10T04:52:16.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.520+0000 7f8b68c00700 1 -- start start 2024-05-10T04:52:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b68c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b64152bb0 0x7f8b640c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b68c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b6406d640 con 0x7f8b640c6cc0 2024-05-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b68c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b640c9800 con 0x7f8b6406bdb0 2024-05-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b68c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b64152fc0 con 0x7f8b64152bb0 2024-05-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b61400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8b64152bb0 0x7f8b640c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b61e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8b640c6cc0 0x7f8b640c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54710/0 (socket says 172.21.15.47:54710) 2024-05-10T04:52:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b61e00700 1 -- 172.21.15.47:0/592262500 learned_addr learned my addr 172.21.15.47:0/592262500 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b61400700 1 -- 172.21.15.47:0/592262500 >> v1:172.21.15.117:6789/0 conn(0x7f8b6406bdb0 legacy=0x7f8b6406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b61400700 1 -- 172.21.15.47:0/592262500 >> v1:172.21.15.47:6789/0 conn(0x7f8b640c6cc0 legacy=0x7f8b640c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.522+0000 7f8b61400700 1 -- 172.21.15.47:0/592262500 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b640c8910 con 0x7f8b64152bb0 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.523+0000 7f8b61400700 1 --2- 172.21.15.47:0/592262500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b640c5cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009840 tx=0x7f8b50009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c123b7ce9b6523cb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.523+0000 7f8b60a00700 1 -- 172.21.15.47:0/592262500 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011830 con 0x7f8b64152bb0 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.523+0000 7f8b60a00700 1 -- 172.21.15.47:0/592262500 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b50011990 con 0x7f8b64152bb0 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.523+0000 7f8b60a00700 1 -- 172.21.15.47:0/592262500 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b50011d20 con 0x7f8b64152bb0 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 -- 172.21.15.47:0/592262500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 msgr2=0x7f8b640c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 --2- 172.21.15.47:0/592262500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b640c5cf0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009840 tx=0x7f8b50009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 -- 172.21.15.47:0/592262500 shutdown_connections 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 --2- 172.21.15.47:0/592262500 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b640c5cf0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 -- 172.21.15.47:0/592262500 >> 172.21.15.47:0/592262500 conn(0x7f8b640ca960 msgr2=0x7f8b640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 -- 172.21.15.47:0/592262500 shutdown_connections 2024-05-10T04:52:16.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.524+0000 7f8b68c00700 1 -- 172.21.15.47:0/592262500 wait complete. 2024-05-10T04:52:16.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.526+0000 7f8b68c00700 1 Processor -- start 2024-05-10T04:52:16.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.526+0000 7f8b68c00700 1 -- start start 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b68c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b6406bdb0 0x7f8b6414af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b68c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640c6cc0 0x7f8b6414d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b68c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b641eb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b68c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b640c36c0 con 0x7f8b64152bb0 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b68c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b641eb1a0 con 0x7f8b6406bdb0 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b68c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b64153350 con 0x7f8b640c6cc0 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b62800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b641eb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b62800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b641eb5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50002/0 (socket says 172.21.15.47:50002) 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b62800700 1 -- 172.21.15.47:0/673594064 learned_addr learned my addr 172.21.15.47:0/673594064 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b61e00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b6406bdb0 0x7f8b6414af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:16.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.528+0000 7f8b61400700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640c6cc0 0x7f8b6414d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b62800700 1 -- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640c6cc0 msgr2=0x7f8b6414d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b62800700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640c6cc0 0x7f8b6414d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b62800700 1 -- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b6406bdb0 msgr2=0x7f8b6414af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b62800700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b6406bdb0 0x7f8b6414af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b62800700 1 -- 172.21.15.47:0/673594064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500094a0 con 0x7f8b64152bb0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b62800700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b641eb5f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00cb50 tx=0x7f8b5c00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c003c00 con 0x7f8b64152bb0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c003d60 con 0x7f8b64152bb0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c00a9c0 con 0x7f8b64152bb0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b640c4830 con 0x7f8b64152bb0 2024-05-10T04:52:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.529+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b640c4a70 con 0x7f8b64152bb0 2024-05-10T04:52:16.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.530+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b64154f60 con 0x7f8b64152bb0 2024-05-10T04:52:16.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.531+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b5c00ab20 con 0x7f8b64152bb0 2024-05-10T04:52:16.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.532+0000 7f8b5a000700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8b4406acc0 0x7f8b4406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:16.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.532+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b5c089530 con 0x7f8b64152bb0 2024-05-10T04:52:16.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.533+0000 7f8b61e00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8b4406acc0 0x7f8b4406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:16.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.533+0000 7f8b61e00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8b4406acc0 0x7f8b4406d1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005910 tx=0x7f8b54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:16.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.537+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8b5c054410 con 0x7f8b64152bb0 2024-05-10T04:52:16.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:16.802+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8b64074720 con 0x7f8b64152bb0 2024-05-10T04:52:17.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.219+0000 7f8b5a000700 1 -- 172.21.15.47:0/673594064 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b5c057a30 con 0x7f8b64152bb0 2024-05-10T04:52:17.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8b4406acc0 msgr2=0x7f8b4406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8b4406acc0 0x7f8b4406d1d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8b54005910 tx=0x7f8b54009040 comp rx=0 tx=0).stop 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 msgr2=0x7f8b641eb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b641eb5f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00cb50 tx=0x7f8b5c00ce60 comp rx=0 tx=0).stop 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 shutdown_connections 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8b64152bb0 0x7f8b641eb5f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8b6406bdb0 0x7f8b6414af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8b4406acc0 0x7f8b4406d1d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.221+0000 7f8b68c00700 1 --2- 172.21.15.47:0/673594064 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8b640c6cc0 0x7f8b6414d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.222+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 >> 172.21.15.47:0/673594064 conn(0x7f8b640ca960 msgr2=0x7f8b64151300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.222+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 shutdown_connections 2024-05-10T04:52:17.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.222+0000 7f8b68c00700 1 -- 172.21.15.47:0/673594064 wait complete. 2024-05-10T04:52:17.252 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-10T04:52:17.252 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.522+0000 7f9b8ce00700 1 Processor -- start 2024-05-10T04:52:17.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.522+0000 7f9b8ce00700 1 -- start start 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b8ce00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9b88158fe0 0x7f9b881529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b8ce00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c8ba0 0x7f9b880c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b8ce00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b8806cbd0 con 0x7f9b880c5a00 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b8ce00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b881593f0 con 0x7f9b88158fe0 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b8ce00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880ca500 con 0x7f9b880c8ba0 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b86a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9b88158fe0 0x7f9b881529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b86a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9b88158fe0 0x7f9b881529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50012/0 (socket says 172.21.15.47:50012) 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b86a00700 1 -- 172.21.15.47:0/2972800399 learned_addr learned my addr 172.21.15.47:0/2972800399 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.524+0000 7f9b87e00700 1 --2- 172.21.15.47:0/2972800399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c8ba0 0x7f9b880c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86a00700 1 -- 172.21.15.47:0/2972800399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c8ba0 msgr2=0x7f9b880c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86a00700 1 --2- 172.21.15.47:0/2972800399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c8ba0 0x7f9b880c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86a00700 1 -- 172.21.15.47:0/2972800399 >> v1:172.21.15.117:6789/0 conn(0x7f9b880c5a00 legacy=0x7f9b881588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86a00700 1 -- 172.21.15.47:0/2972800399 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b88159660 con 0x7f9b88158fe0 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86a00700 1 --2- 172.21.15.47:0/2972800399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b881529e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b740098f0 tx=0x7f9b74009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89c69ba07541c08 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86000700 1 -- 172.21.15.47:0/2972800399 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b74004230 con 0x7f9b88158fe0 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86000700 1 -- 172.21.15.47:0/2972800399 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b74004390 con 0x7f9b88158fe0 2024-05-10T04:52:17.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.525+0000 7f9b86000700 1 -- 172.21.15.47:0/2972800399 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b740036a0 con 0x7f9b88158fe0 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 -- 172.21.15.47:0/2972800399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 msgr2=0x7f9b881529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/2972800399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b881529e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9b740098f0 tx=0x7f9b74009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 -- 172.21.15.47:0/2972800399 shutdown_connections 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/2972800399 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c8ba0 0x7f9b880c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/2972800399 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b881529e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 -- 172.21.15.47:0/2972800399 >> 172.21.15.47:0/2972800399 conn(0x7f9b880ca700 msgr2=0x7f9b880cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 -- 172.21.15.47:0/2972800399 shutdown_connections 2024-05-10T04:52:17.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.526+0000 7f9b8ce00700 1 -- 172.21.15.47:0/2972800399 wait complete. 2024-05-10T04:52:17.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.528+0000 7f9b8ce00700 1 Processor -- start 2024-05-10T04:52:17.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.528+0000 7f9b8ce00700 1 -- start start 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b8ce00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c5a00 0x7f9b8814d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b8ce00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b880c8ba0 0x7f9b8814ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b8ce00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b88150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b8ce00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b88156790 con 0x7f9b88158fe0 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b8ce00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881ebb90 con 0x7f9b880c8ba0 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b8ce00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881ec0c0 con 0x7f9b880c5a00 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b88150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c5a00 0x7f9b8814d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b88150c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50020/0 (socket says 172.21.15.47:50020) 2024-05-10T04:52:17.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 -- 172.21.15.47:0/40117316 learned_addr learned my addr 172.21.15.47:0/40117316 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b86a00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b880c8ba0 0x7f9b8814ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 -- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c5a00 msgr2=0x7f9b8814d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c5a00 0x7f9b8814d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 -- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b880c8ba0 msgr2=0x7f9b8814ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b880c8ba0 0x7f9b8814ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.530+0000 7f9b87e00700 1 -- 172.21.15.47:0/40117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b74009550 con 0x7f9b88158fe0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.531+0000 7f9b87e00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b88150c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007d70 tx=0x7f9b8000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.531+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8000ed30 con 0x7f9b88158fe0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.531+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8000eeb0 con 0x7f9b88158fe0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.531+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b88150800 con 0x7f9b88158fe0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.531+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b80014640 con 0x7f9b88158fe0 2024-05-10T04:52:17.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.531+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b881ebde0 con 0x7f9b88158fe0 2024-05-10T04:52:17.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.532+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88074720 con 0x7f9b88158fe0 2024-05-10T04:52:17.534 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.533+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b800147a0 con 0x7f9b88158fe0 2024-05-10T04:52:17.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.535+0000 7f9b7f400700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b6806acc0 0x7f9b6806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:17.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.535+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9b80089c30 con 0x7f9b88158fe0 2024-05-10T04:52:17.535 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.535+0000 7f9b87400700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b6806acc0 0x7f9b6806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:17.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.536+0000 7f9b87400700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b6806acc0 0x7f9b6806d1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009960 tx=0x7f9b780090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:17.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.540+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9b80054a80 con 0x7f9b88158fe0 2024-05-10T04:52:17.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.796+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b8814fe60 con 0x7f9b88158fe0 2024-05-10T04:52:17.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.797+0000 7f9b7f400700 1 -- 172.21.15.47:0/40117316 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f9b800580a0 con 0x7f9b88158fe0 2024-05-10T04:52:17.798 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:17.798 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:52:17.211312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:52:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b6806acc0 msgr2=0x7f9b6806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b6806acc0 0x7f9b6806d1d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b78009960 tx=0x7f9b780090e0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 msgr2=0x7f9b88150c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b88150c90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9b80007d70 tx=0x7f9b8000e3c0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 shutdown_connections 2024-05-10T04:52:17.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b88158fe0 0x7f9b88150c90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b6806acc0 0x7f9b6806d1d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b880c5a00 0x7f9b8814d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 --2- 172.21.15.47:0/40117316 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b880c8ba0 0x7f9b8814ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.799+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 >> 172.21.15.47:0/40117316 conn(0x7f9b880ca700 msgr2=0x7f9b880c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.800+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 shutdown_connections 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:17.800+0000 7f9b8ce00700 1 -- 172.21.15.47:0/40117316 wait complete. 2024-05-10T04:52:17.801 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-10T04:52:17.826 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:18.096 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.096+0000 7feb55e00700 1 Processor -- start 2024-05-10T04:52:18.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.096+0000 7feb55e00700 1 -- start start 2024-05-10T04:52:18.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb55e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50152b50 0x7feb50160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb55e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb50156570 con 0x7feb500c49e0 2024-05-10T04:52:18.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb55e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb500c1940 con 0x7feb50156160 2024-05-10T04:52:18.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb55e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb500c2e20 con 0x7feb50152b50 2024-05-10T04:52:18.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb4ea00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7feb500c49e0 0x7feb500c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54726/0 (socket says 172.21.15.47:54726) 2024-05-10T04:52:18.099 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb4ea00700 1 -- 172.21.15.47:0/2153886325 learned_addr learned my addr 172.21.15.47:0/2153886325 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb4f400700 1 --2- 172.21.15.47:0/2153886325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50152b50 0x7feb50160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.098+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4184800072 0 0) 0x7feb40001110 con 0x7feb500c49e0 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb340035b0 con 0x7feb500c49e0 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 960150636 0 0) 0x7feb500c1940 con 0x7feb50156160 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb40001110 con 0x7feb50156160 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1154943058 0 0) 0x7feb340035b0 con 0x7feb500c49e0 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4f400700 1 -- 172.21.15.47:0/2153886325 >> v1:172.21.15.117:6789/0 conn(0x7feb50156160 legacy=0x7feb5006cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4f400700 1 -- 172.21.15.47:0/2153886325 >> v1:172.21.15.47:6789/0 conn(0x7feb500c49e0 legacy=0x7feb500c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.100 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4f400700 1 -- 172.21.15.47:0/2153886325 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500c5ae0 con 0x7feb50152b50 2024-05-10T04:52:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4f400700 1 --2- 172.21.15.47:0/2153886325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50152b50 0x7feb50160ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb48009dc0 tx=0x7feb4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b5f27451a9a4852 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.099+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4800e070 con 0x7feb50152b50 2024-05-10T04:52:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb48003a20 con 0x7feb50152b50 2024-05-10T04:52:18.101 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb4d600700 1 -- 172.21.15.47:0/2153886325 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40001800 con 0x7feb50152b50 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 -- 172.21.15.47:0/2153886325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50152b50 msgr2=0x7feb50160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 --2- 172.21.15.47:0/2153886325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50152b50 0x7feb50160ee0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feb48009dc0 tx=0x7feb4800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 -- 172.21.15.47:0/2153886325 shutdown_connections 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 --2- 172.21.15.47:0/2153886325 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50152b50 0x7feb50160ee0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 -- 172.21.15.47:0/2153886325 >> 172.21.15.47:0/2153886325 conn(0x7feb500cac30 msgr2=0x7feb500cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 -- 172.21.15.47:0/2153886325 shutdown_connections 2024-05-10T04:52:18.102 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.100+0000 7feb55e00700 1 -- 172.21.15.47:0/2153886325 wait complete. 2024-05-10T04:52:18.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.102+0000 7feb55e00700 1 Processor -- start 2024-05-10T04:52:18.103 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.103+0000 7feb55e00700 1 -- start start 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb55e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 0x7feb500c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb55e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb50152b50 0x7feb501eb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb55e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50156160 0x7feb501474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb55e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb501503b0 con 0x7feb500c49e0 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb55e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb501ec140 con 0x7feb50152b50 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb55e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb501eb1e0 con 0x7feb50156160 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb4ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 0x7feb500c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb4ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 0x7feb500c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50028/0 (socket says 172.21.15.47:50028) 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb4ea00700 1 -- 172.21.15.47:0/2135944232 learned_addr learned my addr 172.21.15.47:0/2135944232 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb4f400700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50156160 0x7feb501474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.106 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.104+0000 7feb4e000700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb50152b50 0x7feb501eb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb4ea00700 1 -- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50156160 msgr2=0x7feb501474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb4ea00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50156160 0x7feb501474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb4ea00700 1 -- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb50152b50 msgr2=0x7feb501eb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb4ea00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb50152b50 0x7feb501eb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb4ea00700 1 -- 172.21.15.47:0/2135944232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48009a70 con 0x7feb500c49e0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb4ea00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 0x7feb500c8800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb40001370 tx=0x7feb4000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40004c80 con 0x7feb500c49e0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb40004e00 con 0x7feb500c49e0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb500ca600 con 0x7feb500c49e0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40007310 con 0x7feb500c49e0 2024-05-10T04:52:18.107 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.105+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb500c95d0 con 0x7feb500c49e0 2024-05-10T04:52:18.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.107+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb501eb530 con 0x7feb500c49e0 2024-05-10T04:52:18.108 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.107+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb40007470 con 0x7feb500c49e0 2024-05-10T04:52:18.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.108+0000 7feb47400700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb3006acc0 0x7feb3006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.108+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb40089260 con 0x7feb500c49e0 2024-05-10T04:52:18.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.109+0000 7feb4e000700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb3006acc0 0x7feb3006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.109+0000 7feb4e000700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb3006acc0 0x7feb3006d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb501e2ca0 tx=0x7feb3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.113+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feb400540b0 con 0x7feb500c49e0 2024-05-10T04:52:18.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.332+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb500c9430 con 0x7feb500c49e0 2024-05-10T04:52:18.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.333+0000 7feb47400700 1 -- 172.21.15.47:0/2135944232 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7feb500c9430 con 0x7feb500c49e0 2024-05-10T04:52:18.334 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:18.334 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:18.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.335+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb3006acc0 msgr2=0x7feb3006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.335+0000 7feb55e00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb3006acc0 0x7feb3006d1d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7feb501e2ca0 tx=0x7feb3c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.335+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 msgr2=0x7feb500c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.335+0000 7feb55e00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 0x7feb500c8800 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb40001370 tx=0x7feb4000ca30 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 shutdown_connections 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb3006acc0 0x7feb3006d1d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb50156160 0x7feb501474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb500c49e0 0x7feb500c8800 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 --2- 172.21.15.47:0/2135944232 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb50152b50 0x7feb501eb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 >> 172.21.15.47:0/2135944232 conn(0x7feb500cac30 msgr2=0x7feb500bf970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 shutdown_connections 2024-05-10T04:52:18.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.336+0000 7feb55e00700 1 -- 172.21.15.47:0/2135944232 wait complete. 2024-05-10T04:52:18.362 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-05-10T04:52:18.362 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.629+0000 7fa47ca00700 1 Processor -- start 2024-05-10T04:52:18.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.630+0000 7fa47ca00700 1 -- start start 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.631+0000 7fa47ca00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa4780c2860 0x7fa47814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.631+0000 7fa47ca00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478152680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.631+0000 7fa47ca00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4780c2dd0 con 0x7fa478071040 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.631+0000 7fa47ca00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4780aaf10 con 0x7fa4780c2860 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.631+0000 7fa47ca00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4780ab1f0 con 0x7fa478152270 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.631+0000 7fa475e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa4780c2860 0x7fa47814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa4780c2860 0x7fa47814c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50038/0 (socket says 172.21.15.47:50038) 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 -- 172.21.15.47:0/3756284689 learned_addr learned my addr 172.21.15.47:0/3756284689 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:18.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa476800700 1 --2- 172.21.15.47:0/3756284689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 -- 172.21.15.47:0/3756284689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 msgr2=0x7fa478152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 --2- 172.21.15.47:0/3756284689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 -- 172.21.15.47:0/3756284689 >> v1:172.21.15.117:6789/0 conn(0x7fa478071040 legacy=0x7fa4780c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 -- 172.21.15.47:0/3756284689 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4780ab4d0 con 0x7fa4780c2860 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475e00700 1 --2- 172.21.15.47:0/3756284689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4780c2860 0x7fa47814c3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa4680098f0 tx=0x7fa468009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b594ae4f930369 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.632+0000 7fa475400700 1 -- 172.21.15.47:0/3756284689 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468004230 con 0x7fa4780c2860 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa475400700 1 -- 172.21.15.47:0/3756284689 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa468004390 con 0x7fa4780c2860 2024-05-10T04:52:18.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa475400700 1 -- 172.21.15.47:0/3756284689 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4680036a0 con 0x7fa4780c2860 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 -- 172.21.15.47:0/3756284689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4780c2860 msgr2=0x7fa47814c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 --2- 172.21.15.47:0/3756284689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4780c2860 0x7fa47814c3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa4680098f0 tx=0x7fa468009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 -- 172.21.15.47:0/3756284689 shutdown_connections 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 --2- 172.21.15.47:0/3756284689 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 --2- 172.21.15.47:0/3756284689 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa4780c2860 0x7fa47814c3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 -- 172.21.15.47:0/3756284689 >> 172.21.15.47:0/3756284689 conn(0x7fa47806ae30 msgr2=0x7fa47806b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 -- 172.21.15.47:0/3756284689 shutdown_connections 2024-05-10T04:52:18.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.633+0000 7fa47ca00700 1 -- 172.21.15.47:0/3756284689 wait complete. 2024-05-10T04:52:18.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.636+0000 7fa47ca00700 1 Processor -- start 2024-05-10T04:52:18.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.636+0000 7fa47ca00700 1 -- start start 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa47ca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 0x7fa4781562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa47ca00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780c2860 0x7fa4780c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa47ca00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa47ca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4781eedf0 con 0x7fa478071040 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa47ca00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa47814ea40 con 0x7fa4780c2860 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa47ca00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa47814f250 con 0x7fa478152270 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa475e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 0x7fa4781562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa475e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 0x7fa4781562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50050/0 (socket says 172.21.15.47:50050) 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa475e00700 1 -- 172.21.15.47:0/760285128 learned_addr learned my addr 172.21.15.47:0/760285128 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.637+0000 7fa476800700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa46fe00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780c2860 0x7fa4780c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa475e00700 1 -- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 msgr2=0x7fa478153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa475e00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa475e00700 1 -- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780c2860 msgr2=0x7fa4780c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa475e00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780c2860 0x7fa4780c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa475e00700 1 -- 172.21.15.47:0/760285128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa468009550 con 0x7fa478071040 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa475e00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 0x7fa4781562c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa4780c2d00 tx=0x7fa468004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa468003d70 con 0x7fa478071040 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46800b660 con 0x7fa478071040 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa47814ec90 con 0x7fa478071040 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.638+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46800ba10 con 0x7fa478071040 2024-05-10T04:52:18.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.639+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa478155ac0 con 0x7fa478071040 2024-05-10T04:52:18.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.640+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa47814e870 con 0x7fa478071040 2024-05-10T04:52:18.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.641+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa46800bb70 con 0x7fa478071040 2024-05-10T04:52:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.642+0000 7fa46e000700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa45406acc0 0x7fa45406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.642+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa46808adf0 con 0x7fa478071040 2024-05-10T04:52:18.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.642+0000 7fa46fe00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa45406acc0 0x7fa45406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:18.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.643+0000 7fa46fe00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa45406acc0 0x7fa45406d1d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4600078e0 tx=0x7fa460007870 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:18.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.646+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa468055cd0 con 0x7fa478071040 2024-05-10T04:52:18.860 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.858+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa478071450 con 0x7fa45406acc0 2024-05-10T04:52:18.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.871+0000 7fa46e000700 1 -- 172.21.15.47:0/760285128 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345344 (secure 0 0 0) 0x7fa460001540 con 0x7fa45406acc0 2024-05-10T04:52:18.880 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:18.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa45406acc0 msgr2=0x7fa45406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa45406acc0 0x7fa45406d1d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa4600078e0 tx=0x7fa460007870 comp rx=0 tx=0).stop 2024-05-10T04:52:18.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 msgr2=0x7fa4781562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:18.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 0x7fa4781562c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa4780c2d00 tx=0x7fa468004750 comp rx=0 tx=0).stop 2024-05-10T04:52:18.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 shutdown_connections 2024-05-10T04:52:18.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa45406acc0 0x7fa45406d1d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa478152270 0x7fa478153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa478071040 0x7fa4781562c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 --2- 172.21.15.47:0/760285128 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa4780c2860 0x7fa4780c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 >> 172.21.15.47:0/760285128 conn(0x7fa47806ae30 msgr2=0x7fa4781db8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 shutdown_connections 2024-05-10T04:52:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:18.877+0000 7fa47ca00700 1 -- 172.21.15.47:0/760285128 wait complete. 2024-05-10T04:52:18.887 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T04:52:18.904 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-05-10T04:52:17.159457+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235916,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738804,"statfs":{"total":773094113280,"available":772852535296,"internally_reserved":0,"allocated":3448832,"data_stored":2051623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003739"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219600+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T04:51:57.219600+0000","last_peered":"2024-05-10T04:51:57.219600+0000","last_clean":"2024-05-10T04:51:57.219600+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T04:51:57.219600+0000","last_undegraded":"2024-05-10T04:51:57.219600+0000","last_fullsized":"2024-05-10T04:51:57.219600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174451+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T04:51:57.174451+0000","last_peered":"2024-05-10T04:51:57.174451+0000","last_clean":"2024-05-10T04:51:57.174451+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T04:51:57.174451+0000","last_undegraded":"2024-05-10T04:51:57.174451+0000","last_fullsized":"2024-05-10T04:51:57.174451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142131+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T04:51:57.142131+0000","last_peered":"2024-05-10T04:51:57.142131+0000","last_clean":"2024-05-10T04:51:57.142131+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T04:51:57.142131+0000","last_undegraded":"2024-05-10T04:51:57.142131+0000","last_fullsized":"2024-05-10T04:51:57.142131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159614+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T04:51:57.159614+0000","last_peered":"2024-05-10T04:51:57.159614+0000","last_clean":"2024-05-10T04:51:57.159614+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T04:51:57.159614+0000","last_undegraded":"2024-05-10T04:51:57.159614+0000","last_fullsized":"2024-05-10T04:51:57.159614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215270+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T04:51:57.215270+0000","last_peered":"2024-05-10T04:51:57.215270+0000","last_clean":"2024-05-10T04:51:57.215270+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T04:51:57.215270+0000","last_undegraded":"2024-05-10T04:51:57.215270+0000","last_fullsized":"2024-05-10T04:51:57.215270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158970+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T04:51:57.158970+0000","last_peered":"2024-05-10T04:51:57.158970+0000","last_clean":"2024-05-10T04:51:57.158970+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T04:51:57.158970+0000","last_undegraded":"2024-05-10T04:51:57.158970+0000","last_fullsized":"2024-05-10T04:51:57.158970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219056+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T04:51:57.219056+0000","last_peered":"2024-05-10T04:51:57.219056+0000","last_clean":"2024-05-10T04:51:57.219056+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T04:51:57.219056+0000","last_undegraded":"2024-05-10T04:51:57.219056+0000","last_fullsized":"2024-05-10T04:51:57.219056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165516+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T04:51:57.165516+0000","last_peered":"2024-05-10T04:51:57.165516+0000","last_clean":"2024-05-10T04:51:57.165516+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T04:51:57.165516+0000","last_undegraded":"2024-05-10T04:51:57.165516+0000","last_fullsized":"2024-05-10T04:51:57.165516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219499+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T04:51:57.219499+0000","last_peered":"2024-05-10T04:51:57.219499+0000","last_clean":"2024-05-10T04:51:57.219499+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T04:51:57.219499+0000","last_undegraded":"2024-05-10T04:51:57.219499+0000","last_fullsized":"2024-05-10T04:51:57.219499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148505+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T04:51:57.148505+0000","last_peered":"2024-05-10T04:51:57.148505+0000","last_clean":"2024-05-10T04:51:57.148505+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T04:51:57.148505+0000","last_undegraded":"2024-05-10T04:51:57.148505+0000","last_fullsized":"2024-05-10T04:51:57.148505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.147947+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T04:51:57.147947+0000","last_peered":"2024-05-10T04:51:57.147947+0000","last_clean":"2024-05-10T04:51:57.147947+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T04:51:57.147947+0000","last_undegraded":"2024-05-10T04:51:57.147947+0000","last_fullsized":"2024-05-10T04:51:57.147947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145857+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T04:51:57.145857+0000","last_peered":"2024-05-10T04:51:57.145857+0000","last_clean":"2024-05-10T04:51:57.145857+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T04:51:57.145857+0000","last_undegraded":"2024-05-10T04:51:57.145857+0000","last_fullsized":"2024-05-10T04:51:57.145857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169259+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T04:51:57.169259+0000","last_peered":"2024-05-10T04:51:57.169259+0000","last_clean":"2024-05-10T04:51:57.169259+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T04:51:57.169259+0000","last_undegraded":"2024-05-10T04:51:57.169259+0000","last_fullsized":"2024-05-10T04:51:57.169259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141852+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T04:51:57.141852+0000","last_peered":"2024-05-10T04:51:57.141852+0000","last_clean":"2024-05-10T04:51:57.141852+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T04:51:57.141852+0000","last_undegraded":"2024-05-10T04:51:57.141852+0000","last_fullsized":"2024-05-10T04:51:57.141852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173288+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T04:51:57.173288+0000","last_peered":"2024-05-10T04:51:57.173288+0000","last_clean":"2024-05-10T04:51:57.173288+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T04:51:57.173288+0000","last_undegraded":"2024-05-10T04:51:57.173288+0000","last_fullsized":"2024-05-10T04:51:57.173288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158567+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T04:51:57.158567+0000","last_peered":"2024-05-10T04:51:57.158567+0000","last_clean":"2024-05-10T04:51:57.158567+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T04:51:57.158567+0000","last_undegraded":"2024-05-10T04:51:57.158567+0000","last_fullsized":"2024-05-10T04:51:57.158567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160353+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T04:51:57.160353+0000","last_peered":"2024-05-10T04:51:57.160353+0000","last_clean":"2024-05-10T04:51:57.160353+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T04:51:57.160353+0000","last_undegraded":"2024-05-10T04:51:57.160353+0000","last_fullsized":"2024-05-10T04:51:57.160353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138643+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T04:51:57.138643+0000","last_peered":"2024-05-10T04:51:57.138643+0000","last_clean":"2024-05-10T04:51:57.138643+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T04:51:57.138643+0000","last_undegraded":"2024-05-10T04:51:57.138643+0000","last_fullsized":"2024-05-10T04:51:57.138643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.220600+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T04:51:57.220600+0000","last_peered":"2024-05-10T04:51:57.220600+0000","last_clean":"2024-05-10T04:51:57.220600+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T04:51:57.220600+0000","last_undegraded":"2024-05-10T04:51:57.220600+0000","last_fullsized":"2024-05-10T04:51:57.220600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138962+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T04:51:58.138962+0000","last_peered":"2024-05-10T04:51:58.138962+0000","last_clean":"2024-05-10T04:51:58.138962+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T04:51:58.138962+0000","last_undegraded":"2024-05-10T04:51:58.138962+0000","last_fullsized":"2024-05-10T04:51:58.138962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142910+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T04:51:57.142910+0000","last_peered":"2024-05-10T04:51:57.142910+0000","last_clean":"2024-05-10T04:51:57.142910+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T04:51:57.142910+0000","last_undegraded":"2024-05-10T04:51:57.142910+0000","last_fullsized":"2024-05-10T04:51:57.142910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171479+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T04:51:57.171479+0000","last_peered":"2024-05-10T04:51:57.171479+0000","last_clean":"2024-05-10T04:51:57.171479+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T04:51:57.171479+0000","last_undegraded":"2024-05-10T04:51:57.171479+0000","last_fullsized":"2024-05-10T04:51:57.171479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773136+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T04:51:57.773136+0000","last_peered":"2024-05-10T04:51:57.773136+0000","last_clean":"2024-05-10T04:51:57.773136+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T04:51:57.773136+0000","last_undegraded":"2024-05-10T04:51:57.773136+0000","last_fullsized":"2024-05-10T04:51:57.773136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171605+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T04:51:57.171605+0000","last_peered":"2024-05-10T04:51:57.171605+0000","last_clean":"2024-05-10T04:51:57.171605+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T04:51:57.171605+0000","last_undegraded":"2024-05-10T04:51:57.171605+0000","last_fullsized":"2024-05-10T04:51:57.171605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142772+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T04:51:57.142772+0000","last_peered":"2024-05-10T04:51:57.142772+0000","last_clean":"2024-05-10T04:51:57.142772+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T04:51:57.142772+0000","last_undegraded":"2024-05-10T04:51:57.142772+0000","last_fullsized":"2024-05-10T04:51:57.142772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773231+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T04:51:57.773231+0000","last_peered":"2024-05-10T04:51:57.773231+0000","last_clean":"2024-05-10T04:51:57.773231+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T04:51:57.773231+0000","last_undegraded":"2024-05-10T04:51:57.773231+0000","last_fullsized":"2024-05-10T04:51:57.773231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218564+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T04:51:57.218564+0000","last_peered":"2024-05-10T04:51:57.218564+0000","last_clean":"2024-05-10T04:51:57.218564+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T04:51:57.218564+0000","last_undegraded":"2024-05-10T04:51:57.218564+0000","last_fullsized":"2024-05-10T04:51:57.218564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159502+0000","last_change":"2024-05-10T04:51:52.757879+0000","last_active":"2024-05-10T04:51:57.159502+0000","last_peered":"2024-05-10T04:51:57.159502+0000","last_clean":"2024-05-10T04:51:57.159502+0000","last_became_active":"2024-05-10T04:51:52.757556+0000","last_became_peered":"2024-05-10T04:51:52.757556+0000","last_unstale":"2024-05-10T04:51:57.159502+0000","last_undegraded":"2024-05-10T04:51:57.159502+0000","last_fullsized":"2024-05-10T04:51:57.159502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:29.588613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.774138+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T04:51:57.774138+0000","last_peered":"2024-05-10T04:51:57.774138+0000","last_clean":"2024-05-10T04:51:57.774138+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T04:51:57.774138+0000","last_undegraded":"2024-05-10T04:51:57.774138+0000","last_fullsized":"2024-05-10T04:51:57.774138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217441+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T04:51:57.217441+0000","last_peered":"2024-05-10T04:51:57.217441+0000","last_clean":"2024-05-10T04:51:57.217441+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T04:51:57.217441+0000","last_undegraded":"2024-05-10T04:51:57.217441+0000","last_fullsized":"2024-05-10T04:51:57.217441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159784+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T04:51:57.159784+0000","last_peered":"2024-05-10T04:51:57.159784+0000","last_clean":"2024-05-10T04:51:57.159784+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T04:51:57.159784+0000","last_undegraded":"2024-05-10T04:51:57.159784+0000","last_fullsized":"2024-05-10T04:51:57.159784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139714+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T04:51:58.139714+0000","last_peered":"2024-05-10T04:51:58.139714+0000","last_clean":"2024-05-10T04:51:58.139714+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T04:51:58.139714+0000","last_undegraded":"2024-05-10T04:51:58.139714+0000","last_fullsized":"2024-05-10T04:51:58.139714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169375+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T04:51:57.169375+0000","last_peered":"2024-05-10T04:51:57.169375+0000","last_clean":"2024-05-10T04:51:57.169375+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T04:51:57.169375+0000","last_undegraded":"2024-05-10T04:51:57.169375+0000","last_fullsized":"2024-05-10T04:51:57.169375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144171+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T04:51:57.144171+0000","last_peered":"2024-05-10T04:51:57.144171+0000","last_clean":"2024-05-10T04:51:57.144171+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T04:51:57.144171+0000","last_undegraded":"2024-05-10T04:51:57.144171+0000","last_fullsized":"2024-05-10T04:51:57.144171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.770902+0000","last_change":"2024-05-10T04:51:57.175748+0000","last_active":"2024-05-10T04:51:57.770902+0000","last_peered":"2024-05-10T04:51:57.770902+0000","last_clean":"2024-05-10T04:51:57.770902+0000","last_became_active":"2024-05-10T04:51:57.175321+0000","last_became_peered":"2024-05-10T04:51:57.175321+0000","last_unstale":"2024-05-10T04:51:57.770902+0000","last_undegraded":"2024-05-10T04:51:57.770902+0000","last_fullsized":"2024-05-10T04:51:57.770902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:55.866371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146693+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T04:51:57.146693+0000","last_peered":"2024-05-10T04:51:57.146693+0000","last_clean":"2024-05-10T04:51:57.146693+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T04:51:57.146693+0000","last_undegraded":"2024-05-10T04:51:57.146693+0000","last_fullsized":"2024-05-10T04:51:57.146693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142418+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T04:51:57.142418+0000","last_peered":"2024-05-10T04:51:57.142418+0000","last_clean":"2024-05-10T04:51:57.142418+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T04:51:57.142418+0000","last_undegraded":"2024-05-10T04:51:57.142418+0000","last_fullsized":"2024-05-10T04:51:57.142418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773586+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T04:51:57.773586+0000","last_peered":"2024-05-10T04:51:57.773586+0000","last_clean":"2024-05-10T04:51:57.773586+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T04:51:57.773586+0000","last_undegraded":"2024-05-10T04:51:57.773586+0000","last_fullsized":"2024-05-10T04:51:57.773586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167516+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T04:51:57.167516+0000","last_peered":"2024-05-10T04:51:57.167516+0000","last_clean":"2024-05-10T04:51:57.167516+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T04:51:57.167516+0000","last_undegraded":"2024-05-10T04:51:57.167516+0000","last_fullsized":"2024-05-10T04:51:57.167516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165279+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T04:51:57.165279+0000","last_peered":"2024-05-10T04:51:57.165279+0000","last_clean":"2024-05-10T04:51:57.165279+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T04:51:57.165279+0000","last_undegraded":"2024-05-10T04:51:57.165279+0000","last_fullsized":"2024-05-10T04:51:57.165279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787071+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T04:51:57.787071+0000","last_peered":"2024-05-10T04:51:57.787071+0000","last_clean":"2024-05-10T04:51:57.787071+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T04:51:57.787071+0000","last_undegraded":"2024-05-10T04:51:57.787071+0000","last_fullsized":"2024-05-10T04:51:57.787071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158867+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T04:51:57.158867+0000","last_peered":"2024-05-10T04:51:57.158867+0000","last_clean":"2024-05-10T04:51:57.158867+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T04:51:57.158867+0000","last_undegraded":"2024-05-10T04:51:57.158867+0000","last_fullsized":"2024-05-10T04:51:57.158867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173508+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T04:51:57.173508+0000","last_peered":"2024-05-10T04:51:57.173508+0000","last_clean":"2024-05-10T04:51:57.173508+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T04:51:57.173508+0000","last_undegraded":"2024-05-10T04:51:57.173508+0000","last_fullsized":"2024-05-10T04:51:57.173508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138787+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T04:51:58.138787+0000","last_peered":"2024-05-10T04:51:58.138787+0000","last_clean":"2024-05-10T04:51:58.138787+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T04:51:58.138787+0000","last_undegraded":"2024-05-10T04:51:58.138787+0000","last_fullsized":"2024-05-10T04:51:58.138787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148696+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T04:51:57.148696+0000","last_peered":"2024-05-10T04:51:57.148696+0000","last_clean":"2024-05-10T04:51:57.148696+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T04:51:57.148696+0000","last_undegraded":"2024-05-10T04:51:57.148696+0000","last_fullsized":"2024-05-10T04:51:57.148696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160203+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T04:51:57.160203+0000","last_peered":"2024-05-10T04:51:57.160203+0000","last_clean":"2024-05-10T04:51:57.160203+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T04:51:57.160203+0000","last_undegraded":"2024-05-10T04:51:57.160203+0000","last_fullsized":"2024-05-10T04:51:57.160203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139616+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T04:51:58.139616+0000","last_peered":"2024-05-10T04:51:58.139616+0000","last_clean":"2024-05-10T04:51:58.139616+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T04:51:58.139616+0000","last_undegraded":"2024-05-10T04:51:58.139616+0000","last_fullsized":"2024-05-10T04:51:58.139616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160118+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T04:51:57.160118+0000","last_peered":"2024-05-10T04:51:57.160118+0000","last_clean":"2024-05-10T04:51:57.160118+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T04:51:57.160118+0000","last_undegraded":"2024-05-10T04:51:57.160118+0000","last_fullsized":"2024-05-10T04:51:57.160118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143146+0000","last_change":"2024-05-10T04:51:52.753381+0000","last_active":"2024-05-10T04:51:57.143146+0000","last_peered":"2024-05-10T04:51:57.143146+0000","last_clean":"2024-05-10T04:51:57.143146+0000","last_became_active":"2024-05-10T04:51:52.753069+0000","last_became_peered":"2024-05-10T04:51:52.753069+0000","last_unstale":"2024-05-10T04:51:57.143146+0000","last_undegraded":"2024-05-10T04:51:57.143146+0000","last_fullsized":"2024-05-10T04:51:57.143146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773410+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T04:51:57.773410+0000","last_peered":"2024-05-10T04:51:57.773410+0000","last_clean":"2024-05-10T04:51:57.773410+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T04:51:57.773410+0000","last_undegraded":"2024-05-10T04:51:57.773410+0000","last_fullsized":"2024-05-10T04:51:57.773410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174304+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T04:51:57.174304+0000","last_peered":"2024-05-10T04:51:57.174304+0000","last_clean":"2024-05-10T04:51:57.174304+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T04:51:57.174304+0000","last_undegraded":"2024-05-10T04:51:57.174304+0000","last_fullsized":"2024-05-10T04:51:57.174304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145744+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T04:51:57.145744+0000","last_peered":"2024-05-10T04:51:57.145744+0000","last_clean":"2024-05-10T04:51:57.145744+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T04:51:57.145744+0000","last_undegraded":"2024-05-10T04:51:57.145744+0000","last_fullsized":"2024-05-10T04:51:57.145744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139068+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T04:51:58.139068+0000","last_peered":"2024-05-10T04:51:58.139068+0000","last_clean":"2024-05-10T04:51:58.139068+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T04:51:58.139068+0000","last_undegraded":"2024-05-10T04:51:58.139068+0000","last_fullsized":"2024-05-10T04:51:58.139068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:52:13.587589+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T04:52:13.587589+0000","last_peered":"2024-05-10T04:52:13.587589+0000","last_clean":"2024-05-10T04:52:13.587589+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T04:52:13.587589+0000","last_undegraded":"2024-05-10T04:52:13.587589+0000","last_fullsized":"2024-05-10T04:52:13.587589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218710+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T04:51:57.218710+0000","last_peered":"2024-05-10T04:51:57.218710+0000","last_clean":"2024-05-10T04:51:57.218710+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T04:51:57.218710+0000","last_undegraded":"2024-05-10T04:51:57.218710+0000","last_fullsized":"2024-05-10T04:51:57.218710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140198+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T04:51:58.140198+0000","last_peered":"2024-05-10T04:51:58.140198+0000","last_clean":"2024-05-10T04:51:58.140198+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T04:51:58.140198+0000","last_undegraded":"2024-05-10T04:51:58.140198+0000","last_fullsized":"2024-05-10T04:51:58.140198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143030+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T04:51:57.143030+0000","last_peered":"2024-05-10T04:51:57.143030+0000","last_clean":"2024-05-10T04:51:57.143030+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T04:51:57.143030+0000","last_undegraded":"2024-05-10T04:51:57.143030+0000","last_fullsized":"2024-05-10T04:51:57.143030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141996+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T04:51:57.141996+0000","last_peered":"2024-05-10T04:51:57.141996+0000","last_clean":"2024-05-10T04:51:57.141996+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T04:51:57.141996+0000","last_undegraded":"2024-05-10T04:51:57.141996+0000","last_fullsized":"2024-05-10T04:51:57.141996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140050+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T04:51:58.140050+0000","last_peered":"2024-05-10T04:51:58.140050+0000","last_clean":"2024-05-10T04:51:58.140050+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T04:51:58.140050+0000","last_undegraded":"2024-05-10T04:51:58.140050+0000","last_fullsized":"2024-05-10T04:51:58.140050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158654+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T04:51:57.158654+0000","last_peered":"2024-05-10T04:51:57.158654+0000","last_clean":"2024-05-10T04:51:57.158654+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T04:51:57.158654+0000","last_undegraded":"2024-05-10T04:51:57.158654+0000","last_fullsized":"2024-05-10T04:51:57.158654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215369+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T04:51:57.215369+0000","last_peered":"2024-05-10T04:51:57.215369+0000","last_clean":"2024-05-10T04:51:57.215369+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T04:51:57.215369+0000","last_undegraded":"2024-05-10T04:51:57.215369+0000","last_fullsized":"2024-05-10T04:51:57.215369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140671+0000","last_change":"2024-05-10T04:51:57.220214+0000","last_active":"2024-05-10T04:51:58.140671+0000","last_peered":"2024-05-10T04:51:58.140671+0000","last_clean":"2024-05-10T04:51:58.140671+0000","last_became_active":"2024-05-10T04:51:57.219512+0000","last_became_peered":"2024-05-10T04:51:57.219512+0000","last_unstale":"2024-05-10T04:51:58.140671+0000","last_undegraded":"2024-05-10T04:51:58.140671+0000","last_fullsized":"2024-05-10T04:51:58.140671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:41.778039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148801+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T04:51:57.148801+0000","last_peered":"2024-05-10T04:51:57.148801+0000","last_clean":"2024-05-10T04:51:57.148801+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T04:51:57.148801+0000","last_undegraded":"2024-05-10T04:51:57.148801+0000","last_fullsized":"2024-05-10T04:51:57.148801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145710+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T04:51:57.145710+0000","last_peered":"2024-05-10T04:51:57.145710+0000","last_clean":"2024-05-10T04:51:57.145710+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T04:51:57.145710+0000","last_undegraded":"2024-05-10T04:51:57.145710+0000","last_fullsized":"2024-05-10T04:51:57.145710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786825+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T04:51:57.786825+0000","last_peered":"2024-05-10T04:51:57.786825+0000","last_clean":"2024-05-10T04:51:57.786825+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T04:51:57.786825+0000","last_undegraded":"2024-05-10T04:51:57.786825+0000","last_fullsized":"2024-05-10T04:51:57.786825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138766+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T04:51:57.138766+0000","last_peered":"2024-05-10T04:51:57.138766+0000","last_clean":"2024-05-10T04:51:57.138766+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T04:51:57.138766+0000","last_undegraded":"2024-05-10T04:51:57.138766+0000","last_fullsized":"2024-05-10T04:51:57.138766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217588+0000","last_change":"2024-05-10T04:51:52.773374+0000","last_active":"2024-05-10T04:51:57.217588+0000","last_peered":"2024-05-10T04:51:57.217588+0000","last_clean":"2024-05-10T04:51:57.217588+0000","last_became_active":"2024-05-10T04:51:52.773109+0000","last_became_peered":"2024-05-10T04:51:52.773109+0000","last_unstale":"2024-05-10T04:51:57.217588+0000","last_undegraded":"2024-05-10T04:51:57.217588+0000","last_fullsized":"2024-05-10T04:51:57.217588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:34.386904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773863+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T04:51:57.773863+0000","last_peered":"2024-05-10T04:51:57.773863+0000","last_clean":"2024-05-10T04:51:57.773863+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T04:51:57.773863+0000","last_undegraded":"2024-05-10T04:51:57.773863+0000","last_fullsized":"2024-05-10T04:51:57.773863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144228+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T04:51:57.144228+0000","last_peered":"2024-05-10T04:51:57.144228+0000","last_clean":"2024-05-10T04:51:57.144228+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T04:51:57.144228+0000","last_undegraded":"2024-05-10T04:51:57.144228+0000","last_fullsized":"2024-05-10T04:51:57.144228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218635+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T04:51:57.218635+0000","last_peered":"2024-05-10T04:51:57.218635+0000","last_clean":"2024-05-10T04:51:57.218635+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T04:51:57.218635+0000","last_undegraded":"2024-05-10T04:51:57.218635+0000","last_fullsized":"2024-05-10T04:51:57.218635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138952+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T04:51:58.138952+0000","last_peered":"2024-05-10T04:51:58.138952+0000","last_clean":"2024-05-10T04:51:58.138952+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T04:51:58.138952+0000","last_undegraded":"2024-05-10T04:51:58.138952+0000","last_fullsized":"2024-05-10T04:51:58.138952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173824+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T04:51:57.173824+0000","last_peered":"2024-05-10T04:51:57.173824+0000","last_clean":"2024-05-10T04:51:57.173824+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T04:51:57.173824+0000","last_undegraded":"2024-05-10T04:51:57.173824+0000","last_fullsized":"2024-05-10T04:51:57.173824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159946+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T04:51:57.159946+0000","last_peered":"2024-05-10T04:51:57.159946+0000","last_clean":"2024-05-10T04:51:57.159946+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T04:51:57.159946+0000","last_undegraded":"2024-05-10T04:51:57.159946+0000","last_fullsized":"2024-05-10T04:51:57.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138685+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T04:51:58.138685+0000","last_peered":"2024-05-10T04:51:58.138685+0000","last_clean":"2024-05-10T04:51:58.138685+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T04:51:58.138685+0000","last_undegraded":"2024-05-10T04:51:58.138685+0000","last_fullsized":"2024-05-10T04:51:58.138685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158550+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T04:51:57.158550+0000","last_peered":"2024-05-10T04:51:57.158550+0000","last_clean":"2024-05-10T04:51:57.158550+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T04:51:57.158550+0000","last_undegraded":"2024-05-10T04:51:57.158550+0000","last_fullsized":"2024-05-10T04:51:57.158550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145115+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T04:51:57.145115+0000","last_peered":"2024-05-10T04:51:57.145115+0000","last_clean":"2024-05-10T04:51:57.145115+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T04:51:57.145115+0000","last_undegraded":"2024-05-10T04:51:57.145115+0000","last_fullsized":"2024-05-10T04:51:57.145115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139840+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T04:51:58.139840+0000","last_peered":"2024-05-10T04:51:58.139840+0000","last_clean":"2024-05-10T04:51:58.139840+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T04:51:58.139840+0000","last_undegraded":"2024-05-10T04:51:58.139840+0000","last_fullsized":"2024-05-10T04:51:58.139840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173195+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T04:51:57.173195+0000","last_peered":"2024-05-10T04:51:57.173195+0000","last_clean":"2024-05-10T04:51:57.173195+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T04:51:57.173195+0000","last_undegraded":"2024-05-10T04:51:57.173195+0000","last_fullsized":"2024-05-10T04:51:57.173195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138457+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T04:51:57.138457+0000","last_peered":"2024-05-10T04:51:57.138457+0000","last_clean":"2024-05-10T04:51:57.138457+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T04:51:57.138457+0000","last_undegraded":"2024-05-10T04:51:57.138457+0000","last_fullsized":"2024-05-10T04:51:57.138457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772271+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T04:51:57.772271+0000","last_peered":"2024-05-10T04:51:57.772271+0000","last_clean":"2024-05-10T04:51:57.772271+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T04:51:57.772271+0000","last_undegraded":"2024-05-10T04:51:57.772271+0000","last_fullsized":"2024-05-10T04:51:57.772271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167290+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T04:51:57.167290+0000","last_peered":"2024-05-10T04:51:57.167290+0000","last_clean":"2024-05-10T04:51:57.167290+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T04:51:57.167290+0000","last_undegraded":"2024-05-10T04:51:57.167290+0000","last_fullsized":"2024-05-10T04:51:57.167290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158794+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T04:51:57.158794+0000","last_peered":"2024-05-10T04:51:57.158794+0000","last_clean":"2024-05-10T04:51:57.158794+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T04:51:57.158794+0000","last_undegraded":"2024-05-10T04:51:57.158794+0000","last_fullsized":"2024-05-10T04:51:57.158794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214929+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T04:51:57.214929+0000","last_peered":"2024-05-10T04:51:57.214929+0000","last_clean":"2024-05-10T04:51:57.214929+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T04:51:57.214929+0000","last_undegraded":"2024-05-10T04:51:57.214929+0000","last_fullsized":"2024-05-10T04:51:57.214929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786989+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T04:51:57.786989+0000","last_peered":"2024-05-10T04:51:57.786989+0000","last_clean":"2024-05-10T04:51:57.786989+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T04:51:57.786989+0000","last_undegraded":"2024-05-10T04:51:57.786989+0000","last_fullsized":"2024-05-10T04:51:57.786989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141828+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T04:51:57.141828+0000","last_peered":"2024-05-10T04:51:57.141828+0000","last_clean":"2024-05-10T04:51:57.141828+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T04:51:57.141828+0000","last_undegraded":"2024-05-10T04:51:57.141828+0000","last_fullsized":"2024-05-10T04:51:57.141828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215071+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T04:51:57.215071+0000","last_peered":"2024-05-10T04:51:57.215071+0000","last_clean":"2024-05-10T04:51:57.215071+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T04:51:57.215071+0000","last_undegraded":"2024-05-10T04:51:57.215071+0000","last_fullsized":"2024-05-10T04:51:57.215071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786742+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T04:51:57.786742+0000","last_peered":"2024-05-10T04:51:57.786742+0000","last_clean":"2024-05-10T04:51:57.786742+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T04:51:57.786742+0000","last_undegraded":"2024-05-10T04:51:57.786742+0000","last_fullsized":"2024-05-10T04:51:57.786742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218062+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T04:51:57.218062+0000","last_peered":"2024-05-10T04:51:57.218062+0000","last_clean":"2024-05-10T04:51:57.218062+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T04:51:57.218062+0000","last_undegraded":"2024-05-10T04:51:57.218062+0000","last_fullsized":"2024-05-10T04:51:57.218062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174509+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T04:51:57.174509+0000","last_peered":"2024-05-10T04:51:57.174509+0000","last_clean":"2024-05-10T04:51:57.174509+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T04:51:57.174509+0000","last_undegraded":"2024-05-10T04:51:57.174509+0000","last_fullsized":"2024-05-10T04:51:57.174509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138706+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T04:51:58.138706+0000","last_peered":"2024-05-10T04:51:58.138706+0000","last_clean":"2024-05-10T04:51:58.138706+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T04:51:58.138706+0000","last_undegraded":"2024-05-10T04:51:58.138706+0000","last_fullsized":"2024-05-10T04:51:58.138706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174200+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T04:51:57.174200+0000","last_peered":"2024-05-10T04:51:57.174200+0000","last_clean":"2024-05-10T04:51:57.174200+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T04:51:57.174200+0000","last_undegraded":"2024-05-10T04:51:57.174200+0000","last_fullsized":"2024-05-10T04:51:57.174200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172446+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T04:51:57.172446+0000","last_peered":"2024-05-10T04:51:57.172446+0000","last_clean":"2024-05-10T04:51:57.172446+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T04:51:57.172446+0000","last_undegraded":"2024-05-10T04:51:57.172446+0000","last_fullsized":"2024-05-10T04:51:57.172446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773872+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T04:51:57.773872+0000","last_peered":"2024-05-10T04:51:57.773872+0000","last_clean":"2024-05-10T04:51:57.773872+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T04:51:57.773872+0000","last_undegraded":"2024-05-10T04:51:57.773872+0000","last_fullsized":"2024-05-10T04:51:57.773872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148508+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T04:51:57.148508+0000","last_peered":"2024-05-10T04:51:57.148508+0000","last_clean":"2024-05-10T04:51:57.148508+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T04:51:57.148508+0000","last_undegraded":"2024-05-10T04:51:57.148508+0000","last_fullsized":"2024-05-10T04:51:57.148508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145749+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T04:51:57.145749+0000","last_peered":"2024-05-10T04:51:57.145749+0000","last_clean":"2024-05-10T04:51:57.145749+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T04:51:57.145749+0000","last_undegraded":"2024-05-10T04:51:57.145749+0000","last_fullsized":"2024-05-10T04:51:57.145749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773762+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T04:51:57.773762+0000","last_peered":"2024-05-10T04:51:57.773762+0000","last_clean":"2024-05-10T04:51:57.773762+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T04:51:57.773762+0000","last_undegraded":"2024-05-10T04:51:57.773762+0000","last_fullsized":"2024-05-10T04:51:57.773762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214825+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T04:51:57.214825+0000","last_peered":"2024-05-10T04:51:57.214825+0000","last_clean":"2024-05-10T04:51:57.214825+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T04:51:57.214825+0000","last_undegraded":"2024-05-10T04:51:57.214825+0000","last_fullsized":"2024-05-10T04:51:57.214825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144036+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T04:51:57.144036+0000","last_peered":"2024-05-10T04:51:57.144036+0000","last_clean":"2024-05-10T04:51:57.144036+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T04:51:57.144036+0000","last_undegraded":"2024-05-10T04:51:57.144036+0000","last_fullsized":"2024-05-10T04:51:57.144036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139976+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T04:51:58.139976+0000","last_peered":"2024-05-10T04:51:58.139976+0000","last_clean":"2024-05-10T04:51:58.139976+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T04:51:58.139976+0000","last_undegraded":"2024-05-10T04:51:58.139976+0000","last_fullsized":"2024-05-10T04:51:58.139976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173379+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T04:51:57.173379+0000","last_peered":"2024-05-10T04:51:57.173379+0000","last_clean":"2024-05-10T04:51:57.173379+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T04:51:57.173379+0000","last_undegraded":"2024-05-10T04:51:57.173379+0000","last_fullsized":"2024-05-10T04:51:57.173379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165406+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T04:51:57.165406+0000","last_peered":"2024-05-10T04:51:57.165406+0000","last_clean":"2024-05-10T04:51:57.165406+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T04:51:57.165406+0000","last_undegraded":"2024-05-10T04:51:57.165406+0000","last_fullsized":"2024-05-10T04:51:57.165406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773193+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T04:51:57.773193+0000","last_peered":"2024-05-10T04:51:57.773193+0000","last_clean":"2024-05-10T04:51:57.773193+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T04:51:57.773193+0000","last_undegraded":"2024-05-10T04:51:57.773193+0000","last_fullsized":"2024-05-10T04:51:57.773193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173739+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T04:51:57.173739+0000","last_peered":"2024-05-10T04:51:57.173739+0000","last_clean":"2024-05-10T04:51:57.173739+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T04:51:57.173739+0000","last_undegraded":"2024-05-10T04:51:57.173739+0000","last_fullsized":"2024-05-10T04:51:57.173739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169440+0000","last_change":"2024-05-10T04:51:52.747037+0000","last_active":"2024-05-10T04:51:57.169440+0000","last_peered":"2024-05-10T04:51:57.169440+0000","last_clean":"2024-05-10T04:51:57.169440+0000","last_became_active":"2024-05-10T04:51:52.746784+0000","last_became_peered":"2024-05-10T04:51:52.746784+0000","last_unstale":"2024-05-10T04:51:57.169440+0000","last_undegraded":"2024-05-10T04:51:57.169440+0000","last_fullsized":"2024-05-10T04:51:57.169440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:49.520262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773616+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T04:51:57.773616+0000","last_peered":"2024-05-10T04:51:57.773616+0000","last_clean":"2024-05-10T04:51:57.773616+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T04:51:57.773616+0000","last_undegraded":"2024-05-10T04:51:57.773616+0000","last_fullsized":"2024-05-10T04:51:57.773616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215454+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T04:51:57.215454+0000","last_peered":"2024-05-10T04:51:57.215454+0000","last_clean":"2024-05-10T04:51:57.215454+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T04:51:57.215454+0000","last_undegraded":"2024-05-10T04:51:57.215454+0000","last_fullsized":"2024-05-10T04:51:57.215454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146811+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T04:51:57.146811+0000","last_peered":"2024-05-10T04:51:57.146811+0000","last_clean":"2024-05-10T04:51:57.146811+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T04:51:57.146811+0000","last_undegraded":"2024-05-10T04:51:57.146811+0000","last_fullsized":"2024-05-10T04:51:57.146811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772398+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T04:51:57.772398+0000","last_peered":"2024-05-10T04:51:57.772398+0000","last_clean":"2024-05-10T04:51:57.772398+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T04:51:57.772398+0000","last_undegraded":"2024-05-10T04:51:57.772398+0000","last_fullsized":"2024-05-10T04:51:57.772398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138613+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T04:51:57.138613+0000","last_peered":"2024-05-10T04:51:57.138613+0000","last_clean":"2024-05-10T04:51:57.138613+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T04:51:57.138613+0000","last_undegraded":"2024-05-10T04:51:57.138613+0000","last_fullsized":"2024-05-10T04:51:57.138613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218593+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T04:51:57.218593+0000","last_peered":"2024-05-10T04:51:57.218593+0000","last_clean":"2024-05-10T04:51:57.218593+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T04:51:57.218593+0000","last_undegraded":"2024-05-10T04:51:57.218593+0000","last_fullsized":"2024-05-10T04:51:57.218593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787056+0000","last_change":"2024-05-10T04:51:57.160643+0000","last_active":"2024-05-10T04:51:57.787056+0000","last_peered":"2024-05-10T04:51:57.787056+0000","last_clean":"2024-05-10T04:51:57.787056+0000","last_became_active":"2024-05-10T04:51:57.160203+0000","last_became_peered":"2024-05-10T04:51:57.160203+0000","last_unstale":"2024-05-10T04:51:57.787056+0000","last_undegraded":"2024-05-10T04:51:57.787056+0000","last_fullsized":"2024-05-10T04:51:57.787056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174457+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T04:51:57.174457+0000","last_peered":"2024-05-10T04:51:57.174457+0000","last_clean":"2024-05-10T04:51:57.174457+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T04:51:57.174457+0000","last_undegraded":"2024-05-10T04:51:57.174457+0000","last_fullsized":"2024-05-10T04:51:57.174457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159470+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T04:51:57.159470+0000","last_peered":"2024-05-10T04:51:57.159470+0000","last_clean":"2024-05-10T04:51:57.159470+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T04:51:57.159470+0000","last_undegraded":"2024-05-10T04:51:57.159470+0000","last_fullsized":"2024-05-10T04:51:57.159470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138927+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T04:51:58.138927+0000","last_peered":"2024-05-10T04:51:58.138927+0000","last_clean":"2024-05-10T04:51:58.138927+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T04:51:58.138927+0000","last_undegraded":"2024-05-10T04:51:58.138927+0000","last_fullsized":"2024-05-10T04:51:58.138927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138575+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T04:51:57.138575+0000","last_peered":"2024-05-10T04:51:57.138575+0000","last_clean":"2024-05-10T04:51:57.138575+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T04:51:57.138575+0000","last_undegraded":"2024-05-10T04:51:57.138575+0000","last_fullsized":"2024-05-10T04:51:57.138575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219349+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T04:51:57.219349+0000","last_peered":"2024-05-10T04:51:57.219349+0000","last_clean":"2024-05-10T04:51:57.219349+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T04:51:57.219349+0000","last_undegraded":"2024-05-10T04:51:57.219349+0000","last_fullsized":"2024-05-10T04:51:57.219349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146339+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T04:51:57.146339+0000","last_peered":"2024-05-10T04:51:57.146339+0000","last_clean":"2024-05-10T04:51:57.146339+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T04:51:57.146339+0000","last_undegraded":"2024-05-10T04:51:57.146339+0000","last_fullsized":"2024-05-10T04:51:57.146339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138542+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T04:51:57.138542+0000","last_peered":"2024-05-10T04:51:57.138542+0000","last_clean":"2024-05-10T04:51:57.138542+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T04:51:57.138542+0000","last_undegraded":"2024-05-10T04:51:57.138542+0000","last_fullsized":"2024-05-10T04:51:57.138542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158869+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T04:51:57.158869+0000","last_peered":"2024-05-10T04:51:57.158869+0000","last_clean":"2024-05-10T04:51:57.158869+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T04:51:57.158869+0000","last_undegraded":"2024-05-10T04:51:57.158869+0000","last_fullsized":"2024-05-10T04:51:57.158869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142526+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T04:51:57.142526+0000","last_peered":"2024-05-10T04:51:57.142526+0000","last_clean":"2024-05-10T04:51:57.142526+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T04:51:57.142526+0000","last_undegraded":"2024-05-10T04:51:57.142526+0000","last_fullsized":"2024-05-10T04:51:57.142526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169312+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T04:51:57.169312+0000","last_peered":"2024-05-10T04:51:57.169312+0000","last_clean":"2024-05-10T04:51:57.169312+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T04:51:57.169312+0000","last_undegraded":"2024-05-10T04:51:57.169312+0000","last_fullsized":"2024-05-10T04:51:57.169312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174203+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T04:51:57.174203+0000","last_peered":"2024-05-10T04:51:57.174203+0000","last_clean":"2024-05-10T04:51:57.174203+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T04:51:57.174203+0000","last_undegraded":"2024-05-10T04:51:57.174203+0000","last_fullsized":"2024-05-10T04:51:57.174203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148326+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T04:51:57.148326+0000","last_peered":"2024-05-10T04:51:57.148326+0000","last_clean":"2024-05-10T04:51:57.148326+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T04:51:57.148326+0000","last_undegraded":"2024-05-10T04:51:57.148326+0000","last_fullsized":"2024-05-10T04:51:57.148326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172553+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T04:51:57.172553+0000","last_peered":"2024-05-10T04:51:57.172553+0000","last_clean":"2024-05-10T04:51:57.172553+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T04:51:57.172553+0000","last_undegraded":"2024-05-10T04:51:57.172553+0000","last_fullsized":"2024-05-10T04:51:57.172553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158805+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T04:51:57.158805+0000","last_peered":"2024-05-10T04:51:57.158805+0000","last_clean":"2024-05-10T04:51:57.158805+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T04:51:57.158805+0000","last_undegraded":"2024-05-10T04:51:57.158805+0000","last_fullsized":"2024-05-10T04:51:57.158805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167615+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T04:51:57.167615+0000","last_peered":"2024-05-10T04:51:57.167615+0000","last_clean":"2024-05-10T04:51:57.167615+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T04:51:57.167615+0000","last_undegraded":"2024-05-10T04:51:57.167615+0000","last_fullsized":"2024-05-10T04:51:57.167615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159086+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T04:51:57.159086+0000","last_peered":"2024-05-10T04:51:57.159086+0000","last_clean":"2024-05-10T04:51:57.159086+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T04:51:57.159086+0000","last_undegraded":"2024-05-10T04:51:57.159086+0000","last_fullsized":"2024-05-10T04:51:57.159086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142627+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T04:51:57.142627+0000","last_peered":"2024-05-10T04:51:57.142627+0000","last_clean":"2024-05-10T04:51:57.142627+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T04:51:57.142627+0000","last_undegraded":"2024-05-10T04:51:57.142627+0000","last_fullsized":"2024-05-10T04:51:57.142627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148006+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T04:51:57.148006+0000","last_peered":"2024-05-10T04:51:57.148006+0000","last_clean":"2024-05-10T04:51:57.148006+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T04:51:57.148006+0000","last_undegraded":"2024-05-10T04:51:57.148006+0000","last_fullsized":"2024-05-10T04:51:57.148006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":880640,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":111385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:18.913 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:19.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.217+0000 7f685f200700 1 Processor -- start 2024-05-10T04:52:19.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.217+0000 7f685f200700 1 -- start start 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.219+0000 7f685f200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c5a30 0x7f68581592c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.219+0000 7f685f200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6858152a10 0x7f68580c7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.219+0000 7f685f200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68580c7740 0x7f685806c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.219+0000 7f685f200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858155390 con 0x7f6858152a10 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.219+0000 7f685f200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6858156340 con 0x7f68580c7740 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.219+0000 7f685f200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6858155eb0 con 0x7f68580c5a30 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6858152a10 0x7f68580c7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6858152a10 0x7f68580c7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50052/0 (socket says 172.21.15.47:50052) 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 -- 172.21.15.47:0/2420288158 learned_addr learned my addr 172.21.15.47:0/2420288158 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685de00700 1 --2- 172.21.15.47:0/2420288158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c5a30 0x7f68581592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685e800700 1 --2- 172.21.15.47:0/2420288158 >> v2:172.21.15.117:3300/0 conn(0x7f68580c7740 0x7f685806c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 -- 172.21.15.47:0/2420288158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c5a30 msgr2=0x7f68581592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:19.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 --2- 172.21.15.47:0/2420288158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c5a30 0x7f68581592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 -- 172.21.15.47:0/2420288158 >> v2:172.21.15.117:3300/0 conn(0x7f68580c7740 msgr2=0x7f685806c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:19.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 --2- 172.21.15.47:0/2420288158 >> v2:172.21.15.117:3300/0 conn(0x7f68580c7740 0x7f685806c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.220+0000 7f685d400700 1 -- 172.21.15.47:0/2420288158 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6858155580 con 0x7f6858152a10 2024-05-10T04:52:19.222 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.221+0000 7f685d400700 1 --2- 172.21.15.47:0/2420288158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c7200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f685806b540 tx=0x7f6848009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef236e5d41bb4550 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:19.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.222+0000 7f685ca00700 1 -- 172.21.15.47:0/2420288158 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848011830 con 0x7f6858152a10 2024-05-10T04:52:19.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685ca00700 1 -- 172.21.15.47:0/2420288158 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6848011990 con 0x7f6858152a10 2024-05-10T04:52:19.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685ca00700 1 -- 172.21.15.47:0/2420288158 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6848011d20 con 0x7f6858152a10 2024-05-10T04:52:19.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 -- 172.21.15.47:0/2420288158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 msgr2=0x7f68580c7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 --2- 172.21.15.47:0/2420288158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c7200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f685806b540 tx=0x7f6848009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 -- 172.21.15.47:0/2420288158 shutdown_connections 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 --2- 172.21.15.47:0/2420288158 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c5a30 0x7f68581592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 --2- 172.21.15.47:0/2420288158 >> v2:172.21.15.117:3300/0 conn(0x7f68580c7740 0x7f685806c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 --2- 172.21.15.47:0/2420288158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c7200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 -- 172.21.15.47:0/2420288158 >> 172.21.15.47:0/2420288158 conn(0x7f68580ac4a0 msgr2=0x7f68580ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.223+0000 7f685f200700 1 -- 172.21.15.47:0/2420288158 shutdown_connections 2024-05-10T04:52:19.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.224+0000 7f685f200700 1 -- 172.21.15.47:0/2420288158 wait complete. 2024-05-10T04:52:19.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.226+0000 7f685f200700 1 Processor -- start 2024-05-10T04:52:19.227 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.226+0000 7f685f200700 1 -- start start 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685f200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c5a30 0x7f68581578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685f200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c7740 0x7f6858156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68581581e0 con 0x7f6858152a10 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685f200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68580beb20 con 0x7f68580c5a30 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685f200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68580bf980 con 0x7f68580c7740 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50060/0 (socket says 172.21.15.47:50060) 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 -- 172.21.15.47:0/303173648 learned_addr learned my addr 172.21.15.47:0/303173648 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685de00700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c5a30 0x7f68581578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685d400700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c7740 0x7f6858156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 -- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c7740 msgr2=0x7f6858156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c7740 0x7f6858156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 -- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c5a30 msgr2=0x7f68581578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.228+0000 7f685e800700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c5a30 0x7f68581578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f685e800700 1 -- 172.21.15.47:0/303173648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6848009550 con 0x7f6858152a10 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f685e800700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c3cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f685400efc0 tx=0x7f6854009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6854009b20 con 0x7f6858152a10 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685400f040 con 0x7f6858152a10 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68580c0740 con 0x7f6858152a10 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685400cc70 con 0x7f6858152a10 2024-05-10T04:52:19.231 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.229+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68580bf050 con 0x7f6858152a10 2024-05-10T04:52:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.230+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6858074720 con 0x7f6858152a10 2024-05-10T04:52:19.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.232+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6854014480 con 0x7f6858152a10 2024-05-10T04:52:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.233+0000 7f6852000700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f683c06acc0 0x7f683c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.233+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6854089ff0 con 0x7f6858152a10 2024-05-10T04:52:19.234 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.233+0000 7f685de00700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f683c06acc0 0x7f683c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.235 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.234+0000 7f685de00700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f683c06acc0 0x7f683c06d1d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f684c009b40 tx=0x7f684c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:19.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.238+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6854054e50 con 0x7f6858152a10 2024-05-10T04:52:19.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.448+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6858155b40 con 0x7f683c06acc0 2024-05-10T04:52:19.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.459+0000 7f6852000700 1 -- 172.21.15.47:0/303173648 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345344 (secure 0 0 0) 0x7f684c011810 con 0x7f683c06acc0 2024-05-10T04:52:19.464 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f683c06acc0 msgr2=0x7f683c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f683c06acc0 0x7f683c06d1d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f684c009b40 tx=0x7f684c009210 comp rx=0 tx=0).stop 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 msgr2=0x7f68580c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c3cf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f685400efc0 tx=0x7f6854009f60 comp rx=0 tx=0).stop 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 shutdown_connections 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6858152a10 0x7f68580c3cf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68580c5a30 0x7f68581578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f683c06acc0 0x7f683c06d1d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 --2- 172.21.15.47:0/303173648 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68580c7740 0x7f6858156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 >> 172.21.15.47:0/303173648 conn(0x7f68580ac4a0 msgr2=0x7f6858153200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 shutdown_connections 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.463+0000 7f685f200700 1 -- 172.21.15.47:0/303173648 wait complete. 2024-05-10T04:52:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T04:52:19.492 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-05-10T04:52:19.160151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235916,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738804,"statfs":{"total":773094113280,"available":772852535296,"internally_reserved":0,"allocated":3448832,"data_stored":2051623,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003708"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219600+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T04:51:57.219600+0000","last_peered":"2024-05-10T04:51:57.219600+0000","last_clean":"2024-05-10T04:51:57.219600+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T04:51:57.219600+0000","last_undegraded":"2024-05-10T04:51:57.219600+0000","last_fullsized":"2024-05-10T04:51:57.219600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174451+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T04:51:57.174451+0000","last_peered":"2024-05-10T04:51:57.174451+0000","last_clean":"2024-05-10T04:51:57.174451+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T04:51:57.174451+0000","last_undegraded":"2024-05-10T04:51:57.174451+0000","last_fullsized":"2024-05-10T04:51:57.174451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142131+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T04:51:57.142131+0000","last_peered":"2024-05-10T04:51:57.142131+0000","last_clean":"2024-05-10T04:51:57.142131+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T04:51:57.142131+0000","last_undegraded":"2024-05-10T04:51:57.142131+0000","last_fullsized":"2024-05-10T04:51:57.142131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159614+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T04:51:57.159614+0000","last_peered":"2024-05-10T04:51:57.159614+0000","last_clean":"2024-05-10T04:51:57.159614+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T04:51:57.159614+0000","last_undegraded":"2024-05-10T04:51:57.159614+0000","last_fullsized":"2024-05-10T04:51:57.159614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215270+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T04:51:57.215270+0000","last_peered":"2024-05-10T04:51:57.215270+0000","last_clean":"2024-05-10T04:51:57.215270+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T04:51:57.215270+0000","last_undegraded":"2024-05-10T04:51:57.215270+0000","last_fullsized":"2024-05-10T04:51:57.215270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158970+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T04:51:57.158970+0000","last_peered":"2024-05-10T04:51:57.158970+0000","last_clean":"2024-05-10T04:51:57.158970+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T04:51:57.158970+0000","last_undegraded":"2024-05-10T04:51:57.158970+0000","last_fullsized":"2024-05-10T04:51:57.158970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219056+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T04:51:57.219056+0000","last_peered":"2024-05-10T04:51:57.219056+0000","last_clean":"2024-05-10T04:51:57.219056+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T04:51:57.219056+0000","last_undegraded":"2024-05-10T04:51:57.219056+0000","last_fullsized":"2024-05-10T04:51:57.219056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165516+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T04:51:57.165516+0000","last_peered":"2024-05-10T04:51:57.165516+0000","last_clean":"2024-05-10T04:51:57.165516+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T04:51:57.165516+0000","last_undegraded":"2024-05-10T04:51:57.165516+0000","last_fullsized":"2024-05-10T04:51:57.165516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219499+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T04:51:57.219499+0000","last_peered":"2024-05-10T04:51:57.219499+0000","last_clean":"2024-05-10T04:51:57.219499+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T04:51:57.219499+0000","last_undegraded":"2024-05-10T04:51:57.219499+0000","last_fullsized":"2024-05-10T04:51:57.219499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148505+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T04:51:57.148505+0000","last_peered":"2024-05-10T04:51:57.148505+0000","last_clean":"2024-05-10T04:51:57.148505+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T04:51:57.148505+0000","last_undegraded":"2024-05-10T04:51:57.148505+0000","last_fullsized":"2024-05-10T04:51:57.148505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.147947+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T04:51:57.147947+0000","last_peered":"2024-05-10T04:51:57.147947+0000","last_clean":"2024-05-10T04:51:57.147947+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T04:51:57.147947+0000","last_undegraded":"2024-05-10T04:51:57.147947+0000","last_fullsized":"2024-05-10T04:51:57.147947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145857+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T04:51:57.145857+0000","last_peered":"2024-05-10T04:51:57.145857+0000","last_clean":"2024-05-10T04:51:57.145857+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T04:51:57.145857+0000","last_undegraded":"2024-05-10T04:51:57.145857+0000","last_fullsized":"2024-05-10T04:51:57.145857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169259+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T04:51:57.169259+0000","last_peered":"2024-05-10T04:51:57.169259+0000","last_clean":"2024-05-10T04:51:57.169259+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T04:51:57.169259+0000","last_undegraded":"2024-05-10T04:51:57.169259+0000","last_fullsized":"2024-05-10T04:51:57.169259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141852+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T04:51:57.141852+0000","last_peered":"2024-05-10T04:51:57.141852+0000","last_clean":"2024-05-10T04:51:57.141852+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T04:51:57.141852+0000","last_undegraded":"2024-05-10T04:51:57.141852+0000","last_fullsized":"2024-05-10T04:51:57.141852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173288+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T04:51:57.173288+0000","last_peered":"2024-05-10T04:51:57.173288+0000","last_clean":"2024-05-10T04:51:57.173288+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T04:51:57.173288+0000","last_undegraded":"2024-05-10T04:51:57.173288+0000","last_fullsized":"2024-05-10T04:51:57.173288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158567+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T04:51:57.158567+0000","last_peered":"2024-05-10T04:51:57.158567+0000","last_clean":"2024-05-10T04:51:57.158567+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T04:51:57.158567+0000","last_undegraded":"2024-05-10T04:51:57.158567+0000","last_fullsized":"2024-05-10T04:51:57.158567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160353+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T04:51:57.160353+0000","last_peered":"2024-05-10T04:51:57.160353+0000","last_clean":"2024-05-10T04:51:57.160353+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T04:51:57.160353+0000","last_undegraded":"2024-05-10T04:51:57.160353+0000","last_fullsized":"2024-05-10T04:51:57.160353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138643+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T04:51:57.138643+0000","last_peered":"2024-05-10T04:51:57.138643+0000","last_clean":"2024-05-10T04:51:57.138643+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T04:51:57.138643+0000","last_undegraded":"2024-05-10T04:51:57.138643+0000","last_fullsized":"2024-05-10T04:51:57.138643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.220600+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T04:51:57.220600+0000","last_peered":"2024-05-10T04:51:57.220600+0000","last_clean":"2024-05-10T04:51:57.220600+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T04:51:57.220600+0000","last_undegraded":"2024-05-10T04:51:57.220600+0000","last_fullsized":"2024-05-10T04:51:57.220600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138962+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T04:51:58.138962+0000","last_peered":"2024-05-10T04:51:58.138962+0000","last_clean":"2024-05-10T04:51:58.138962+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T04:51:58.138962+0000","last_undegraded":"2024-05-10T04:51:58.138962+0000","last_fullsized":"2024-05-10T04:51:58.138962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142910+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T04:51:57.142910+0000","last_peered":"2024-05-10T04:51:57.142910+0000","last_clean":"2024-05-10T04:51:57.142910+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T04:51:57.142910+0000","last_undegraded":"2024-05-10T04:51:57.142910+0000","last_fullsized":"2024-05-10T04:51:57.142910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171479+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T04:51:57.171479+0000","last_peered":"2024-05-10T04:51:57.171479+0000","last_clean":"2024-05-10T04:51:57.171479+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T04:51:57.171479+0000","last_undegraded":"2024-05-10T04:51:57.171479+0000","last_fullsized":"2024-05-10T04:51:57.171479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773136+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T04:51:57.773136+0000","last_peered":"2024-05-10T04:51:57.773136+0000","last_clean":"2024-05-10T04:51:57.773136+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T04:51:57.773136+0000","last_undegraded":"2024-05-10T04:51:57.773136+0000","last_fullsized":"2024-05-10T04:51:57.773136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171605+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T04:51:57.171605+0000","last_peered":"2024-05-10T04:51:57.171605+0000","last_clean":"2024-05-10T04:51:57.171605+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T04:51:57.171605+0000","last_undegraded":"2024-05-10T04:51:57.171605+0000","last_fullsized":"2024-05-10T04:51:57.171605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142772+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T04:51:57.142772+0000","last_peered":"2024-05-10T04:51:57.142772+0000","last_clean":"2024-05-10T04:51:57.142772+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T04:51:57.142772+0000","last_undegraded":"2024-05-10T04:51:57.142772+0000","last_fullsized":"2024-05-10T04:51:57.142772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773231+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T04:51:57.773231+0000","last_peered":"2024-05-10T04:51:57.773231+0000","last_clean":"2024-05-10T04:51:57.773231+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T04:51:57.773231+0000","last_undegraded":"2024-05-10T04:51:57.773231+0000","last_fullsized":"2024-05-10T04:51:57.773231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218564+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T04:51:57.218564+0000","last_peered":"2024-05-10T04:51:57.218564+0000","last_clean":"2024-05-10T04:51:57.218564+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T04:51:57.218564+0000","last_undegraded":"2024-05-10T04:51:57.218564+0000","last_fullsized":"2024-05-10T04:51:57.218564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159502+0000","last_change":"2024-05-10T04:51:52.757879+0000","last_active":"2024-05-10T04:51:57.159502+0000","last_peered":"2024-05-10T04:51:57.159502+0000","last_clean":"2024-05-10T04:51:57.159502+0000","last_became_active":"2024-05-10T04:51:52.757556+0000","last_became_peered":"2024-05-10T04:51:52.757556+0000","last_unstale":"2024-05-10T04:51:57.159502+0000","last_undegraded":"2024-05-10T04:51:57.159502+0000","last_fullsized":"2024-05-10T04:51:57.159502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:29.588613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.774138+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T04:51:57.774138+0000","last_peered":"2024-05-10T04:51:57.774138+0000","last_clean":"2024-05-10T04:51:57.774138+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T04:51:57.774138+0000","last_undegraded":"2024-05-10T04:51:57.774138+0000","last_fullsized":"2024-05-10T04:51:57.774138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217441+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T04:51:57.217441+0000","last_peered":"2024-05-10T04:51:57.217441+0000","last_clean":"2024-05-10T04:51:57.217441+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T04:51:57.217441+0000","last_undegraded":"2024-05-10T04:51:57.217441+0000","last_fullsized":"2024-05-10T04:51:57.217441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159784+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T04:51:57.159784+0000","last_peered":"2024-05-10T04:51:57.159784+0000","last_clean":"2024-05-10T04:51:57.159784+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T04:51:57.159784+0000","last_undegraded":"2024-05-10T04:51:57.159784+0000","last_fullsized":"2024-05-10T04:51:57.159784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139714+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T04:51:58.139714+0000","last_peered":"2024-05-10T04:51:58.139714+0000","last_clean":"2024-05-10T04:51:58.139714+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T04:51:58.139714+0000","last_undegraded":"2024-05-10T04:51:58.139714+0000","last_fullsized":"2024-05-10T04:51:58.139714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169375+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T04:51:57.169375+0000","last_peered":"2024-05-10T04:51:57.169375+0000","last_clean":"2024-05-10T04:51:57.169375+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T04:51:57.169375+0000","last_undegraded":"2024-05-10T04:51:57.169375+0000","last_fullsized":"2024-05-10T04:51:57.169375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144171+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T04:51:57.144171+0000","last_peered":"2024-05-10T04:51:57.144171+0000","last_clean":"2024-05-10T04:51:57.144171+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T04:51:57.144171+0000","last_undegraded":"2024-05-10T04:51:57.144171+0000","last_fullsized":"2024-05-10T04:51:57.144171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.770902+0000","last_change":"2024-05-10T04:51:57.175748+0000","last_active":"2024-05-10T04:51:57.770902+0000","last_peered":"2024-05-10T04:51:57.770902+0000","last_clean":"2024-05-10T04:51:57.770902+0000","last_became_active":"2024-05-10T04:51:57.175321+0000","last_became_peered":"2024-05-10T04:51:57.175321+0000","last_unstale":"2024-05-10T04:51:57.770902+0000","last_undegraded":"2024-05-10T04:51:57.770902+0000","last_fullsized":"2024-05-10T04:51:57.770902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:55.866371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146693+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T04:51:57.146693+0000","last_peered":"2024-05-10T04:51:57.146693+0000","last_clean":"2024-05-10T04:51:57.146693+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T04:51:57.146693+0000","last_undegraded":"2024-05-10T04:51:57.146693+0000","last_fullsized":"2024-05-10T04:51:57.146693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142418+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T04:51:57.142418+0000","last_peered":"2024-05-10T04:51:57.142418+0000","last_clean":"2024-05-10T04:51:57.142418+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T04:51:57.142418+0000","last_undegraded":"2024-05-10T04:51:57.142418+0000","last_fullsized":"2024-05-10T04:51:57.142418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773586+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T04:51:57.773586+0000","last_peered":"2024-05-10T04:51:57.773586+0000","last_clean":"2024-05-10T04:51:57.773586+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T04:51:57.773586+0000","last_undegraded":"2024-05-10T04:51:57.773586+0000","last_fullsized":"2024-05-10T04:51:57.773586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167516+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T04:51:57.167516+0000","last_peered":"2024-05-10T04:51:57.167516+0000","last_clean":"2024-05-10T04:51:57.167516+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T04:51:57.167516+0000","last_undegraded":"2024-05-10T04:51:57.167516+0000","last_fullsized":"2024-05-10T04:51:57.167516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165279+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T04:51:57.165279+0000","last_peered":"2024-05-10T04:51:57.165279+0000","last_clean":"2024-05-10T04:51:57.165279+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T04:51:57.165279+0000","last_undegraded":"2024-05-10T04:51:57.165279+0000","last_fullsized":"2024-05-10T04:51:57.165279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787071+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T04:51:57.787071+0000","last_peered":"2024-05-10T04:51:57.787071+0000","last_clean":"2024-05-10T04:51:57.787071+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T04:51:57.787071+0000","last_undegraded":"2024-05-10T04:51:57.787071+0000","last_fullsized":"2024-05-10T04:51:57.787071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158867+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T04:51:57.158867+0000","last_peered":"2024-05-10T04:51:57.158867+0000","last_clean":"2024-05-10T04:51:57.158867+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T04:51:57.158867+0000","last_undegraded":"2024-05-10T04:51:57.158867+0000","last_fullsized":"2024-05-10T04:51:57.158867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173508+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T04:51:57.173508+0000","last_peered":"2024-05-10T04:51:57.173508+0000","last_clean":"2024-05-10T04:51:57.173508+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T04:51:57.173508+0000","last_undegraded":"2024-05-10T04:51:57.173508+0000","last_fullsized":"2024-05-10T04:51:57.173508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138787+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T04:51:58.138787+0000","last_peered":"2024-05-10T04:51:58.138787+0000","last_clean":"2024-05-10T04:51:58.138787+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T04:51:58.138787+0000","last_undegraded":"2024-05-10T04:51:58.138787+0000","last_fullsized":"2024-05-10T04:51:58.138787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148696+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T04:51:57.148696+0000","last_peered":"2024-05-10T04:51:57.148696+0000","last_clean":"2024-05-10T04:51:57.148696+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T04:51:57.148696+0000","last_undegraded":"2024-05-10T04:51:57.148696+0000","last_fullsized":"2024-05-10T04:51:57.148696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160203+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T04:51:57.160203+0000","last_peered":"2024-05-10T04:51:57.160203+0000","last_clean":"2024-05-10T04:51:57.160203+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T04:51:57.160203+0000","last_undegraded":"2024-05-10T04:51:57.160203+0000","last_fullsized":"2024-05-10T04:51:57.160203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139616+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T04:51:58.139616+0000","last_peered":"2024-05-10T04:51:58.139616+0000","last_clean":"2024-05-10T04:51:58.139616+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T04:51:58.139616+0000","last_undegraded":"2024-05-10T04:51:58.139616+0000","last_fullsized":"2024-05-10T04:51:58.139616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160118+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T04:51:57.160118+0000","last_peered":"2024-05-10T04:51:57.160118+0000","last_clean":"2024-05-10T04:51:57.160118+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T04:51:57.160118+0000","last_undegraded":"2024-05-10T04:51:57.160118+0000","last_fullsized":"2024-05-10T04:51:57.160118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143146+0000","last_change":"2024-05-10T04:51:52.753381+0000","last_active":"2024-05-10T04:51:57.143146+0000","last_peered":"2024-05-10T04:51:57.143146+0000","last_clean":"2024-05-10T04:51:57.143146+0000","last_became_active":"2024-05-10T04:51:52.753069+0000","last_became_peered":"2024-05-10T04:51:52.753069+0000","last_unstale":"2024-05-10T04:51:57.143146+0000","last_undegraded":"2024-05-10T04:51:57.143146+0000","last_fullsized":"2024-05-10T04:51:57.143146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773410+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T04:51:57.773410+0000","last_peered":"2024-05-10T04:51:57.773410+0000","last_clean":"2024-05-10T04:51:57.773410+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T04:51:57.773410+0000","last_undegraded":"2024-05-10T04:51:57.773410+0000","last_fullsized":"2024-05-10T04:51:57.773410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174304+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T04:51:57.174304+0000","last_peered":"2024-05-10T04:51:57.174304+0000","last_clean":"2024-05-10T04:51:57.174304+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T04:51:57.174304+0000","last_undegraded":"2024-05-10T04:51:57.174304+0000","last_fullsized":"2024-05-10T04:51:57.174304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145744+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T04:51:57.145744+0000","last_peered":"2024-05-10T04:51:57.145744+0000","last_clean":"2024-05-10T04:51:57.145744+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T04:51:57.145744+0000","last_undegraded":"2024-05-10T04:51:57.145744+0000","last_fullsized":"2024-05-10T04:51:57.145744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139068+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T04:51:58.139068+0000","last_peered":"2024-05-10T04:51:58.139068+0000","last_clean":"2024-05-10T04:51:58.139068+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T04:51:58.139068+0000","last_undegraded":"2024-05-10T04:51:58.139068+0000","last_fullsized":"2024-05-10T04:51:58.139068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:52:13.587589+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T04:52:13.587589+0000","last_peered":"2024-05-10T04:52:13.587589+0000","last_clean":"2024-05-10T04:52:13.587589+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T04:52:13.587589+0000","last_undegraded":"2024-05-10T04:52:13.587589+0000","last_fullsized":"2024-05-10T04:52:13.587589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218710+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T04:51:57.218710+0000","last_peered":"2024-05-10T04:51:57.218710+0000","last_clean":"2024-05-10T04:51:57.218710+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T04:51:57.218710+0000","last_undegraded":"2024-05-10T04:51:57.218710+0000","last_fullsized":"2024-05-10T04:51:57.218710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140198+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T04:51:58.140198+0000","last_peered":"2024-05-10T04:51:58.140198+0000","last_clean":"2024-05-10T04:51:58.140198+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T04:51:58.140198+0000","last_undegraded":"2024-05-10T04:51:58.140198+0000","last_fullsized":"2024-05-10T04:51:58.140198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143030+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T04:51:57.143030+0000","last_peered":"2024-05-10T04:51:57.143030+0000","last_clean":"2024-05-10T04:51:57.143030+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T04:51:57.143030+0000","last_undegraded":"2024-05-10T04:51:57.143030+0000","last_fullsized":"2024-05-10T04:51:57.143030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141996+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T04:51:57.141996+0000","last_peered":"2024-05-10T04:51:57.141996+0000","last_clean":"2024-05-10T04:51:57.141996+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T04:51:57.141996+0000","last_undegraded":"2024-05-10T04:51:57.141996+0000","last_fullsized":"2024-05-10T04:51:57.141996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140050+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T04:51:58.140050+0000","last_peered":"2024-05-10T04:51:58.140050+0000","last_clean":"2024-05-10T04:51:58.140050+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T04:51:58.140050+0000","last_undegraded":"2024-05-10T04:51:58.140050+0000","last_fullsized":"2024-05-10T04:51:58.140050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158654+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T04:51:57.158654+0000","last_peered":"2024-05-10T04:51:57.158654+0000","last_clean":"2024-05-10T04:51:57.158654+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T04:51:57.158654+0000","last_undegraded":"2024-05-10T04:51:57.158654+0000","last_fullsized":"2024-05-10T04:51:57.158654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215369+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T04:51:57.215369+0000","last_peered":"2024-05-10T04:51:57.215369+0000","last_clean":"2024-05-10T04:51:57.215369+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T04:51:57.215369+0000","last_undegraded":"2024-05-10T04:51:57.215369+0000","last_fullsized":"2024-05-10T04:51:57.215369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140671+0000","last_change":"2024-05-10T04:51:57.220214+0000","last_active":"2024-05-10T04:51:58.140671+0000","last_peered":"2024-05-10T04:51:58.140671+0000","last_clean":"2024-05-10T04:51:58.140671+0000","last_became_active":"2024-05-10T04:51:57.219512+0000","last_became_peered":"2024-05-10T04:51:57.219512+0000","last_unstale":"2024-05-10T04:51:58.140671+0000","last_undegraded":"2024-05-10T04:51:58.140671+0000","last_fullsized":"2024-05-10T04:51:58.140671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:41.778039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148801+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T04:51:57.148801+0000","last_peered":"2024-05-10T04:51:57.148801+0000","last_clean":"2024-05-10T04:51:57.148801+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T04:51:57.148801+0000","last_undegraded":"2024-05-10T04:51:57.148801+0000","last_fullsized":"2024-05-10T04:51:57.148801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145710+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T04:51:57.145710+0000","last_peered":"2024-05-10T04:51:57.145710+0000","last_clean":"2024-05-10T04:51:57.145710+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T04:51:57.145710+0000","last_undegraded":"2024-05-10T04:51:57.145710+0000","last_fullsized":"2024-05-10T04:51:57.145710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786825+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T04:51:57.786825+0000","last_peered":"2024-05-10T04:51:57.786825+0000","last_clean":"2024-05-10T04:51:57.786825+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T04:51:57.786825+0000","last_undegraded":"2024-05-10T04:51:57.786825+0000","last_fullsized":"2024-05-10T04:51:57.786825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138766+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T04:51:57.138766+0000","last_peered":"2024-05-10T04:51:57.138766+0000","last_clean":"2024-05-10T04:51:57.138766+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T04:51:57.138766+0000","last_undegraded":"2024-05-10T04:51:57.138766+0000","last_fullsized":"2024-05-10T04:51:57.138766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217588+0000","last_change":"2024-05-10T04:51:52.773374+0000","last_active":"2024-05-10T04:51:57.217588+0000","last_peered":"2024-05-10T04:51:57.217588+0000","last_clean":"2024-05-10T04:51:57.217588+0000","last_became_active":"2024-05-10T04:51:52.773109+0000","last_became_peered":"2024-05-10T04:51:52.773109+0000","last_unstale":"2024-05-10T04:51:57.217588+0000","last_undegraded":"2024-05-10T04:51:57.217588+0000","last_fullsized":"2024-05-10T04:51:57.217588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:34.386904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773863+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T04:51:57.773863+0000","last_peered":"2024-05-10T04:51:57.773863+0000","last_clean":"2024-05-10T04:51:57.773863+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T04:51:57.773863+0000","last_undegraded":"2024-05-10T04:51:57.773863+0000","last_fullsized":"2024-05-10T04:51:57.773863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144228+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T04:51:57.144228+0000","last_peered":"2024-05-10T04:51:57.144228+0000","last_clean":"2024-05-10T04:51:57.144228+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T04:51:57.144228+0000","last_undegraded":"2024-05-10T04:51:57.144228+0000","last_fullsized":"2024-05-10T04:51:57.144228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218635+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T04:51:57.218635+0000","last_peered":"2024-05-10T04:51:57.218635+0000","last_clean":"2024-05-10T04:51:57.218635+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T04:51:57.218635+0000","last_undegraded":"2024-05-10T04:51:57.218635+0000","last_fullsized":"2024-05-10T04:51:57.218635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138952+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T04:51:58.138952+0000","last_peered":"2024-05-10T04:51:58.138952+0000","last_clean":"2024-05-10T04:51:58.138952+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T04:51:58.138952+0000","last_undegraded":"2024-05-10T04:51:58.138952+0000","last_fullsized":"2024-05-10T04:51:58.138952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173824+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T04:51:57.173824+0000","last_peered":"2024-05-10T04:51:57.173824+0000","last_clean":"2024-05-10T04:51:57.173824+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T04:51:57.173824+0000","last_undegraded":"2024-05-10T04:51:57.173824+0000","last_fullsized":"2024-05-10T04:51:57.173824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159946+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T04:51:57.159946+0000","last_peered":"2024-05-10T04:51:57.159946+0000","last_clean":"2024-05-10T04:51:57.159946+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T04:51:57.159946+0000","last_undegraded":"2024-05-10T04:51:57.159946+0000","last_fullsized":"2024-05-10T04:51:57.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138685+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T04:51:58.138685+0000","last_peered":"2024-05-10T04:51:58.138685+0000","last_clean":"2024-05-10T04:51:58.138685+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T04:51:58.138685+0000","last_undegraded":"2024-05-10T04:51:58.138685+0000","last_fullsized":"2024-05-10T04:51:58.138685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158550+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T04:51:57.158550+0000","last_peered":"2024-05-10T04:51:57.158550+0000","last_clean":"2024-05-10T04:51:57.158550+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T04:51:57.158550+0000","last_undegraded":"2024-05-10T04:51:57.158550+0000","last_fullsized":"2024-05-10T04:51:57.158550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145115+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T04:51:57.145115+0000","last_peered":"2024-05-10T04:51:57.145115+0000","last_clean":"2024-05-10T04:51:57.145115+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T04:51:57.145115+0000","last_undegraded":"2024-05-10T04:51:57.145115+0000","last_fullsized":"2024-05-10T04:51:57.145115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139840+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T04:51:58.139840+0000","last_peered":"2024-05-10T04:51:58.139840+0000","last_clean":"2024-05-10T04:51:58.139840+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T04:51:58.139840+0000","last_undegraded":"2024-05-10T04:51:58.139840+0000","last_fullsized":"2024-05-10T04:51:58.139840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173195+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T04:51:57.173195+0000","last_peered":"2024-05-10T04:51:57.173195+0000","last_clean":"2024-05-10T04:51:57.173195+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T04:51:57.173195+0000","last_undegraded":"2024-05-10T04:51:57.173195+0000","last_fullsized":"2024-05-10T04:51:57.173195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138457+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T04:51:57.138457+0000","last_peered":"2024-05-10T04:51:57.138457+0000","last_clean":"2024-05-10T04:51:57.138457+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T04:51:57.138457+0000","last_undegraded":"2024-05-10T04:51:57.138457+0000","last_fullsized":"2024-05-10T04:51:57.138457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772271+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T04:51:57.772271+0000","last_peered":"2024-05-10T04:51:57.772271+0000","last_clean":"2024-05-10T04:51:57.772271+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T04:51:57.772271+0000","last_undegraded":"2024-05-10T04:51:57.772271+0000","last_fullsized":"2024-05-10T04:51:57.772271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167290+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T04:51:57.167290+0000","last_peered":"2024-05-10T04:51:57.167290+0000","last_clean":"2024-05-10T04:51:57.167290+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T04:51:57.167290+0000","last_undegraded":"2024-05-10T04:51:57.167290+0000","last_fullsized":"2024-05-10T04:51:57.167290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158794+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T04:51:57.158794+0000","last_peered":"2024-05-10T04:51:57.158794+0000","last_clean":"2024-05-10T04:51:57.158794+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T04:51:57.158794+0000","last_undegraded":"2024-05-10T04:51:57.158794+0000","last_fullsized":"2024-05-10T04:51:57.158794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214929+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T04:51:57.214929+0000","last_peered":"2024-05-10T04:51:57.214929+0000","last_clean":"2024-05-10T04:51:57.214929+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T04:51:57.214929+0000","last_undegraded":"2024-05-10T04:51:57.214929+0000","last_fullsized":"2024-05-10T04:51:57.214929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786989+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T04:51:57.786989+0000","last_peered":"2024-05-10T04:51:57.786989+0000","last_clean":"2024-05-10T04:51:57.786989+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T04:51:57.786989+0000","last_undegraded":"2024-05-10T04:51:57.786989+0000","last_fullsized":"2024-05-10T04:51:57.786989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141828+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T04:51:57.141828+0000","last_peered":"2024-05-10T04:51:57.141828+0000","last_clean":"2024-05-10T04:51:57.141828+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T04:51:57.141828+0000","last_undegraded":"2024-05-10T04:51:57.141828+0000","last_fullsized":"2024-05-10T04:51:57.141828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215071+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T04:51:57.215071+0000","last_peered":"2024-05-10T04:51:57.215071+0000","last_clean":"2024-05-10T04:51:57.215071+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T04:51:57.215071+0000","last_undegraded":"2024-05-10T04:51:57.215071+0000","last_fullsized":"2024-05-10T04:51:57.215071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786742+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T04:51:57.786742+0000","last_peered":"2024-05-10T04:51:57.786742+0000","last_clean":"2024-05-10T04:51:57.786742+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T04:51:57.786742+0000","last_undegraded":"2024-05-10T04:51:57.786742+0000","last_fullsized":"2024-05-10T04:51:57.786742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218062+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T04:51:57.218062+0000","last_peered":"2024-05-10T04:51:57.218062+0000","last_clean":"2024-05-10T04:51:57.218062+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T04:51:57.218062+0000","last_undegraded":"2024-05-10T04:51:57.218062+0000","last_fullsized":"2024-05-10T04:51:57.218062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174509+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T04:51:57.174509+0000","last_peered":"2024-05-10T04:51:57.174509+0000","last_clean":"2024-05-10T04:51:57.174509+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T04:51:57.174509+0000","last_undegraded":"2024-05-10T04:51:57.174509+0000","last_fullsized":"2024-05-10T04:51:57.174509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138706+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T04:51:58.138706+0000","last_peered":"2024-05-10T04:51:58.138706+0000","last_clean":"2024-05-10T04:51:58.138706+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T04:51:58.138706+0000","last_undegraded":"2024-05-10T04:51:58.138706+0000","last_fullsized":"2024-05-10T04:51:58.138706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174200+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T04:51:57.174200+0000","last_peered":"2024-05-10T04:51:57.174200+0000","last_clean":"2024-05-10T04:51:57.174200+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T04:51:57.174200+0000","last_undegraded":"2024-05-10T04:51:57.174200+0000","last_fullsized":"2024-05-10T04:51:57.174200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172446+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T04:51:57.172446+0000","last_peered":"2024-05-10T04:51:57.172446+0000","last_clean":"2024-05-10T04:51:57.172446+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T04:51:57.172446+0000","last_undegraded":"2024-05-10T04:51:57.172446+0000","last_fullsized":"2024-05-10T04:51:57.172446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773872+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T04:51:57.773872+0000","last_peered":"2024-05-10T04:51:57.773872+0000","last_clean":"2024-05-10T04:51:57.773872+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T04:51:57.773872+0000","last_undegraded":"2024-05-10T04:51:57.773872+0000","last_fullsized":"2024-05-10T04:51:57.773872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148508+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T04:51:57.148508+0000","last_peered":"2024-05-10T04:51:57.148508+0000","last_clean":"2024-05-10T04:51:57.148508+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T04:51:57.148508+0000","last_undegraded":"2024-05-10T04:51:57.148508+0000","last_fullsized":"2024-05-10T04:51:57.148508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145749+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T04:51:57.145749+0000","last_peered":"2024-05-10T04:51:57.145749+0000","last_clean":"2024-05-10T04:51:57.145749+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T04:51:57.145749+0000","last_undegraded":"2024-05-10T04:51:57.145749+0000","last_fullsized":"2024-05-10T04:51:57.145749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773762+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T04:51:57.773762+0000","last_peered":"2024-05-10T04:51:57.773762+0000","last_clean":"2024-05-10T04:51:57.773762+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T04:51:57.773762+0000","last_undegraded":"2024-05-10T04:51:57.773762+0000","last_fullsized":"2024-05-10T04:51:57.773762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214825+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T04:51:57.214825+0000","last_peered":"2024-05-10T04:51:57.214825+0000","last_clean":"2024-05-10T04:51:57.214825+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T04:51:57.214825+0000","last_undegraded":"2024-05-10T04:51:57.214825+0000","last_fullsized":"2024-05-10T04:51:57.214825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144036+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T04:51:57.144036+0000","last_peered":"2024-05-10T04:51:57.144036+0000","last_clean":"2024-05-10T04:51:57.144036+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T04:51:57.144036+0000","last_undegraded":"2024-05-10T04:51:57.144036+0000","last_fullsized":"2024-05-10T04:51:57.144036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139976+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T04:51:58.139976+0000","last_peered":"2024-05-10T04:51:58.139976+0000","last_clean":"2024-05-10T04:51:58.139976+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T04:51:58.139976+0000","last_undegraded":"2024-05-10T04:51:58.139976+0000","last_fullsized":"2024-05-10T04:51:58.139976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173379+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T04:51:57.173379+0000","last_peered":"2024-05-10T04:51:57.173379+0000","last_clean":"2024-05-10T04:51:57.173379+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T04:51:57.173379+0000","last_undegraded":"2024-05-10T04:51:57.173379+0000","last_fullsized":"2024-05-10T04:51:57.173379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165406+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T04:51:57.165406+0000","last_peered":"2024-05-10T04:51:57.165406+0000","last_clean":"2024-05-10T04:51:57.165406+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T04:51:57.165406+0000","last_undegraded":"2024-05-10T04:51:57.165406+0000","last_fullsized":"2024-05-10T04:51:57.165406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773193+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T04:51:57.773193+0000","last_peered":"2024-05-10T04:51:57.773193+0000","last_clean":"2024-05-10T04:51:57.773193+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T04:51:57.773193+0000","last_undegraded":"2024-05-10T04:51:57.773193+0000","last_fullsized":"2024-05-10T04:51:57.773193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173739+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T04:51:57.173739+0000","last_peered":"2024-05-10T04:51:57.173739+0000","last_clean":"2024-05-10T04:51:57.173739+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T04:51:57.173739+0000","last_undegraded":"2024-05-10T04:51:57.173739+0000","last_fullsized":"2024-05-10T04:51:57.173739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169440+0000","last_change":"2024-05-10T04:51:52.747037+0000","last_active":"2024-05-10T04:51:57.169440+0000","last_peered":"2024-05-10T04:51:57.169440+0000","last_clean":"2024-05-10T04:51:57.169440+0000","last_became_active":"2024-05-10T04:51:52.746784+0000","last_became_peered":"2024-05-10T04:51:52.746784+0000","last_unstale":"2024-05-10T04:51:57.169440+0000","last_undegraded":"2024-05-10T04:51:57.169440+0000","last_fullsized":"2024-05-10T04:51:57.169440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:49.520262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773616+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T04:51:57.773616+0000","last_peered":"2024-05-10T04:51:57.773616+0000","last_clean":"2024-05-10T04:51:57.773616+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T04:51:57.773616+0000","last_undegraded":"2024-05-10T04:51:57.773616+0000","last_fullsized":"2024-05-10T04:51:57.773616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215454+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T04:51:57.215454+0000","last_peered":"2024-05-10T04:51:57.215454+0000","last_clean":"2024-05-10T04:51:57.215454+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T04:51:57.215454+0000","last_undegraded":"2024-05-10T04:51:57.215454+0000","last_fullsized":"2024-05-10T04:51:57.215454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146811+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T04:51:57.146811+0000","last_peered":"2024-05-10T04:51:57.146811+0000","last_clean":"2024-05-10T04:51:57.146811+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T04:51:57.146811+0000","last_undegraded":"2024-05-10T04:51:57.146811+0000","last_fullsized":"2024-05-10T04:51:57.146811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772398+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T04:51:57.772398+0000","last_peered":"2024-05-10T04:51:57.772398+0000","last_clean":"2024-05-10T04:51:57.772398+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T04:51:57.772398+0000","last_undegraded":"2024-05-10T04:51:57.772398+0000","last_fullsized":"2024-05-10T04:51:57.772398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138613+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T04:51:57.138613+0000","last_peered":"2024-05-10T04:51:57.138613+0000","last_clean":"2024-05-10T04:51:57.138613+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T04:51:57.138613+0000","last_undegraded":"2024-05-10T04:51:57.138613+0000","last_fullsized":"2024-05-10T04:51:57.138613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218593+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T04:51:57.218593+0000","last_peered":"2024-05-10T04:51:57.218593+0000","last_clean":"2024-05-10T04:51:57.218593+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T04:51:57.218593+0000","last_undegraded":"2024-05-10T04:51:57.218593+0000","last_fullsized":"2024-05-10T04:51:57.218593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787056+0000","last_change":"2024-05-10T04:51:57.160643+0000","last_active":"2024-05-10T04:51:57.787056+0000","last_peered":"2024-05-10T04:51:57.787056+0000","last_clean":"2024-05-10T04:51:57.787056+0000","last_became_active":"2024-05-10T04:51:57.160203+0000","last_became_peered":"2024-05-10T04:51:57.160203+0000","last_unstale":"2024-05-10T04:51:57.787056+0000","last_undegraded":"2024-05-10T04:51:57.787056+0000","last_fullsized":"2024-05-10T04:51:57.787056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174457+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T04:51:57.174457+0000","last_peered":"2024-05-10T04:51:57.174457+0000","last_clean":"2024-05-10T04:51:57.174457+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T04:51:57.174457+0000","last_undegraded":"2024-05-10T04:51:57.174457+0000","last_fullsized":"2024-05-10T04:51:57.174457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159470+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T04:51:57.159470+0000","last_peered":"2024-05-10T04:51:57.159470+0000","last_clean":"2024-05-10T04:51:57.159470+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T04:51:57.159470+0000","last_undegraded":"2024-05-10T04:51:57.159470+0000","last_fullsized":"2024-05-10T04:51:57.159470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138927+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T04:51:58.138927+0000","last_peered":"2024-05-10T04:51:58.138927+0000","last_clean":"2024-05-10T04:51:58.138927+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T04:51:58.138927+0000","last_undegraded":"2024-05-10T04:51:58.138927+0000","last_fullsized":"2024-05-10T04:51:58.138927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138575+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T04:51:57.138575+0000","last_peered":"2024-05-10T04:51:57.138575+0000","last_clean":"2024-05-10T04:51:57.138575+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T04:51:57.138575+0000","last_undegraded":"2024-05-10T04:51:57.138575+0000","last_fullsized":"2024-05-10T04:51:57.138575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219349+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T04:51:57.219349+0000","last_peered":"2024-05-10T04:51:57.219349+0000","last_clean":"2024-05-10T04:51:57.219349+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T04:51:57.219349+0000","last_undegraded":"2024-05-10T04:51:57.219349+0000","last_fullsized":"2024-05-10T04:51:57.219349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146339+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T04:51:57.146339+0000","last_peered":"2024-05-10T04:51:57.146339+0000","last_clean":"2024-05-10T04:51:57.146339+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T04:51:57.146339+0000","last_undegraded":"2024-05-10T04:51:57.146339+0000","last_fullsized":"2024-05-10T04:51:57.146339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138542+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T04:51:57.138542+0000","last_peered":"2024-05-10T04:51:57.138542+0000","last_clean":"2024-05-10T04:51:57.138542+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T04:51:57.138542+0000","last_undegraded":"2024-05-10T04:51:57.138542+0000","last_fullsized":"2024-05-10T04:51:57.138542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158869+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T04:51:57.158869+0000","last_peered":"2024-05-10T04:51:57.158869+0000","last_clean":"2024-05-10T04:51:57.158869+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T04:51:57.158869+0000","last_undegraded":"2024-05-10T04:51:57.158869+0000","last_fullsized":"2024-05-10T04:51:57.158869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142526+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T04:51:57.142526+0000","last_peered":"2024-05-10T04:51:57.142526+0000","last_clean":"2024-05-10T04:51:57.142526+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T04:51:57.142526+0000","last_undegraded":"2024-05-10T04:51:57.142526+0000","last_fullsized":"2024-05-10T04:51:57.142526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169312+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T04:51:57.169312+0000","last_peered":"2024-05-10T04:51:57.169312+0000","last_clean":"2024-05-10T04:51:57.169312+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T04:51:57.169312+0000","last_undegraded":"2024-05-10T04:51:57.169312+0000","last_fullsized":"2024-05-10T04:51:57.169312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174203+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T04:51:57.174203+0000","last_peered":"2024-05-10T04:51:57.174203+0000","last_clean":"2024-05-10T04:51:57.174203+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T04:51:57.174203+0000","last_undegraded":"2024-05-10T04:51:57.174203+0000","last_fullsized":"2024-05-10T04:51:57.174203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148326+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T04:51:57.148326+0000","last_peered":"2024-05-10T04:51:57.148326+0000","last_clean":"2024-05-10T04:51:57.148326+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T04:51:57.148326+0000","last_undegraded":"2024-05-10T04:51:57.148326+0000","last_fullsized":"2024-05-10T04:51:57.148326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172553+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T04:51:57.172553+0000","last_peered":"2024-05-10T04:51:57.172553+0000","last_clean":"2024-05-10T04:51:57.172553+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T04:51:57.172553+0000","last_undegraded":"2024-05-10T04:51:57.172553+0000","last_fullsized":"2024-05-10T04:51:57.172553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158805+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T04:51:57.158805+0000","last_peered":"2024-05-10T04:51:57.158805+0000","last_clean":"2024-05-10T04:51:57.158805+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T04:51:57.158805+0000","last_undegraded":"2024-05-10T04:51:57.158805+0000","last_fullsized":"2024-05-10T04:51:57.158805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167615+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T04:51:57.167615+0000","last_peered":"2024-05-10T04:51:57.167615+0000","last_clean":"2024-05-10T04:51:57.167615+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T04:51:57.167615+0000","last_undegraded":"2024-05-10T04:51:57.167615+0000","last_fullsized":"2024-05-10T04:51:57.167615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159086+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T04:51:57.159086+0000","last_peered":"2024-05-10T04:51:57.159086+0000","last_clean":"2024-05-10T04:51:57.159086+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T04:51:57.159086+0000","last_undegraded":"2024-05-10T04:51:57.159086+0000","last_fullsized":"2024-05-10T04:51:57.159086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142627+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T04:51:57.142627+0000","last_peered":"2024-05-10T04:51:57.142627+0000","last_clean":"2024-05-10T04:51:57.142627+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T04:51:57.142627+0000","last_undegraded":"2024-05-10T04:51:57.142627+0000","last_fullsized":"2024-05-10T04:51:57.142627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148006+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T04:51:57.148006+0000","last_peered":"2024-05-10T04:51:57.148006+0000","last_clean":"2024-05-10T04:51:57.148006+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T04:51:57.148006+0000","last_undegraded":"2024-05-10T04:51:57.148006+0000","last_fullsized":"2024-05-10T04:51:57.148006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":880640,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":111385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:19.497 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-05-10T04:52:19.500 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-10T04:52:19.500 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-10T04:52:19.500 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-10T04:52:19.500 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-10T04:52:19.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.801+0000 7f187d200700 1 Processor -- start 2024-05-10T04:52:19.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.801+0000 7f187d200700 1 -- start start 2024-05-10T04:52:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.802+0000 7f187d200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18780c5c40 0x7f18780c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.802+0000 7f187d200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18780c9270 0x7f1878158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.802+0000 7f187d200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f187806c7c0 con 0x7f1878159050 2024-05-10T04:52:19.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.802+0000 7f187d200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f187806d060 con 0x7f18780c5c40 2024-05-10T04:52:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f187d200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1878159890 con 0x7f18780c9270 2024-05-10T04:52:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1875e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f18780c5c40 0x7f18780c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1876800700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1878159050 0x7f18781555a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54732/0 (socket says 172.21.15.47:54732) 2024-05-10T04:52:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1876800700 1 -- 172.21.15.47:0/4209848169 learned_addr learned my addr 172.21.15.47:0/4209848169 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1875400700 1 --2- 172.21.15.47:0/4209848169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18780c9270 0x7f1878158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1875e00700 1 -- 172.21.15.47:0/4209848169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18780c9270 msgr2=0x7f1878158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1875e00700 1 --2- 172.21.15.47:0/4209848169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18780c9270 0x7f1878158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1875e00700 1 -- 172.21.15.47:0/4209848169 >> v1:172.21.15.47:6789/0 conn(0x7f1878159050 legacy=0x7f18781555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1875e00700 1 -- 172.21.15.47:0/4209848169 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f187806ca10 con 0x7f18780c5c40 2024-05-10T04:52:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.803+0000 7f1874a00700 1 -- 172.21.15.47:0/4209848169 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158917673 0 0) 0x7f187806c7c0 con 0x7f1878159050 2024-05-10T04:52:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.804+0000 7f1875e00700 1 --2- 172.21.15.47:0/4209848169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c5c40 0x7f18780c8d30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1868009840 tx=0x7f1868009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca18006eb32f60b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:19.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.804+0000 7f1874a00700 1 -- 172.21.15.47:0/4209848169 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868011830 con 0x7f18780c5c40 2024-05-10T04:52:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.804+0000 7f1874a00700 1 -- 172.21.15.47:0/4209848169 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1868011990 con 0x7f18780c5c40 2024-05-10T04:52:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.804+0000 7f1874a00700 1 -- 172.21.15.47:0/4209848169 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1868011d20 con 0x7f18780c5c40 2024-05-10T04:52:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 -- 172.21.15.47:0/4209848169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c5c40 msgr2=0x7f18780c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 --2- 172.21.15.47:0/4209848169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c5c40 0x7f18780c8d30 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1868009840 tx=0x7f1868009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 -- 172.21.15.47:0/4209848169 shutdown_connections 2024-05-10T04:52:19.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 --2- 172.21.15.47:0/4209848169 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c5c40 0x7f18780c8d30 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 --2- 172.21.15.47:0/4209848169 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f18780c9270 0x7f1878158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 -- 172.21.15.47:0/4209848169 >> 172.21.15.47:0/4209848169 conn(0x7f18780ca940 msgr2=0x7f18780cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 -- 172.21.15.47:0/4209848169 shutdown_connections 2024-05-10T04:52:19.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.805+0000 7f187d200700 1 -- 172.21.15.47:0/4209848169 wait complete. 2024-05-10T04:52:19.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.807+0000 7f187d200700 1 Processor -- start 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.807+0000 7f187d200700 1 -- start start 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f187d200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18780c5c40 0x7f1878153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f187d200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 0x7f1878155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f187d200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1878159050 0x7f18780c0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f187d200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1878155f60 con 0x7f18780c9270 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f187d200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f187814d020 con 0x7f18780c5c40 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f187d200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1878154db0 con 0x7f1878159050 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 0x7f1878155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 0x7f1878155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50088/0 (socket says 172.21.15.47:50088) 2024-05-10T04:52:19.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 -- 172.21.15.47:0/1804269457 learned_addr learned my addr 172.21.15.47:0/1804269457 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875e00700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18780c5c40 0x7f1878153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1876800700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1878159050 0x7f18780c0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 -- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1878159050 msgr2=0x7f18780c0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1878159050 0x7f18780c0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 -- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18780c5c40 msgr2=0x7f1878153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18780c5c40 0x7f1878153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.809+0000 7f1875400700 1 -- 172.21.15.47:0/1804269457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680094a0 con 0x7f18780c9270 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.810+0000 7f1875400700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 0x7f1878155240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f186400e870 tx=0x7f186400eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:19.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.810+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1864009590 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.810+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1864013680 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.810+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18640139f0 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.810+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f187814d270 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.810+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1878155ca0 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.811+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1878155090 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.812+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1864013b50 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.813+0000 7f186e000700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f185806ac90 0x7f185806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.813+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1864089510 con 0x7f18780c9270 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.814+0000 7f1875e00700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f185806ac90 0x7f185806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:19.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.814+0000 7f1875e00700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f185806ac90 0x7f185806d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1868009840 tx=0x7f1868008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:19.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:19.818+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1864054360 con 0x7f18780c9270 2024-05-10T04:52:20.090 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.090+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f18781ebf00 con 0x7f18780c9270 2024-05-10T04:52:20.093 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.093+0000 7f186e000700 1 -- 172.21.15.47:0/1804269457 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170942 (secure 0 0 0) 0x7f1864057980 con 0x7f18780c9270 2024-05-10T04:52:20.096 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:20.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f185806ac90 msgr2=0x7f185806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f185806ac90 0x7f185806d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1868009840 tx=0x7f1868008030 comp rx=0 tx=0).stop 2024-05-10T04:52:20.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 msgr2=0x7f1878155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 0x7f1878155240 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f186400e870 tx=0x7f186400eb80 comp rx=0 tx=0).stop 2024-05-10T04:52:20.097 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 shutdown_connections 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f185806ac90 0x7f185806d1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1878159050 0x7f18780c0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f18780c5c40 0x7f1878153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 --2- 172.21.15.47:0/1804269457 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f18780c9270 0x7f1878155240 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.096+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 >> 172.21.15.47:0/1804269457 conn(0x7f18780ca940 msgr2=0x7f18780cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.097+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 shutdown_connections 2024-05-10T04:52:20.098 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.097+0000 7f187d200700 1 -- 172.21.15.47:0/1804269457 wait complete. 2024-05-10T04:52:20.125 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6832","nonce":43361},{"type":"v1","addr":"172.21.15.117:6833","nonce":43361}]},"active_addr":"172.21.15.117:6833/43361","active_change":"2024-05-10T04:51:39.136894+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":577428770}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1248451535}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":1707247438}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.117:0","nonce":756950570}]}]} 2024-05-10T04:52:20.131 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-10T04:52:20.131 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-10T04:52:20.131 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:20.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.403+0000 7f1286200700 1 Processor -- start 2024-05-10T04:52:20.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.403+0000 7f1286200700 1 -- start start 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1286200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c5a00 0x7f12801529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1286200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f12800c8ba0 0x7f12800c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1286200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f128006cbd0 con 0x7f12801588d0 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1286200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12801593f0 con 0x7f12800c8ba0 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1286200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12800ca500 con 0x7f12800c5a00 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1285800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f12800c8ba0 0x7f12800c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1285800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f12800c8ba0 0x7f12800c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50100/0 (socket says 172.21.15.47:50100) 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f127fe00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f12801588d0 0x7f1280158ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:54736/0 (socket says 172.21.15.47:54736) 2024-05-10T04:52:20.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1285800700 1 -- 172.21.15.47:0/3865351217 learned_addr learned my addr 172.21.15.47:0/3865351217 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.405+0000 7f1284e00700 1 --2- 172.21.15.47:0/3865351217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c5a00 0x7f12801529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f1285800700 1 -- 172.21.15.47:0/3865351217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c5a00 msgr2=0x7f12801529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f1285800700 1 --2- 172.21.15.47:0/3865351217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c5a00 0x7f12801529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f1285800700 1 -- 172.21.15.47:0/3865351217 >> v1:172.21.15.47:6789/0 conn(0x7f12801588d0 legacy=0x7f1280158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f1285800700 1 -- 172.21.15.47:0/3865351217 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1280159660 con 0x7f12800c8ba0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f127f400700 1 -- 172.21.15.47:0/3865351217 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174092775 0 0) 0x7f128006cbd0 con 0x7f12801588d0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f1285800700 1 --2- 172.21.15.47:0/3865351217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c8ba0 0x7f12800c8fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12780098f0 tx=0x7f1278009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5bd9d231062dc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f127f400700 1 -- 172.21.15.47:0/3865351217 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278011830 con 0x7f12800c8ba0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f127f400700 1 -- 172.21.15.47:0/3865351217 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278011990 con 0x7f12800c8ba0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.406+0000 7f127f400700 1 -- 172.21.15.47:0/3865351217 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1278011d20 con 0x7f12800c8ba0 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 -- 172.21.15.47:0/3865351217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c8ba0 msgr2=0x7f12800c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 --2- 172.21.15.47:0/3865351217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c8ba0 0x7f12800c8fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f12780098f0 tx=0x7f1278009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 -- 172.21.15.47:0/3865351217 shutdown_connections 2024-05-10T04:52:20.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 --2- 172.21.15.47:0/3865351217 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c8ba0 0x7f12800c8fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 --2- 172.21.15.47:0/3865351217 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c5a00 0x7f12801529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 -- 172.21.15.47:0/3865351217 >> 172.21.15.47:0/3865351217 conn(0x7f12800ca700 msgr2=0x7f12800cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 -- 172.21.15.47:0/3865351217 shutdown_connections 2024-05-10T04:52:20.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.407+0000 7f1286200700 1 -- 172.21.15.47:0/3865351217 wait complete. 2024-05-10T04:52:20.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.409+0000 7f1286200700 1 Processor -- start 2024-05-10T04:52:20.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.409+0000 7f1286200700 1 -- start start 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1286200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 0x7f12801548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1286200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c8ba0 0x7f12801ee9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1286200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12801588d0 0x7f12801eef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1286200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801ecbd0 con 0x7f12800c5a00 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1286200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12801ef580 con 0x7f12801588d0 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1286200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1280154430 con 0x7f12800c8ba0 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1284e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 0x7f12801548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1284e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 0x7f12801548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:50110/0 (socket says 172.21.15.47:50110) 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1284e00700 1 -- 172.21.15.47:0/3068778926 learned_addr learned my addr 172.21.15.47:0/3068778926 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f127fe00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c8ba0 0x7f12801ee9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1285800700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12801588d0 0x7f12801eef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1284e00700 1 -- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c8ba0 msgr2=0x7f12801ee9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.411+0000 7f1284e00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c8ba0 0x7f12801ee9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f1284e00700 1 -- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12801588d0 msgr2=0x7f12801eef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f1284e00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12801588d0 0x7f12801eef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f1284e00700 1 -- 172.21.15.47:0/3068778926 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1278009550 con 0x7f12800c5a00 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f1284e00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 0x7f12801548c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f127400efc0 tx=0x7f127400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400cb50 con 0x7f12800c5a00 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400f040 con 0x7f12800c5a00 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12801ec700 con 0x7f12800c5a00 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274014480 con 0x7f12800c5a00 2024-05-10T04:52:20.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.412+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12800c1810 con 0x7f12800c5a00 2024-05-10T04:52:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.413+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1280074720 con 0x7f12800c5a00 2024-05-10T04:52:20.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.414+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f12740145e0 con 0x7f12800c5a00 2024-05-10T04:52:20.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.416+0000 7f127cc00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f126006ac90 0x7f126006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.416+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f127408a1e0 con 0x7f12800c5a00 2024-05-10T04:52:20.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.416+0000 7f127fe00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f126006ac90 0x7f126006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.417+0000 7f127fe00700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f126006ac90 0x7f126006d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12801e2740 tx=0x7f126c007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.421+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1274055030 con 0x7f12800c5a00 2024-05-10T04:52:20.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.639+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1280154570 con 0x7f12800c5a00 2024-05-10T04:52:20.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.640+0000 7f127cc00700 1 -- 172.21.15.47:0/3068778926 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f1274058650 con 0x7f12800c5a00 2024-05-10T04:52:20.641 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:20.641 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.642+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f126006ac90 msgr2=0x7f126006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.642+0000 7f1286200700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f126006ac90 0x7f126006d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12801e2740 tx=0x7f126c007e90 comp rx=0 tx=0).stop 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 msgr2=0x7f12801548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 0x7f12801548c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f127400efc0 tx=0x7f127400c0c0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 shutdown_connections 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12801588d0 0x7f12801eef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12800c5a00 0x7f12801548c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f126006ac90 0x7f126006d1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 --2- 172.21.15.47:0/3068778926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12800c8ba0 0x7f12801ee9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 >> 172.21.15.47:0/3068778926 conn(0x7f12800ca700 msgr2=0x7f12800ab940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 shutdown_connections 2024-05-10T04:52:20.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.643+0000 7f1286200700 1 -- 172.21.15.47:0/3068778926 wait complete. 2024-05-10T04:52:20.670 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-10T04:52:20.670 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:20.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.940+0000 7f160d800700 1 Processor -- start 2024-05-10T04:52:20.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.940+0000 7f160d800700 1 -- start start 2024-05-10T04:52:20.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f160d800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16080c5c40 0x7f16080c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f160d800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1608159220 0x7f160815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f160d800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f160806c7c0 con 0x7f16080c9270 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f160d800700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f160806d060 con 0x7f1608159220 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f160d800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1608159630 con 0x7f16080c5c40 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1608159220 0x7f160815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1606a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16080c5c40 0x7f16080c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1608159220 0x7f160815fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36594/0 (socket says 172.21.15.47:36594) 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1606000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f16080c9270 0x7f1608158b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43532/0 (socket says 172.21.15.47:43532) 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 -- 172.21.15.47:0/558497050 learned_addr learned my addr 172.21.15.47:0/558497050 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 -- 172.21.15.47:0/558497050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16080c5c40 msgr2=0x7f16080c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 --2- 172.21.15.47:0/558497050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16080c5c40 0x7f16080c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 -- 172.21.15.47:0/558497050 >> v1:172.21.15.47:6789/0 conn(0x7f16080c9270 legacy=0x7f1608158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.942+0000 7f1607400700 1 -- 172.21.15.47:0/558497050 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1608159890 con 0x7f1608159220 2024-05-10T04:52:20.944 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.943+0000 7f1607400700 1 --2- 172.21.15.47:0/558497050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1608159220 0x7f160815fe40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1600009e50 tx=0x7f160000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a74b0f16c46d98cb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.943+0000 7f1605600700 1 -- 172.21.15.47:0/558497050 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000e070 con 0x7f1608159220 2024-05-10T04:52:20.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.943+0000 7f1605600700 1 -- 172.21.15.47:0/558497050 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f160000b910 con 0x7f1608159220 2024-05-10T04:52:20.945 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.943+0000 7f1605600700 1 -- 172.21.15.47:0/558497050 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f160000bcc0 con 0x7f1608159220 2024-05-10T04:52:20.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 -- 172.21.15.47:0/558497050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1608159220 msgr2=0x7f160815fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 --2- 172.21.15.47:0/558497050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1608159220 0x7f160815fe40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1600009e50 tx=0x7f160000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:20.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 -- 172.21.15.47:0/558497050 shutdown_connections 2024-05-10T04:52:20.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 --2- 172.21.15.47:0/558497050 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1608159220 0x7f160815fe40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 --2- 172.21.15.47:0/558497050 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f16080c5c40 0x7f16080c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 -- 172.21.15.47:0/558497050 >> 172.21.15.47:0/558497050 conn(0x7f16080ca940 msgr2=0x7f16080cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:20.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 -- 172.21.15.47:0/558497050 shutdown_connections 2024-05-10T04:52:20.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.944+0000 7f160d800700 1 -- 172.21.15.47:0/558497050 wait complete. 2024-05-10T04:52:20.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.946+0000 7f160d800700 1 Processor -- start 2024-05-10T04:52:20.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.946+0000 7f160d800700 1 -- start start 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f160d800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 0x7f16080bf6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f160d800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c9270 0x7f16081ee860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f160d800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1608159220 0x7f16081eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f160d800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16081e1890 con 0x7f16080c5c40 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f160d800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16080c0410 con 0x7f16080c9270 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f160d800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16080be6d0 con 0x7f1608159220 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 0x7f16080bf6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 0x7f16080bf6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36598/0 (socket says 172.21.15.47:36598) 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 -- 172.21.15.47:0/1261338256 learned_addr learned my addr 172.21.15.47:0/1261338256 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:20.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1607400700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1608159220 0x7f16081eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606000700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c9270 0x7f16081ee860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 -- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1608159220 msgr2=0x7f16081eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1608159220 0x7f16081eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 -- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c9270 msgr2=0x7f16081ee860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c9270 0x7f16081ee860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606a00700 1 -- 172.21.15.47:0/1261338256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1600009b30 con 0x7f16080c5c40 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1607400700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1608159220 0x7f16081eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.948+0000 7f1606000700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c9270 0x7f16081ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.949+0000 7f1606a00700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 0x7f16080bf6f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15f800e870 tx=0x7f15f800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.949+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f8009590 con 0x7f16080c5c40 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.949+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15f800ee70 con 0x7f16080c5c40 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.949+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16081ef2e0 con 0x7f16080c5c40 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.949+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f800ca70 con 0x7f16080c5c40 2024-05-10T04:52:20.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.949+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16081e15b0 con 0x7f16080c5c40 2024-05-10T04:52:20.952 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.950+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16080bf540 con 0x7f16080c5c40 2024-05-10T04:52:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.951+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15f800cbd0 con 0x7f16080c5c40 2024-05-10T04:52:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.952+0000 7f15fea00700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15e806acc0 0x7f15e806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.952+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15f80895c0 con 0x7f16080c5c40 2024-05-10T04:52:20.953 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.953+0000 7f1606000700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15e806acc0 0x7f15e806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:20.956 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:20.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.953+0000 7f1606000700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15e806acc0 0x7f15e806d1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15f4000f60 tx=0x7f15f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:20.957 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:20.957+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15f80544a0 con 0x7f16080c5c40 2024-05-10T04:52:21.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.184+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1608074720 con 0x7f16080c5c40 2024-05-10T04:52:21.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.185+0000 7f15fea00700 1 -- 172.21.15.47:0/1261338256 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f15f8057ac0 con 0x7f16080c5c40 2024-05-10T04:52:21.186 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:21.187 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15e806acc0 msgr2=0x7f15e806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15e806acc0 0x7f15e806d1d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f15f4000f60 tx=0x7f15f4009040 comp rx=0 tx=0).stop 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 msgr2=0x7f16080bf6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 0x7f16080bf6f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f15f800e870 tx=0x7f15f800ec30 comp rx=0 tx=0).stop 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 shutdown_connections 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15e806acc0 0x7f15e806d1d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1608159220 0x7f16081eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f16080c5c40 0x7f16080bf6f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 --2- 172.21.15.47:0/1261338256 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f16080c9270 0x7f16081ee860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 >> 172.21.15.47:0/1261338256 conn(0x7f16080ca940 msgr2=0x7f1608158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 shutdown_connections 2024-05-10T04:52:21.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.188+0000 7f160d800700 1 -- 172.21.15.47:0/1261338256 wait complete. 2024-05-10T04:52:21.215 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-10T04:52:21.215 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-10T04:52:21.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-10T04:52:21.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-10T04:52:21.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-10T04:52:21.217 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-10T04:52:21.217 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-10T04:52:21.218 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-10T04:52:21.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.711+0000 7f734d600700 1 Processor -- start 2024-05-10T04:52:21.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.711+0000 7f734d600700 1 -- start start 2024-05-10T04:52:21.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.714+0000 7f734d600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.714+0000 7f734d600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f73400db790 0x7f734004ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f734d600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f734000f0e0 con 0x7f7340035550 2024-05-10T04:52:21.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f734d600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7340035960 con 0x7f73400db790 2024-05-10T04:52:21.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f734d600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734004b450 con 0x7f734004b040 2024-05-10T04:52:21.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f7347e00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f7340035550 0x7f73400075d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46034/0 (socket says 172.21.15.47:46034) 2024-05-10T04:52:21.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f7347e00700 1 -- 172.21.15.47:0/372687382 learned_addr learned my addr 172.21.15.47:0/372687382 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:21.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f734cc00700 1 --2- 172.21.15.47:0/372687382 >> v2:172.21.15.117:3300/0 conn(0x7f73400db790 0x7f734004ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.715+0000 7f7347400700 1 --2- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.716+0000 7f7346a00700 1 -- 172.21.15.47:0/372687382 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557858860 0 0) 0x7f734000f0e0 con 0x7f7340035550 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.716+0000 7f7346a00700 1 -- 172.21.15.47:0/372687382 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73300035b0 con 0x7f7340035550 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.716+0000 7f734cc00700 1 -- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 msgr2=0x7f73400db250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.716+0000 7f734cc00700 1 --2- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400db250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.716+0000 7f734cc00700 1 -- 172.21.15.47:0/372687382 >> v1:172.21.15.117:6789/0 conn(0x7f7340035550 legacy=0x7f73400075d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.716+0000 7f734cc00700 1 -- 172.21.15.47:0/372687382 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734000e4d0 con 0x7f73400db790 2024-05-10T04:52:21.717 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.717+0000 7f734cc00700 1 --2- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f734004ddf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f734802d440 tx=0x7f734804fe00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868ac27ee5a5499d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.717+0000 7f7346a00700 1 -- 172.21.15.47:0/372687382 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348068630 con 0x7f73400db790 2024-05-10T04:52:21.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.717+0000 7f7346a00700 1 -- 172.21.15.47:0/372687382 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7348068790 con 0x7f73400db790 2024-05-10T04:52:21.718 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.717+0000 7f7346a00700 1 -- 172.21.15.47:0/372687382 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348092600 con 0x7f73400db790 2024-05-10T04:52:21.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.719+0000 7f734d600700 1 -- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 msgr2=0x7f734004ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.719+0000 7f734d600700 1 --2- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f734004ddf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f734802d440 tx=0x7f734804fe00 comp rx=0 tx=0).stop 2024-05-10T04:52:21.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.719+0000 7f734d600700 1 -- 172.21.15.47:0/372687382 shutdown_connections 2024-05-10T04:52:21.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.719+0000 7f734d600700 1 --2- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f734004ddf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.719+0000 7f734d600700 1 --2- 172.21.15.47:0/372687382 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.719+0000 7f734d600700 1 -- 172.21.15.47:0/372687382 >> 172.21.15.47:0/372687382 conn(0x7f734004c850 msgr2=0x7f734004cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.720+0000 7f734d600700 1 -- 172.21.15.47:0/372687382 shutdown_connections 2024-05-10T04:52:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.723+0000 7fa3dd600700 1 Processor -- start 2024-05-10T04:52:21.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.722+0000 7f339e400700 1 Processor -- start 2024-05-10T04:52:21.725 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.722+0000 7f339e400700 1 -- start start 2024-05-10T04:52:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.720+0000 7f734d600700 1 -- 172.21.15.47:0/372687382 wait complete. 2024-05-10T04:52:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.725+0000 7f734d600700 1 Processor -- start 2024-05-10T04:52:21.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.726+0000 7f734d600700 1 -- start start 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.725+0000 7f339e400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33980c1080 0x7f3398162260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.725+0000 7f339e400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33981660e0 0x7f33980c6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.725+0000 7f339e400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33980c27c0 con 0x7f33980c6ed0 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.725+0000 7f339e400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980c1c90 con 0x7f33980c1080 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.725+0000 7f339e400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33980c2fb0 con 0x7f33981660e0 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.726+0000 7f3397400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f33980c1080 0x7f3398162260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.726+0000 7f3396a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f33981660e0 0x7f33980c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.726+0000 7f3397e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f33980c6ed0 0x7f339806abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43544/0 (socket says 172.21.15.47:43544) 2024-05-10T04:52:21.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.727+0000 7f3397e00700 1 -- 172.21.15.47:0/1876003640 learned_addr learned my addr 172.21.15.47:0/1876003640 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.724+0000 7fa3dd600700 1 -- start start 2024-05-10T04:52:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.727+0000 7fa3dd600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 0x7fa3d806daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7fa3d7e00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fa3d80c2160 0x7fa3d80c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46050/0 (socket says 172.21.15.47:46050) 2024-05-10T04:52:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7fa3cf400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 0x7fa3d806daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.729 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7fa3cf400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 0x7fa3d806daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50376/0 (socket says 172.21.15.47:50376) 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7fec07a00700 1 Processor -- start 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7f3397400700 1 -- 172.21.15.47:0/1876003640 >> v2:172.21.15.117:3300/0 conn(0x7f33981660e0 msgr2=0x7f33980c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7f3396000700 1 -- 172.21.15.47:0/1876003640 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4053719932 0 0) 0x7f33980c27c0 con 0x7f33980c6ed0 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7f3397400700 1 --2- 172.21.15.47:0/1876003640 >> v2:172.21.15.117:3300/0 conn(0x7f33981660e0 0x7f33980c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.728+0000 7f3397400700 1 -- 172.21.15.47:0/1876003640 >> v1:172.21.15.47:6789/0 conn(0x7f33980c6ed0 legacy=0x7f339806abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7f3397400700 1 -- 172.21.15.47:0/1876003640 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33981627a0 con 0x7f33980c1080 2024-05-10T04:52:21.730 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7fa3dd600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fa3d80c2ce0 0x7fa3d806dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7fec07a00700 1 -- start start 2024-05-10T04:52:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7fa3d7e00700 1 -- 172.21.15.47:0/729517304 learned_addr learned my addr 172.21.15.47:0/729517304 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80722b0 con 0x7fa3d80c2160 2024-05-10T04:52:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/729517304 >> v2:172.21.15.117:3300/0 conn(0x7fa3d80c2ce0 0x7fa3d806dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d8072710 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80abdf0 con 0x7fa3d814e870 2024-05-10T04:52:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7f3396a00700 1 --2- 172.21.15.47:0/1876003640 >> v2:172.21.15.117:3300/0 conn(0x7f33981660e0 0x7f33980c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.729+0000 7f3397400700 1 --2- 172.21.15.47:0/1876003640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 0x7f3398162260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f33980c3150 tx=0x7f3384009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312437bf3cffd190 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7f3396000700 1 -- 172.21.15.47:0/1876003640 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384004220 con 0x7f33980c1080 2024-05-10T04:52:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7fa3d7400700 1 -- 172.21.15.47:0/729517304 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786086605 0 0) 0x7fa3d80722b0 con 0x7fa3d80c2160 2024-05-10T04:52:21.732 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7f3396000700 1 -- 172.21.15.47:0/1876003640 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3384004380 con 0x7f33980c1080 2024-05-10T04:52:21.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7fbd70400700 1 Processor -- start 2024-05-10T04:52:21.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7fa3d7400700 1 -- 172.21.15.47:0/729517304 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc0035b0 con 0x7fa3d80c2160 2024-05-10T04:52:21.733 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.730+0000 7f734d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7340035550 0x7f7340046e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7fa3dcc00700 1 -- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 msgr2=0x7fa3d806daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7f734d600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400dd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 0x7fa3d806daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.734 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7fa3dcc00700 1 -- 172.21.15.47:0/729517304 >> v1:172.21.15.117:6789/0 conn(0x7fa3d80c2160 legacy=0x7fa3d80c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7f734d600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f73400d62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7fa3dcc00700 1 -- 172.21.15.47:0/729517304 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80ac560 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7f734d600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340048ef0 con 0x7f7340035550 2024-05-10T04:52:21.735 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7f734d600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400476f0 con 0x7f73400db790 2024-05-10T04:52:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7fa3cf400700 1 --2- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 0x7fa3d806daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7f734d600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73400363f0 con 0x7f734004b040 2024-05-10T04:52:21.736 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.731+0000 7fbd70400700 1 -- start start 2024-05-10T04:52:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d806dfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009840 tx=0x7fa3d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5cb7afe2cc1b6652 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7f3396000700 1 -- 172.21.15.47:0/1876003640 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384010890 con 0x7f33980c1080 2024-05-10T04:52:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7fa3d7400700 1 -- 172.21.15.47:0/729517304 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004230 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7fa3d7400700 1 -- 172.21.15.47:0/729517304 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d0004390 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.737 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7fa3d7400700 1 -- 172.21.15.47:0/729517304 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0004230 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7f734cc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f73400d62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7f734cc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f73400d62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53004/0 (socket says 172.21.15.47:53004) 2024-05-10T04:52:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7f734cc00700 1 -- 172.21.15.47:0/3861347840 learned_addr learned my addr 172.21.15.47:0/3861347840 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 -- 172.21.15.47:0/1876003640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 msgr2=0x7f3398162260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.738 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 --2- 172.21.15.47:0/1876003640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 0x7f3398162260 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f33980c3150 tx=0x7f3384009b20 comp rx=0 tx=0).stop 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 -- 172.21.15.47:0/1876003640 shutdown_connections 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 --2- 172.21.15.47:0/1876003640 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 0x7f3398162260 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 --2- 172.21.15.47:0/1876003640 >> v2:172.21.15.117:3300/0 conn(0x7f33981660e0 0x7f33980c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 -- 172.21.15.47:0/1876003640 >> 172.21.15.47:0/1876003640 conn(0x7f33980a86c0 msgr2=0x7f33980a8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7f7347e00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7340035550 0x7f7340046e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f7347400700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400dd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7f339e400700 1 -- 172.21.15.47:0/1876003640 shutdown_connections 2024-05-10T04:52:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 msgr2=0x7fa3d806dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fa3dd600700 1 --2- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d806dfe0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa3d0009840 tx=0x7fa3d0009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.732+0000 7fec07a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf802e0a0 0x7febf80e24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fec07a00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf804b110 con 0x7febf80dac30 2024-05-10T04:52:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fec07a00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf8047230 con 0x7febf804a090 2024-05-10T04:52:21.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fec07a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf804aac0 con 0x7febf802e0a0 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fec05a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf802e0a0 0x7febf80e24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.733+0000 7fec05000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7febf80dac30 0x7febf80d43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43554/0 (socket says 172.21.15.47:43554) 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fec05000700 1 -- 172.21.15.47:0/2970824761 learned_addr learned my addr 172.21.15.47:0/2970824761 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 shutdown_connections 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fa3dd600700 1 --2- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d806dfe0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fa3dd600700 1 --2- 172.21.15.47:0/729517304 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d814e870 0x7fa3d806daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 >> 172.21.15.47:0/729517304 conn(0x7fa3d80c65e0 msgr2=0x7fa3d80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7f339e400700 1 -- 172.21.15.47:0/1876003640 wait complete. 2024-05-10T04:52:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 shutdown_connections 2024-05-10T04:52:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7fa3dd600700 1 -- 172.21.15.47:0/729517304 wait complete. 2024-05-10T04:52:21.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638509913 0 0) 0x7febf8047230 con 0x7febf804a090 2024-05-10T04:52:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.734+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe80035b0 con 0x7febf804a090 2024-05-10T04:52:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fbd70400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd680c6680 0x7fbd6814eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fbd70400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbd6806b000 0x7fbd68155680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fbd70400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd680c17f0 con 0x7fbd6806abf0 2024-05-10T04:52:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fbd70400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd680732d0 con 0x7fbd680c6680 2024-05-10T04:52:21.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fbd70400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6806b410 con 0x7fbd6806b000 2024-05-10T04:52:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67605165 0 0) 0x7febf804b110 con 0x7febf80dac30 2024-05-10T04:52:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf8047230 con 0x7febf80dac30 2024-05-10T04:52:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fec05a00700 1 -- 172.21.15.47:0/2970824761 >> v1:172.21.15.117:6789/0 conn(0x7febf804a090 legacy=0x7febf80060e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fec05a00700 1 -- 172.21.15.47:0/2970824761 >> v1:172.21.15.47:6789/0 conn(0x7febf80dac30 legacy=0x7febf80d43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7fbd6da00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd680c6680 0x7fbd6814eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7f111d600700 1 Processor -- start 2024-05-10T04:52:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7fbd6da00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbd680c6680 0x7fbd6814eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36622/0 (socket says 172.21.15.47:36622) 2024-05-10T04:52:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7f9546200700 1 Processor -- start 2024-05-10T04:52:21.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7fbd6da00700 1 -- 172.21.15.47:0/2120142134 learned_addr learned my addr 172.21.15.47:0/2120142134 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.735+0000 7fec05a00700 1 -- 172.21.15.47:0/2970824761 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf804ada0 con 0x7febf802e0a0 2024-05-10T04:52:21.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7f9546200700 1 -- start start 2024-05-10T04:52:21.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7fec05a00700 1 --2- 172.21.15.47:0/2970824761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf802e0a0 0x7febf80e24f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7febf0009870 tx=0x7febf0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e294f48fb83f8c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.737+0000 7f7347400700 1 -- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 msgr2=0x7f73400d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.737+0000 7f7347400700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f73400db790 0x7f73400d62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.737+0000 7f7347400700 1 -- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7340035550 msgr2=0x7f7340046e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.737+0000 7f7347400700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7340035550 0x7f7340046e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.737+0000 7f7347400700 1 -- 172.21.15.47:0/3861347840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7348073ad0 con 0x7f734004b040 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.737+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0011830 con 0x7febf802e0a0 2024-05-10T04:52:21.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf0011990 con 0x7febf802e0a0 2024-05-10T04:52:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7febff400700 1 -- 172.21.15.47:0/2970824761 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0011d20 con 0x7febf802e0a0 2024-05-10T04:52:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7fbd6e400700 1 --2- 172.21.15.47:0/2120142134 >> v2:172.21.15.117:3300/0 conn(0x7fbd6806b000 0x7fbd68155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f339e400700 1 Processor -- start 2024-05-10T04:52:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f9546200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 0x7f95400c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f9546200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95400721a0 0x7f9540152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f9546200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9540152810 con 0x7f95400725b0 2024-05-10T04:52:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.736+0000 7f111d600700 1 -- start start 2024-05-10T04:52:21.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f9546200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95400c25e0 con 0x7f95400721a0 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f9546200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95400c6df0 con 0x7f9540073010 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f953f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 0x7f95400c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 0x7f95400c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50398/0 (socket says 172.21.15.47:50398) 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 -- 172.21.15.47:0/1237380511 learned_addr learned my addr 172.21.15.47:0/1237380511 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 -- 172.21.15.47:0/1237380511 >> v2:172.21.15.47:3300/0 conn(0x7f95400721a0 msgr2=0x7f9540152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 --2- 172.21.15.47:0/1237380511 >> v2:172.21.15.47:3300/0 conn(0x7f95400721a0 0x7f9540152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 -- 172.21.15.47:0/1237380511 >> v1:172.21.15.47:6789/0 conn(0x7f95400725b0 legacy=0x7f954014f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 -- 172.21.15.47:0/1237380511 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95400c1c20 con 0x7f9540073010 2024-05-10T04:52:21.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7fa3dd600700 1 Processor -- start 2024-05-10T04:52:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f339e400700 1 -- start start 2024-05-10T04:52:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.739+0000 7f953f400700 1 --2- 172.21.15.47:0/1237380511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 0x7f95400c5ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95300098f0 tx=0x7f9530009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299b5730048571da server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.738+0000 7f7347e00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7340035550 0x7f7340046e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f953e000700 1 -- 172.21.15.47:0/1237380511 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530004230 con 0x7f9540073010 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f7347400700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400dd720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f733400d600 tx=0x7f733400d910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fbd67e00700 1 -- 172.21.15.47:0/2120142134 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122343045 0 0) 0x7fbd680c17f0 con 0x7fbd6806abf0 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fbd67e00700 1 -- 172.21.15.47:0/2120142134 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd500035b0 con 0x7fbd6806abf0 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fbd6e400700 1 -- 172.21.15.47:0/2120142134 >> v2:172.21.15.47:3300/0 conn(0x7fbd680c6680 msgr2=0x7fbd6814eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fbd6e400700 1 --2- 172.21.15.47:0/2120142134 >> v2:172.21.15.47:3300/0 conn(0x7fbd680c6680 0x7fbd6814eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fbd6e400700 1 -- 172.21.15.47:0/2120142134 >> v1:172.21.15.117:6789/0 conn(0x7fbd6806abf0 legacy=0x7fbd68154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fbd6e400700 1 -- 172.21.15.47:0/2120142134 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd680c1510 con 0x7fbd6806b000 2024-05-10T04:52:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f953e000700 1 -- 172.21.15.47:0/1237380511 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9530004390 con 0x7f9540073010 2024-05-10T04:52:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f953e000700 1 -- 172.21.15.47:0/1237380511 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9530010890 con 0x7f9540073010 2024-05-10T04:52:21.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fa3dd600700 1 -- start start 2024-05-10T04:52:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f339e400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 0x7f33981ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f339e400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33980c6ed0 0x7f3398163eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f339e400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33981660e0 0x7f339815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f339e400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33981f82a0 con 0x7f33980c1080 2024-05-10T04:52:21.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f339e400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339815f210 con 0x7f33980c6ed0 2024-05-10T04:52:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f339e400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33980bb6a0 con 0x7f33981660e0 2024-05-10T04:52:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f3397e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33981660e0 0x7f339815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f3396a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33980c6ed0 0x7f3398163eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f3396a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33980c6ed0 0x7f3398163eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53034/0 (socket says 172.21.15.47:53034) 2024-05-10T04:52:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f3396a00700 1 -- 172.21.15.47:0/660615777 learned_addr learned my addr 172.21.15.47:0/660615777 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f9546200700 1 -- 172.21.15.47:0/1237380511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 msgr2=0x7f95400c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f9546200700 1 --2- 172.21.15.47:0/1237380511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 0x7f95400c5ad0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f95300098f0 tx=0x7f9530009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:21.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fec07a00700 1 -- 172.21.15.47:0/2970824761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf802e0a0 msgr2=0x7febf80e24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7fec07a00700 1 --2- 172.21.15.47:0/2970824761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf802e0a0 0x7febf80e24f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7febf0009870 tx=0x7febf0009b80 comp rx=0 tx=0).stop 2024-05-10T04:52:21.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f9546200700 1 -- 172.21.15.47:0/1237380511 shutdown_connections 2024-05-10T04:52:21.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f3396a00700 1 -- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33981660e0 msgr2=0x7f339815e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f3396a00700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f33981660e0 0x7f339815e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f3396a00700 1 -- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 msgr2=0x7f33981ed0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f3396a00700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f33980c1080 0x7f33981ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f3396a00700 1 -- 172.21.15.47:0/660615777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338800c6c0 con 0x7f33980c6ed0 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f9546200700 1 --2- 172.21.15.47:0/1237380511 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9540073010 0x7f95400c5ad0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f9546200700 1 --2- 172.21.15.47:0/1237380511 >> v2:172.21.15.47:3300/0 conn(0x7f95400721a0 0x7f9540152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f9546200700 1 -- 172.21.15.47:0/1237380511 >> 172.21.15.47:0/1237380511 conn(0x7f954006c330 msgr2=0x7f95400a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7334017070 con 0x7f734004b040 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7fbd6e400700 1 --2- 172.21.15.47:0/2120142134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6806b000 0x7fbd68155680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd68070c60 tx=0x7fbd54009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53941955f1c7b130 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7334004020 con 0x7f734004b040 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340041d0 con 0x7f734004b040 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.740+0000 7f734d600700 1 -- 172.21.15.47:0/3861347840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7340048c10 con 0x7f734004b040 2024-05-10T04:52:21.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.741+0000 7f734d600700 1 -- 172.21.15.47:0/3861347840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7340037a30 con 0x7f734004b040 2024-05-10T04:52:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fec07a00700 1 -- 172.21.15.47:0/2970824761 shutdown_connections 2024-05-10T04:52:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fec07a00700 1 --2- 172.21.15.47:0/2970824761 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf802e0a0 0x7febf80e24f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fec07a00700 1 -- 172.21.15.47:0/2970824761 >> 172.21.15.47:0/2970824761 conn(0x7febf802d580 msgr2=0x7febf802d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7fbd67e00700 1 -- 172.21.15.47:0/2120142134 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54004230 con 0x7fbd6806b000 2024-05-10T04:52:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7fbd67e00700 1 -- 172.21.15.47:0/2120142134 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd54004390 con 0x7fbd6806b000 2024-05-10T04:52:21.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7fbd67e00700 1 -- 172.21.15.47:0/2120142134 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd540036a0 con 0x7fbd6806b000 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fbd70400700 1 -- 172.21.15.47:0/2120142134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6806b000 msgr2=0x7fbd68155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fbd70400700 1 --2- 172.21.15.47:0/2120142134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6806b000 0x7fbd68155680 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbd68070c60 tx=0x7fbd54009b20 comp rx=0 tx=0).stop 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f3396a00700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33980c6ed0 0x7f3398163eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f338800acb0 tx=0x7f338800c590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388011040 con 0x7f33980c6ed0 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3388007990 con 0x7f33980c6ed0 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388007d40 con 0x7f33980c6ed0 2024-05-10T04:52:21.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33840094a0 con 0x7f33980c6ed0 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f9546200700 1 -- 172.21.15.47:0/1237380511 shutdown_connections 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fa3dd600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d80c2160 0x7fa3d8150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fa3dd600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d81480e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fa3dd600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d814e870 0x7fa3d8146f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fa3dd600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81eee90 con 0x7fa3d814e870 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fa3dd600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81dd290 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7fa3dd600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81506a0 con 0x7fa3d80c2160 2024-05-10T04:52:21.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7f734d600700 1 -- 172.21.15.47:0/3861347840 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f734000ed70 con 0x7f734004b040 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fec07a00700 1 -- 172.21.15.47:0/2970824761 shutdown_connections 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fbd70400700 1 -- 172.21.15.47:0/2120142134 shutdown_connections 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fbd70400700 1 --2- 172.21.15.47:0/2120142134 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd6806b000 0x7fbd68155680 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fbd70400700 1 --2- 172.21.15.47:0/2120142134 >> v2:172.21.15.47:3300/0 conn(0x7fbd680c6680 0x7fbd6814eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fbd70400700 1 -- 172.21.15.47:0/2120142134 >> 172.21.15.47:0/2120142134 conn(0x7fbd680a86c0 msgr2=0x7fbd680a8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33980bbc60 con 0x7f33980c6ed0 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f9546200700 1 -- 172.21.15.47:0/1237380511 wait complete. 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fa3d7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d80c2160 0x7fa3d8150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fa3d7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d80c2160 0x7fa3d8150160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50434/0 (socket says 172.21.15.47:50434) 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fa3d7e00700 1 -- 172.21.15.47:0/2939435363 learned_addr learned my addr 172.21.15.47:0/2939435363 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d814e870 0x7fa3d8146f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fa3cf400700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d81480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fa3cf400700 1 -- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d80c2160 msgr2=0x7fa3d8150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fa3cf400700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa3d80c2160 0x7fa3d8150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fa3cf400700 1 -- 172.21.15.47:0/2939435363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d814e870 msgr2=0x7fa3d8146f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fa3cf400700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d814e870 0x7fa3d8146f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fa3cf400700 1 -- 172.21.15.47:0/2939435363 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c000a640 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa3d814e870 0x7fa3d8146f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7fa3cf400700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d81480e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000e910 tx=0x7fa3c000ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f111d600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1118072f80 0x7f11180c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.742+0000 7f111d600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 0x7f111806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f111d600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f111806e410 0x7f11180aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f111d600700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11180c6f10 con 0x7f11180c1080 2024-05-10T04:52:21.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f111d600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1118072bd0 con 0x7f111806e410 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f111d600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111815a5d0 con 0x7f1118072f80 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f1116000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 0x7f111806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f1116000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 0x7f111806ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36666/0 (socket says 172.21.15.47:36666) 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f1116000700 1 -- 172.21.15.47:0/4273902480 learned_addr learned my addr 172.21.15.47:0/4273902480 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.743+0000 7f1116a00700 1 --2- 172.21.15.47:0/4273902480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1118072f80 0x7f11180c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7f1116a00700 1 -- 172.21.15.47:0/4273902480 >> v2:172.21.15.117:3300/0 conn(0x7f111806e410 msgr2=0x7f11180aa7d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7f1116a00700 1 --2- 172.21.15.47:0/4273902480 >> v2:172.21.15.117:3300/0 conn(0x7f111806e410 0x7f11180aa7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7f1116a00700 1 -- 172.21.15.47:0/4273902480 >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 msgr2=0x7f111806ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7f1116a00700 1 --2- 172.21.15.47:0/4273902480 >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 0x7f111806ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7f1116a00700 1 -- 172.21.15.47:0/4273902480 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11180aa4f0 con 0x7f1118072f80 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7f1116000700 1 --2- 172.21.15.47:0/4273902480 >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 0x7f111806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7f1116a00700 1 --2- 172.21.15.47:0/4273902480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1118072f80 0x7f11180c69d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f111806cf30 tx=0x7f111000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e2740c60d7f0fef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7f1115600700 1 -- 172.21.15.47:0/4273902480 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111000e070 con 0x7f1118072f80 2024-05-10T04:52:21.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7f1115600700 1 -- 172.21.15.47:0/4273902480 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111000bb20 con 0x7f1118072f80 2024-05-10T04:52:21.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.744+0000 7fef8ea00700 1 Processor -- start 2024-05-10T04:52:21.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.745+0000 7fef8ea00700 1 -- start start 2024-05-10T04:52:21.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7f1115600700 1 -- 172.21.15.47:0/4273902480 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110012430 con 0x7f1118072f80 2024-05-10T04:52:21.766 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7fec07a00700 1 -- 172.21.15.47:0/2970824761 wait complete. 2024-05-10T04:52:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f9546200700 1 Processor -- start 2024-05-10T04:52:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.747+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3398165bc0 con 0x7f33980c6ed0 2024-05-10T04:52:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0004230 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0004390 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 -- 172.21.15.47:0/4273902480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1118072f80 msgr2=0x7f11180c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 --2- 172.21.15.47:0/4273902480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1118072f80 0x7f11180c69d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f111806cf30 tx=0x7f111000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00036a0 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.747+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d00094a0 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.747+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d81dd7c0 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.768 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f9546200700 1 -- start start 2024-05-10T04:52:21.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 -- 172.21.15.47:0/4273902480 shutdown_connections 2024-05-10T04:52:21.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 --2- 172.21.15.47:0/4273902480 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1118072f80 0x7f11180c69d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa3d814ef20 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 --2- 172.21.15.47:0/4273902480 >> v2:172.21.15.117:3300/0 conn(0x7f111806e410 0x7f11180aa7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 --2- 172.21.15.47:0/4273902480 >> v2:172.21.15.47:3300/0 conn(0x7f11180c1080 0x7f111806ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f111d600700 1 -- 172.21.15.47:0/4273902480 >> 172.21.15.47:0/4273902480 conn(0x7f11180a8ae0 msgr2=0x7f11180a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7fef8ea00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 0x7fef880c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7fef8ea00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8806d640 con 0x7fef8806bdb0 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7fef8ea00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef880c9800 con 0x7fef880c6cc0 2024-05-10T04:52:21.770 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7fef8ea00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88152fc0 con 0x7fef88152bb0 2024-05-10T04:52:21.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.746+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7334004330 con 0x7f734004b040 2024-05-10T04:52:21.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.747+0000 7f733be00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f732806acc0 0x7f732806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7334054210 con 0x7f734004b040 2024-05-10T04:52:21.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7f733be00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f7328074250 0x7f73280766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.771 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 --> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7328076db0 con 0x7f7328074250 2024-05-10T04:52:21.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73340543d0 con 0x7f734004b040 2024-05-10T04:52:21.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7fbd70400700 1 -- 172.21.15.47:0/2120142134 shutdown_connections 2024-05-10T04:52:21.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7fbd70400700 1 -- 172.21.15.47:0/2120142134 wait complete. 2024-05-10T04:52:21.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.748+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f338801f460 con 0x7f33980c6ed0 2024-05-10T04:52:21.772 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7f338f400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806acc0 0x7f337806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33880899b0 con 0x7f33980c6ed0 2024-05-10T04:52:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f9546200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95400721a0 0x7f954014f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f7347e00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f732806acc0 0x7f732806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.773 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f734cc00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f7328074250 0x7f73280766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7fec07a00700 1 Processor -- start 2024-05-10T04:52:21.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7fef87e00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fef880c6cc0 0x7fef880c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46094/0 (socket says 172.21.15.47:46094) 2024-05-10T04:52:21.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.750+0000 7fef87e00700 1 -- 172.21.15.47:0/1457563159 learned_addr learned my addr 172.21.15.47:0/1457563159 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:21.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7fef7fe00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 0x7fef880c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.774 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f9546200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9540073010 0x7f95401e8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f9546200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9540142880 0x7f95401e9470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f9546200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95401e8fb0 con 0x7f9540142880 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f9546200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95400a8f80 con 0x7f9540073010 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f9546200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95400ab150 con 0x7f95400721a0 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.751+0000 7f3397400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806acc0 0x7f337806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7f111d600700 1 -- 172.21.15.47:0/4273902480 shutdown_connections 2024-05-10T04:52:21.775 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.749+0000 7f111d600700 1 -- 172.21.15.47:0/4273902480 wait complete. 2024-05-10T04:52:21.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7f338f400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f3378074250 0x7f33780766e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 --> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3378076db0 con 0x7f3378074250 2024-05-10T04:52:21.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3388007ea0 con 0x7f33980c6ed0 2024-05-10T04:52:21.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3c0003800 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.776 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7f3397400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806acc0 0x7f337806d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33980c3150 tx=0x7f3384012000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696272383 0 0) 0x7fef8806d640 con 0x7fef8806bdb0 2024-05-10T04:52:21.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f3397e00700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f3378074250 0x7f33780766e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef6c0035b0 con 0x7fef8806bdb0 2024-05-10T04:52:21.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7f953fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9540142880 0x7f95401e9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9540073010 0x7f95401e8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9540073010 0x7f95401e8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53062/0 (socket says 172.21.15.47:53062) 2024-05-10T04:52:21.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 -- 172.21.15.47:0/875301008 learned_addr learned my addr 172.21.15.47:0/875301008 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.752+0000 7f734cc00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f7328074250 0x7f73280766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1016656672 0 0) 0x7fef6c0035b0 con 0x7fef8806bdb0 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 msgr2=0x7fef880c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7fef87400700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 0x7fef880c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 >> v1:172.21.15.117:6789/0 conn(0x7fef880c6cc0 legacy=0x7fef880c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7fec07a00700 1 -- start start 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 -- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95400721a0 msgr2=0x7f954014f230 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:52:21.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95400721a0 0x7f954014f230 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 -- 172.21.15.47:0/875301008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9540142880 msgr2=0x7f95401e9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9540142880 0x7f95401e9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.753+0000 7f953ea00700 1 -- 172.21.15.47:0/875301008 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9530009550 con 0x7f9540073010 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== osd.0 v2:172.21.15.47:6808/43823 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f7328076db0 con 0x7f7328074250 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec07a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf802e0a0 0x7febf80cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec07a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf804a090 0x7febf80d5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec07a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febf80dac30 0x7febf8041ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec07a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80cc350 con 0x7febf80dac30 2024-05-10T04:52:21.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec07a00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf80d6930 con 0x7febf802e0a0 2024-05-10T04:52:21.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec07a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf80d4550 con 0x7febf804a090 2024-05-10T04:52:21.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880c8910 con 0x7fef8806bdb0 2024-05-10T04:52:21.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7fef800019f0 con 0x7fef8806bdb0 2024-05-10T04:52:21.781 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7f3397e00700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f3378074250 0x7f33780766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fec05000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf802e0a0 0x7febf80cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7fa3d4c00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa3b406ace0 0x7fa3b406d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3c00895e0 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7fa3d4c00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7fa3b4074370 0x7fa3b4076800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 --> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3b4076ed0 con 0x7fa3b4074370 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3c0089a80 con 0x7fa3d80c2ce0 2024-05-10T04:52:21.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fa3d7e00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa3b406ace0 0x7fa3b406d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7f111d600700 1 Processor -- start 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7f111d600700 1 -- start start 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7fec05a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febf80dac30 0x7febf8041ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7febffe00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf804a090 0x7febf80d5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7febffe00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf804a090 0x7febf80d5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50476/0 (socket says 172.21.15.47:50476) 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7febffe00700 1 -- 172.21.15.47:0/3062237614 learned_addr learned my addr 172.21.15.47:0/3062237614 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7fa3b4074370 0x7fa3b4076800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 >> v1:172.21.15.47:6789/0 conn(0x7fef8806bdb0 legacy=0x7fef8806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c003a30 0x7fef6c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c004850 0x7fef6c004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 0x7fef6c005320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef88152fc0 con 0x7fef6c004850 2024-05-10T04:52:21.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c00bbf0 con 0x7fef6c003a30 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c00bdb0 con 0x7fef88152bb0 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7fef87e00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c003a30 0x7fef6c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7fef7fe00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c004850 0x7fef6c004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fef87e00700 1 -- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 msgr2=0x7fef6c005320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fef87e00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88152bb0 0x7fef6c005320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fef87e00700 1 -- 172.21.15.47:0/1457563159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c004850 msgr2=0x7fef6c004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f111d600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f111806e410 0x7f11180c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fef87e00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c004850 0x7fef6c004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.785 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fef87e00700 1 -- 172.21.15.47:0/1457563159 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef880c8910 con 0x7fef6c003a30 2024-05-10T04:52:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.757+0000 7fef7fe00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c004850 0x7fef6c004c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7f7347e00700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f732806acc0 0x7f732806d1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f733c007fd0 tx=0x7f733c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7fef87e00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c003a30 0x7fef6c003e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef780019a0 tx=0x7fef6c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e99caca0b75dbe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== osd.3 v2:172.21.15.47:6824/43825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3378076db0 con 0x7f3378074250 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7febffe00700 1 -- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf802e0a0 msgr2=0x7febf80cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7f953fe00700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9540142880 0x7f95401e9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.754+0000 7f953ea00700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9540073010 0x7f95401e8290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b4d0 tx=0x7f952c00b7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c011830 con 0x7f9540073010 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f952c011990 con 0x7f9540073010 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f952c011d40 con 0x7f9540073010 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95400c4010 con 0x7f9540073010 2024-05-10T04:52:21.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.755+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95400aab00 con 0x7f9540073010 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.756+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9540152240 con 0x7f9540073010 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f952c01a400 con 0x7f9540073010 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fa3d7e00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa3b406ace0 0x7fa3b406d1f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8008480 tx=0x7fa3c8005330 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7febffe00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf802e0a0 0x7febf80cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7febffe00700 1 -- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febf80dac30 msgr2=0x7febf8041ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7febffe00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febf80dac30 0x7febf8041ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7febffe00700 1 -- 172.21.15.47:0/3062237614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00094a0 con 0x7febf804a090 2024-05-10T04:52:21.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fa3dcc00700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7fa3b4074370 0x7fa3b4076800 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78001410 con 0x7fef6c003a30 2024-05-10T04:52:21.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef78005b60 con 0x7fef6c003a30 2024-05-10T04:52:21.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fef87400700 1 -- 172.21.15.47:0/1457563159 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780070d0 con 0x7fef6c003a30 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fec05a00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7febf80dac30 0x7febf8041ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7fec05000700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7febf802e0a0 0x7febf80cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f111d600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1118072f80 0x7f11180c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f111d600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11180c1080 0x7f11181524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f111d600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181e58b0 con 0x7f1118072f80 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f111d600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11181533a0 con 0x7f11180c1080 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.758+0000 7f111d600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11181e68a0 con 0x7f111806e410 2024-05-10T04:52:21.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1116a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f111806e410 0x7f11180c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7febffe00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf804a090 0x7febf80d5c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febf400c460 tx=0x7febf400c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1116a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f111806e410 0x7f11180c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50484/0 (socket says 172.21.15.47:50484) 2024-05-10T04:52:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1116a00700 1 -- 172.21.15.47:0/2879488667 learned_addr learned my addr 172.21.15.47:0/2879488667 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1117400700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11180c1080 0x7f11181524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1116a00700 1 -- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11180c1080 msgr2=0x7f11181524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1116a00700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11180c1080 0x7f11181524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.759+0000 7f1116a00700 1 -- 172.21.15.47:0/2879488667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1118072f80 msgr2=0x7f11180c0630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:52:21.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7fbd70400700 1 Processor -- start 2024-05-10T04:52:21.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40052d0 con 0x7febf804a090 2024-05-10T04:52:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7fbd70400700 1 -- start start 2024-05-10T04:52:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf4005430 con 0x7febf804a090 2024-05-10T04:52:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7fef8ea00700 1 -- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c003a30 msgr2=0x7fef6c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7fef8ea00700 1 --2- 172.21.15.47:0/1457563159 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef6c003a30 0x7fef6c003e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fef780019a0 tx=0x7fef6c005880 comp rx=0 tx=0).stop 2024-05-10T04:52:21.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7f9537400700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9520073570 0x7f9520075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f952c0895e0 con 0x7f9540073010 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7f9537400700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7f952007cc00 0x7f952007f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 --> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f952007f760 con 0x7f952007cc00 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f952c08bb40 con 0x7f9540073010 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7fec07a00700 1 -- 172.21.15.47:0/3062237614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf80d5780 con 0x7febf804a090 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7fec07a00700 1 -- 172.21.15.47:0/3062237614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf80d47a0 con 0x7febf804a090 2024-05-10T04:52:21.794 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== osd.5 v2:172.21.15.117:6808/44080 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fa3b4076ed0 con 0x7fa3b4074370 2024-05-10T04:52:21.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7fef8ca00700 1 -- 172.21.15.47:0/1457563159 reap_dead start 2024-05-10T04:52:21.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40052d0 con 0x7febf804a090 2024-05-10T04:52:21.795 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7f953fe00700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7f952007cc00 0x7f952007f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.760+0000 7f1116000700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1118072f80 0x7f11180c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7f1116a00700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1118072f80 0x7f11180c0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7f1116a00700 1 -- 172.21.15.47:0/2879488667 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1108009550 con 0x7f111806e410 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.761+0000 7f1116000700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1118072f80 0x7f11180c0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7f1116a00700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f111806e410 0x7f11180c5b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1110014040 tx=0x7f1110004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fef8ea00700 1 -- 172.21.15.47:0/1457563159 shutdown_connections 2024-05-10T04:52:21.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fef8ea00700 1 -- 172.21.15.47:0/1457563159 >> 172.21.15.47:0/1457563159 conn(0x7fef880ca960 msgr2=0x7fef880cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febd8000fb0 con 0x7febf804a090 2024-05-10T04:52:21.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fef8ea00700 1 -- 172.21.15.47:0/1457563159 shutdown_connections 2024-05-10T04:52:21.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110004680 con 0x7f111806e410 2024-05-10T04:52:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fbd70400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6806abf0 0x7fbd6813be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fbd70400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd6806b000 0x7fbd6813abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1110031070 con 0x7f111806e410 2024-05-10T04:52:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fbd70400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680c6680 0x7fbd68138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.798 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fbd70400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6813c3d0 con 0x7fbd6806b000 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fbd70400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd680bcba0 con 0x7fbd680c6680 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fbd70400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6813a760 con 0x7fbd6806abf0 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6806abf0 0x7fbd6813be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6806abf0 0x7fbd6813be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50498/0 (socket says 172.21.15.47:50498) 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 -- 172.21.15.47:0/1608732985 learned_addr learned my addr 172.21.15.47:0/1608732985 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6d000700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd6806b000 0x7fbd6813abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 -- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680c6680 msgr2=0x7fbd68138200 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbd680c6680 0x7fbd68138200 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 -- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd6806b000 msgr2=0x7fbd6813abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.799 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7f953fe00700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7f952007cc00 0x7f952007f090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1110009a70 con 0x7f111806e410 2024-05-10T04:52:21.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1110038480 con 0x7f111806e410 2024-05-10T04:52:21.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11181f3ba0 con 0x7f111806e410 2024-05-10T04:52:21.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.765+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== osd.4 v2:172.21.15.117:6800/44079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f952007f760 con 0x7f952007cc00 2024-05-10T04:52:21.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.762+0000 7fef8ea00700 1 -- 172.21.15.47:0/1457563159 wait complete. 2024-05-10T04:52:21.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.765+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f111815da00 con 0x7f111806e410 2024-05-10T04:52:21.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.766+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febf4003680 con 0x7febf804a090 2024-05-10T04:52:21.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.766+0000 7fef8ea00700 1 Processor -- start 2024-05-10T04:52:21.801 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.767+0000 7fef8ea00700 1 -- start start 2024-05-10T04:52:21.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.767+0000 7febfcc00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febe406ad20 0x7febe406d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.767+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febf4001150 con 0x7febf804a090 2024-05-10T04:52:21.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd6806b000 0x7fbd6813abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.763+0000 7fbd6da00700 1 -- 172.21.15.47:0/1608732985 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd540094a0 con 0x7fbd6806abf0 2024-05-10T04:52:21.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7fbd6d000700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbd6806b000 0x7fbd6813abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:21.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7febfcc00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7febe4075050 0x7febe4077540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7fec05000700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febe406ad20 0x7febe406d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.765+0000 7f953f400700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9520073570 0x7f9520075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.766+0000 7f953f400700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9520073570 0x7f9520075a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95300098f0 tx=0x7f9530014000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 --> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febe4077c10 con 0x7febe4075050 2024-05-10T04:52:21.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1110012430 con 0x7f111806e410 2024-05-10T04:52:21.804 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7fbd6da00700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6806abf0 0x7fbd6813be90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e8e0 tx=0x7fbd5c00eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.768+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7febf4057360 con 0x7febf804a090 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.769+0000 7fec05a00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7febe4075050 0x7febe4077540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.769+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c00eee0 con 0x7fbd6806abf0 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.769+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c00c850 con 0x7fbd6806abf0 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.769+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c009600 con 0x7fbd6806abf0 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.769+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd680c0230 con 0x7fbd6806abf0 2024-05-10T04:52:21.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.769+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd680be580 con 0x7fbd6806abf0 2024-05-10T04:52:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.770+0000 7fec05000700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febe406ad20 0x7febe406d230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fec000644e0 tx=0x7fec00068bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.770+0000 7fec05a00700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7febe4075050 0x7febe4077540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.770+0000 7f110ea00700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f10f806ad10 0x7f10f806d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.771+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd44000fb0 con 0x7fbd6806abf0 2024-05-10T04:52:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.771+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1110033070 con 0x7f111806e410 2024-05-10T04:52:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.771+0000 7f1116000700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f10f806ad10 0x7f10f806d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.771+0000 7f110ea00700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f10f80743a0 0x7f10f8076830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 --> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10f8076f00 con 0x7f10f80743a0 2024-05-10T04:52:21.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.773+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f111009bc90 con 0x7f111806e410 2024-05-10T04:52:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef8ea00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c003a30 0x7fef8814e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef8ea00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8814b8d0 0x7fef88154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef8ea00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88155980 0x7fef88155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef8ea00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881562d0 con 0x7fef6c003a30 2024-05-10T04:52:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef8ea00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8814f280 con 0x7fef8814b8d0 2024-05-10T04:52:21.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.773+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== osd.1 v2:172.21.15.47:6816/43821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7febe4077c10 con 0x7febe4075050 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef8ea00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef881550e0 con 0x7fef88155980 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef7fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8814b8d0 0x7fef88154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef7fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8814b8d0 0x7fef88154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53122/0 (socket says 172.21.15.47:53122) 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.772+0000 7fef7fe00700 1 -- 172.21.15.47:0/3859738792 learned_addr learned my addr 172.21.15.47:0/3859738792 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.773+0000 7fef87e00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c003a30 0x7fef8814e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.773+0000 7fef8ca00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88155980 0x7fef88155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.773+0000 7f1117400700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f10f80743a0 0x7f10f8076830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.773+0000 7f1116000700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f10f806ad10 0x7f10f806d220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1118071b10 tx=0x7f1108008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.774+0000 7fef87e00700 1 -- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88155980 msgr2=0x7fef88155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.774+0000 7fef87e00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fef88155980 0x7fef88155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.774+0000 7fef87e00700 1 -- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8814b8d0 msgr2=0x7fef88154ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.774+0000 7fef87e00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fef8814b8d0 0x7fef88154ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.774+0000 7fef87e00700 1 -- 172.21.15.47:0/3859738792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8814ab70 con 0x7fef6c003a30 2024-05-10T04:52:21.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.774+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd5c00cc00 con 0x7fbd6806abf0 2024-05-10T04:52:21.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.775+0000 7fef87e00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c003a30 0x7fef8814e980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef78001970 tx=0x7fef78001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.775+0000 7f1117400700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f10f80743a0 0x7f10f8076830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.775+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78004870 con 0x7fef6c003a30 2024-05-10T04:52:21.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.775+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef780049d0 con 0x7fef6c003a30 2024-05-10T04:52:21.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.775+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78004d80 con 0x7fef6c003a30 2024-05-10T04:52:21.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef88153e70 con 0x7fef6c003a30 2024-05-10T04:52:21.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7fbd65600700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbd4806ad90 0x7fbd4806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd5c089830 con 0x7fbd6806abf0 2024-05-10T04:52:21.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7fbd65600700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7fbd48074420 0x7fbd480768b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 --> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd48076f80 con 0x7fbd48074420 2024-05-10T04:52:21.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd5c089be0 con 0x7fbd6806abf0 2024-05-10T04:52:21.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.776+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== osd.6 v2:172.21.15.117:6816/44081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f10f8076f00 con 0x7f10f80743a0 2024-05-10T04:52:21.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.777+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8814b0d0 con 0x7fef6c003a30 2024-05-10T04:52:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.777+0000 7fbd6e400700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7fbd48074420 0x7fbd480768b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.779+0000 7fbd6e400700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7fbd48074420 0x7fbd480768b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.779+0000 7fbd6d000700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbd4806ad90 0x7fbd4806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.780+0000 7fbd6d000700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbd4806ad90 0x7fbd4806d2a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd680c13b0 tx=0x7fbd60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.781+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== osd.2 v2:172.21.15.47:6800/43824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fbd48076f80 con 0x7fbd48074420 2024-05-10T04:52:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.779+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef880c9a50 con 0x7fef6c003a30 2024-05-10T04:52:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.781+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef7800c650 con 0x7fef6c003a30 2024-05-10T04:52:21.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.783+0000 7fef84c00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fef6406ac90 0x7fef6406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.783+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef7808a8c0 con 0x7fef6c003a30 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.783+0000 7fef84c00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7fef640742a0 0x7fef64076730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.783+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 --> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef64076e00 con 0x7fef640742a0 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.783+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef7808ab80 con 0x7fef6c003a30 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.786+0000 7fef7fe00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fef6406ac90 0x7fef6406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.786+0000 7fef8ca00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7fef640742a0 0x7fef64076730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.787+0000 7fef8ca00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7fef640742a0 0x7fef64076730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.787+0000 7fef7fe00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fef6406ac90 0x7fef6406d1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef880c4950 tx=0x7fef70009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.788+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== osd.7 v2:172.21.15.117:6824/44082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fef64076e00 con 0x7fef640742a0 2024-05-10T04:52:21.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.792+0000 7f734d600700 1 -- 172.21.15.47:0/3861347840 --> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f734000ea90 con 0x7f7328074250 2024-05-10T04:52:21.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.794+0000 7f733be00700 1 -- 172.21.15.47:0/3861347840 <== osd.0 v2:172.21.15.47:6808/43823 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7348068430 con 0x7f7328074250 2024-05-10T04:52:21.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.796+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 --> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f33981658e0 con 0x7f3378074250 2024-05-10T04:52:21.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.797+0000 7f338f400700 1 -- 172.21.15.47:0/660615777 <== osd.3 v2:172.21.15.47:6824/43825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3390001e20 con 0x7f3378074250 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.797+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f7328074250 msgr2=0x7f73280766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.797+0000 7f7339600700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f7328074250 0x7f73280766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f732806acc0 msgr2=0x7f732806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f7339600700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f732806acc0 0x7f732806d1d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f733c007fd0 tx=0x7f733c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 msgr2=0x7f73400dd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f7339600700 1 --2- 172.21.15.47:0/3861347840 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f734004b040 0x7f73400dd720 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f733400d600 tx=0x7f733400d910 comp rx=0 tx=0).stop 2024-05-10T04:52:21.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f734cc00700 1 -- 172.21.15.47:0/3861347840 reap_dead start 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 shutdown_connections 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 >> 172.21.15.47:0/3861347840 conn(0x7f734004c850 msgr2=0x7f73400057a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f3378074250 msgr2=0x7f33780766e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.798+0000 7f339e400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f3378074250 0x7f33780766e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806acc0 msgr2=0x7f337806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f339e400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806acc0 0x7f337806d1d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33980c3150 tx=0x7f3384012000 comp rx=0 tx=0).stop 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33980c6ed0 msgr2=0x7f3398163eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f339e400700 1 --2- 172.21.15.47:0/660615777 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f33980c6ed0 0x7f3398163eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f338800acb0 tx=0x7f338800c590 comp rx=0 tx=0).stop 2024-05-10T04:52:21.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f3397e00700 1 -- 172.21.15.47:0/660615777 reap_dead start 2024-05-10T04:52:21.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 shutdown_connections 2024-05-10T04:52:21.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 --> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa3d806e7c0 con 0x7fa3b4074370 2024-05-10T04:52:21.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.799+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 >> 172.21.15.47:0/660615777 conn(0x7f33980a86c0 msgr2=0x7f33980c49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.800+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 --> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f95400c3e90 con 0x7f952007cc00 2024-05-10T04:52:21.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.800+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 shutdown_connections 2024-05-10T04:52:21.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.800+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 shutdown_connections 2024-05-10T04:52:21.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.800+0000 7f7339600700 1 -- 172.21.15.47:0/3861347840 wait complete. 2024-05-10T04:52:21.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.800+0000 7fa3d4c00700 1 -- 172.21.15.47:0/2939435363 <== osd.5 v2:172.21.15.117:6808/44080 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa3d806e7c0 con 0x7fa3b4074370 2024-05-10T04:52:21.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.800+0000 7f339e400700 1 -- 172.21.15.47:0/660615777 wait complete. 2024-05-10T04:52:21.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7f9537400700 1 -- 172.21.15.47:0/875301008 <== osd.4 v2:172.21.15.117:6800/44079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f953800b860 con 0x7f952007cc00 2024-05-10T04:52:21.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7fa3b4074370 msgr2=0x7fa3b4076800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7fa3b4074370 0x7fa3b4076800 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa3b406ace0 msgr2=0x7fa3b406d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa3b406ace0 0x7fa3b406d1f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8008480 tx=0x7fa3c8005330 comp rx=0 tx=0).stop 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 msgr2=0x7fa3d81480e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 --2- 172.21.15.47:0/2939435363 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa3d80c2ce0 0x7fa3d81480e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000e910 tx=0x7fa3c000ec20 comp rx=0 tx=0).stop 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dcc00700 1 -- 172.21.15.47:0/2939435363 reap_dead start 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 shutdown_connections 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 >> 172.21.15.47:0/2939435363 conn(0x7fa3d80c65e0 msgr2=0x7fa3d814a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7f952007cc00 msgr2=0x7f952007f090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.801+0000 7f9546200700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7f952007cc00 0x7f952007f090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.802+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9520073570 msgr2=0x7f9520075a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.802+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 shutdown_connections 2024-05-10T04:52:21.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.802+0000 7f9546200700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9520073570 0x7f9520075a80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f95300098f0 tx=0x7f9530014000 comp rx=0 tx=0).stop 2024-05-10T04:52:21.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.802+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9540073010 msgr2=0x7f95401e8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.802+0000 7f9546200700 1 --2- 172.21.15.47:0/875301008 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9540073010 0x7f95401e8290 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f952c00b4d0 tx=0x7f952c00b7e0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.802+0000 7f953fe00700 1 -- 172.21.15.47:0/875301008 reap_dead start 2024-05-10T04:52:21.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.803+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 shutdown_connections 2024-05-10T04:52:21.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.803+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 >> 172.21.15.47:0/875301008 conn(0x7f954006c330 msgr2=0x7f954006ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.803+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 --> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febd8002d30 con 0x7febe4075050 2024-05-10T04:52:21.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.803+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 shutdown_connections 2024-05-10T04:52:21.826 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.803+0000 7f9546200700 1 -- 172.21.15.47:0/875301008 wait complete. 2024-05-10T04:52:21.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.804+0000 7fa3dd600700 1 -- 172.21.15.47:0/2939435363 wait complete. 2024-05-10T04:52:21.827 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.804+0000 7febfcc00700 1 -- 172.21.15.47:0/3062237614 <== osd.1 v2:172.21.15.47:6816/43821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febd8002d30 con 0x7febe4075050 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7febe4075050 msgr2=0x7febe4077540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7febee000700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7febe4075050 0x7febe4077540 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febe406ad20 msgr2=0x7febe406d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7febee000700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7febe406ad20 0x7febe406d230 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fec000644e0 tx=0x7fec00068bc0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf804a090 msgr2=0x7febf80d5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7febee000700 1 --2- 172.21.15.47:0/3062237614 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7febf804a090 0x7febf80d5c10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7febf400c460 tx=0x7febf400c770 comp rx=0 tx=0).stop 2024-05-10T04:52:21.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.805+0000 7fec05a00700 1 -- 172.21.15.47:0/3062237614 reap_dead start 2024-05-10T04:52:21.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.806+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 shutdown_connections 2024-05-10T04:52:21.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.806+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 >> 172.21.15.47:0/3062237614 conn(0x7febf802d580 msgr2=0x7febf80d7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.806+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 shutdown_connections 2024-05-10T04:52:21.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.806+0000 7febee000700 1 -- 172.21.15.47:0/3062237614 wait complete. 2024-05-10T04:52:21.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.817+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 --> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1118159f80 con 0x7f10f80743a0 2024-05-10T04:52:21.829 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.821+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 --> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd44002d30 con 0x7fbd48074420 2024-05-10T04:52:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.821+0000 7f110ea00700 1 -- 172.21.15.47:0/2879488667 <== osd.6 v2:172.21.15.117:6816/44081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1104009530 con 0x7f10f80743a0 2024-05-10T04:52:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.822+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f10f80743a0 msgr2=0x7f10f8076830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.822+0000 7f111d600700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f10f80743a0 0x7f10f8076830 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.830 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.822+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 --> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef88159800 con 0x7fef640742a0 2024-05-10T04:52:21.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f10f806ad10 msgr2=0x7f10f806d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f10f806ad10 0x7f10f806d220 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1118071b10 tx=0x7f1108008040 comp rx=0 tx=0).stop 2024-05-10T04:52:21.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f111806e410 msgr2=0x7f11180c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.831 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7fbd65600700 1 -- 172.21.15.47:0/1608732985 <== osd.2 v2:172.21.15.47:6800/43824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd44002d30 con 0x7fbd48074420 2024-05-10T04:52:21.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 --2- 172.21.15.47:0/2879488667 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f111806e410 0x7f11180c5b70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1110014040 tx=0x7f1110004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f1117400700 1 -- 172.21.15.47:0/2879488667 reap_dead start 2024-05-10T04:52:21.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 shutdown_connections 2024-05-10T04:52:21.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 >> 172.21.15.47:0/2879488667 conn(0x7f11180a8ae0 msgr2=0x7f11180c28c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.823+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 shutdown_connections 2024-05-10T04:52:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.824+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7fbd48074420 msgr2=0x7fbd480768b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.824+0000 7fbd70400700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7fbd48074420 0x7fbd480768b0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.824+0000 7f111d600700 1 -- 172.21.15.47:0/2879488667 wait complete. 2024-05-10T04:52:21.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.824+0000 7fef84c00700 1 -- 172.21.15.47:0/3859738792 <== osd.7 v2:172.21.15.117:6824/44082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef80003a00 con 0x7fef640742a0 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbd4806ad90 msgr2=0x7fbd4806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbd4806ad90 0x7fbd4806d2a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbd680c13b0 tx=0x7fbd60009040 comp rx=0 tx=0).stop 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6806abf0 msgr2=0x7fbd6813be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 --2- 172.21.15.47:0/1608732985 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbd6806abf0 0x7fbd6813be90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00e8e0 tx=0x7fbd5c00eca0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd6e400700 1 -- 172.21.15.47:0/1608732985 reap_dead start 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 shutdown_connections 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 >> 172.21.15.47:0/1608732985 conn(0x7fbd680a86c0 msgr2=0x7fbd680a8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 shutdown_connections 2024-05-10T04:52:21.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fbd70400700 1 -- 172.21.15.47:0/1608732985 wait complete. 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7fef640742a0 msgr2=0x7fef64076730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.825+0000 7fef8ea00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7fef640742a0 0x7fef64076730 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fef6406ac90 msgr2=0x7fef6406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ea00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fef6406ac90 0x7fef6406d1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fef880c4950 tx=0x7fef70009210 comp rx=0 tx=0).stop 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c003a30 msgr2=0x7fef8814e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ea00700 1 --2- 172.21.15.47:0/3859738792 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fef6c003a30 0x7fef8814e980 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fef78001970 tx=0x7fef78001230 comp rx=0 tx=0).stop 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ca00700 1 -- 172.21.15.47:0/3859738792 reap_dead start 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 shutdown_connections 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.826+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 >> 172.21.15.47:0/3859738792 conn(0x7fef880ca960 msgr2=0x7fef8814d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:21.836 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.827+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 shutdown_connections 2024-05-10T04:52:21.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:21.827+0000 7fef8ea00700 1 -- 172.21.15.47:0/3859738792 wait complete. 2024-05-10T04:52:21.847 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:21.848 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T04:52:21.849 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:21.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T04:52:21.853 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:21.853 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T04:52:21.859 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:21.859 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:21.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T04:52:21.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T04:52:21.868 INFO:teuthology.orchestra.run.smithi047.stdout:55834574859 2024-05-10T04:52:21.869 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:21.869 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T04:52:21.870 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T04:52:21.871 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:21.871 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T04:52:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.333+0000 7fba9bc00700 1 Processor -- start 2024-05-10T04:52:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.333+0000 7fba9bc00700 1 -- start start 2024-05-10T04:52:22.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.334+0000 7f19ce800700 1 Processor -- start 2024-05-10T04:52:22.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.334+0000 7f19ce800700 1 -- start start 2024-05-10T04:52:22.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.336+0000 7fba9bc00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba8c033530 0x7fba8c032990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.336+0000 7fba9bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c032fe0 0x7fba8c0dc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.336+0000 7fba9bc00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c048f60 con 0x7fba8c0dc610 2024-05-10T04:52:22.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.336+0000 7fba9bc00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c0091b0 con 0x7fba8c033530 2024-05-10T04:52:22.337 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.336+0000 7fba9bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c04c190 con 0x7fba8c032fe0 2024-05-10T04:52:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.337+0000 7f58a9c00700 1 Processor -- start 2024-05-10T04:52:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.337+0000 7f19ce800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 0x7f19c00d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.337+0000 7f19ce800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f19c00debe0 0x7f19c000a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.337+0000 7f19ce800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c000a990 0x7f19c00dafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7fba93e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c032fe0 0x7fba8c0dc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7fba99c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fba8c0dc610 0x7fba8c00d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43576/0 (socket says 172.21.15.47:43576) 2024-05-10T04:52:22.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7fba99c00700 1 -- 172.21.15.47:0/1471616014 learned_addr learned my addr 172.21.15.47:0/1471616014 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:22.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19cd400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 0x7f19c00d83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19cd400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 0x7f19c00d83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53126/0 (socket says 172.21.15.47:53126) 2024-05-10T04:52:22.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19cd400700 1 -- 172.21.15.47:0/518550207 learned_addr learned my addr 172.21.15.47:0/518550207 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7fba99200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fba8c033530 0x7fba8c032990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c0009c80 con 0x7f19c00debe0 2024-05-10T04:52:22.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19c004d340 con 0x7f19c0009870 2024-05-10T04:52:22.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0048f60 con 0x7f19c000a990 2024-05-10T04:52:22.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.338+0000 7f19cde00700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c000a990 0x7f19c00dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.339+0000 7f19cca00700 1 --2- 172.21.15.47:0/518550207 >> v2:172.21.15.47:3300/0 conn(0x7f19c00debe0 0x7f19c000a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.339+0000 7fba93400700 1 -- 172.21.15.47:0/1471616014 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654484638 0 0) 0x7fba8c048f60 con 0x7fba8c0dc610 2024-05-10T04:52:22.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f19cca00700 1 -- 172.21.15.47:0/518550207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c000a990 msgr2=0x7f19c00dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7fba93400700 1 -- 172.21.15.47:0/1471616014 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba7c0035b0 con 0x7fba8c0dc610 2024-05-10T04:52:22.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f19cca00700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c000a990 0x7f19c00dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f19cca00700 1 -- 172.21.15.47:0/518550207 >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 msgr2=0x7f19c00d83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f19cca00700 1 --2- 172.21.15.47:0/518550207 >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 0x7f19c00d83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f19cca00700 1 -- 172.21.15.47:0/518550207 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c004d5e0 con 0x7f19c00debe0 2024-05-10T04:52:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7f19cd400700 1 --2- 172.21.15.47:0/518550207 >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 0x7f19c00d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7fba93400700 1 -- 172.21.15.47:0/1471616014 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 838714768 0 0) 0x7fba7c0035b0 con 0x7fba8c0dc610 2024-05-10T04:52:22.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7f19cde00700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c000a990 0x7f19c00dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7fba99200700 1 -- 172.21.15.47:0/1471616014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c032fe0 msgr2=0x7fba8c0dc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7fba99200700 1 --2- 172.21.15.47:0/1471616014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c032fe0 0x7fba8c0dc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7fba99200700 1 -- 172.21.15.47:0/1471616014 >> v1:172.21.15.47:6789/0 conn(0x7fba8c0dc610 legacy=0x7fba8c00d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7f19cca00700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c000a450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f19c000f610 tx=0x7f19bc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca031f2c7dde2811 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7fba99200700 1 -- 172.21.15.47:0/1471616014 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c0dcb80 con 0x7fba8c033530 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.337+0000 7f58a9c00700 1 -- start start 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f58a9c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f589c047ef0 0x7f589c030d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.340+0000 7f58a9c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0060e0 0x7f589c03ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7f58a2a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f589c047ef0 0x7f589c030d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7f58a2a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f589c047ef0 0x7f589c030d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36758/0 (socket says 172.21.15.47:36758) 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7f58a2000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0060e0 0x7f589c03ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.341+0000 7f58a2000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0060e0 0x7f589c03ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50518/0 (socket says 172.21.15.47:50518) 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7f58a2a00700 1 -- 172.21.15.47:0/248355142 learned_addr learned my addr 172.21.15.47:0/248355142 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589c048300 con 0x7f589c0064f0 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589c007a80 con 0x7f589c047ef0 2024-05-10T04:52:22.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c007550 con 0x7f589c0060e0 2024-05-10T04:52:22.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7fba93e00700 1 --2- 172.21.15.47:0/1471616014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c032fe0 0x7fba8c0dc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.342+0000 7f19c7e00700 1 -- 172.21.15.47:0/518550207 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011830 con 0x7f19c00debe0 2024-05-10T04:52:22.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.343+0000 7f19c7e00700 1 -- 172.21.15.47:0/518550207 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc011990 con 0x7f19c00debe0 2024-05-10T04:52:22.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.343+0000 7f19c7e00700 1 -- 172.21.15.47:0/518550207 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc011d20 con 0x7f19c00debe0 2024-05-10T04:52:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.343+0000 7f868f200700 1 Processor -- start 2024-05-10T04:52:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f868f200700 1 -- start start 2024-05-10T04:52:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f58a2a00700 1 -- 172.21.15.47:0/248355142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0060e0 msgr2=0x7f589c03ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f58a2a00700 1 --2- 172.21.15.47:0/248355142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0060e0 0x7f589c03ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f58a2a00700 1 -- 172.21.15.47:0/248355142 >> v1:172.21.15.47:6789/0 conn(0x7f589c0064f0 legacy=0x7f589c0e2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.347 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f58a2a00700 1 -- 172.21.15.47:0/248355142 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589c04b870 con 0x7f589c047ef0 2024-05-10T04:52:22.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7fba99200700 1 --2- 172.21.15.47:0/1471616014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c033530 0x7fba8c032990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba94050680 tx=0x7fba9404f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beeaf7906c9d524b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7fba93400700 1 -- 172.21.15.47:0/1471616014 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88001670 con 0x7fba8c033530 2024-05-10T04:52:22.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 msgr2=0x7f19c000a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.344+0000 7f19ce800700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c000a450 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f19c000f610 tx=0x7f19bc009b20 comp rx=0 tx=0).stop 2024-05-10T04:52:22.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7fba93400700 1 -- 172.21.15.47:0/1471616014 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba94068430 con 0x7fba8c033530 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7fba93400700 1 -- 172.21.15.47:0/1471616014 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba88001670 con 0x7fba8c033530 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 shutdown_connections 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f19ce800700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c000a990 0x7f19c00dafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f19ce800700 1 --2- 172.21.15.47:0/518550207 >> v2:172.21.15.117:3300/0 conn(0x7f19c0009870 0x7f19c00d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f19ce800700 1 --2- 172.21.15.47:0/518550207 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c000a450 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 >> 172.21.15.47:0/518550207 conn(0x7f19c004aa60 msgr2=0x7f19c004ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 shutdown_connections 2024-05-10T04:52:22.349 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.346+0000 7f19ce800700 1 -- 172.21.15.47:0/518550207 wait complete. 2024-05-10T04:52:22.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.345+0000 7f58a2a00700 1 --2- 172.21.15.47:0/248355142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c047ef0 0x7f589c030d30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58a4079d30 tx=0x7f58a4062790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13c38ec6c8cf163 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f58a1600700 1 -- 172.21.15.47:0/248355142 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4068630 con 0x7f589c047ef0 2024-05-10T04:52:22.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f58a1600700 1 -- 172.21.15.47:0/248355142 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4068790 con 0x7f589c047ef0 2024-05-10T04:52:22.350 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f58a1600700 1 -- 172.21.15.47:0/248355142 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4092620 con 0x7f589c047ef0 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f868f200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 0x7f868800b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f868f200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86880daf50 con 0x7f8688007090 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f868f200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8688047200 con 0x7f86880465b0 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.347+0000 7f868f200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880da9f0 con 0x7f86880db3e0 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f868e800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 0x7f868800b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f868e800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 0x7f868800b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50532/0 (socket says 172.21.15.47:50532) 2024-05-10T04:52:22.351 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f868e800700 1 -- 172.21.15.47:0/2202919736 learned_addr learned my addr 172.21.15.47:0/2202919736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7fba9bc00700 1 -- 172.21.15.47:0/1471616014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c033530 msgr2=0x7fba8c032990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7fba9bc00700 1 --2- 172.21.15.47:0/1471616014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c033530 0x7fba8c032990 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fba94050680 tx=0x7fba9404f200 comp rx=0 tx=0).stop 2024-05-10T04:52:22.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c047ef0 msgr2=0x7f589c030d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f58a9c00700 1 --2- 172.21.15.47:0/248355142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c047ef0 0x7f589c030d30 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f58a4079d30 tx=0x7f58a4062790 comp rx=0 tx=0).stop 2024-05-10T04:52:22.352 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f868e800700 1 -- 172.21.15.47:0/2202919736 >> v1:172.21.15.117:6789/0 conn(0x7f86880465b0 legacy=0x7f86880d7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7fba9bc00700 1 -- 172.21.15.47:0/1471616014 shutdown_connections 2024-05-10T04:52:22.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7fba9bc00700 1 --2- 172.21.15.47:0/1471616014 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c033530 0x7fba8c032990 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7fba9bc00700 1 --2- 172.21.15.47:0/1471616014 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c032fe0 0x7fba8c0dc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7fba9bc00700 1 -- 172.21.15.47:0/1471616014 >> 172.21.15.47:0/1471616014 conn(0x7fba8c04dcf0 msgr2=0x7fba8c04e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 shutdown_connections 2024-05-10T04:52:22.353 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7f58a9c00700 1 --2- 172.21.15.47:0/248355142 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c047ef0 0x7f589c030d30 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7f58a9c00700 1 --2- 172.21.15.47:0/248355142 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c0060e0 0x7f589c03ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7f19ce800700 1 Processor -- start 2024-05-10T04:52:22.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7fba9bc00700 1 -- 172.21.15.47:0/1471616014 shutdown_connections 2024-05-10T04:52:22.354 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7fba9bc00700 1 -- 172.21.15.47:0/1471616014 wait complete. 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.349+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 >> 172.21.15.47:0/248355142 conn(0x7f589c02d580 msgr2=0x7f589c02d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.350+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 shutdown_connections 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.350+0000 7f58a9c00700 1 -- 172.21.15.47:0/248355142 wait complete. 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.350+0000 7f19ce800700 1 -- start start 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.352+0000 7f19ce800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c0009870 0x7f19c0042040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.352+0000 7f19ce800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19c000a990 0x7f19c0178650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.352+0000 7f19ce800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c00d4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.355 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.352+0000 7f19ce800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0045410 con 0x7f19c00debe0 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.352+0000 7f19ce800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0043310 con 0x7f19c000a990 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.352+0000 7f19ce800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c0043770 con 0x7f19c0009870 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f19cde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c00d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f19cde00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c00d4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36762/0 (socket says 172.21.15.47:36762) 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f19cde00700 1 -- 172.21.15.47:0/1028496184 learned_addr learned my addr 172.21.15.47:0/1028496184 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f19cca00700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19c000a990 0x7f19c0178650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f19cd400700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c0009870 0x7f19c0042040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.348+0000 7f868e800700 1 -- 172.21.15.47:0/2202919736 >> v1:172.21.15.47:6789/0 conn(0x7f8688007090 legacy=0x7f8688049920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.356 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f868e800700 1 -- 172.21.15.47:0/2202919736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86880469c0 con 0x7f86880db3e0 2024-05-10T04:52:22.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.353+0000 7f868e800700 1 --2- 172.21.15.47:0/2202919736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 0x7f868800b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f869004fff0 tx=0x7f8690062730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=585e556ed0fde054 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cde00700 1 -- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c0009870 msgr2=0x7f19c0042040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cde00700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c0009870 0x7f19c0042040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cde00700 1 -- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19c000a990 msgr2=0x7f19c0178650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cde00700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19c000a990 0x7f19c0178650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f868ca00700 1 -- 172.21.15.47:0/2202919736 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690068630 con 0x7f86880db3e0 2024-05-10T04:52:22.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f868ca00700 1 -- 172.21.15.47:0/2202919736 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8690068790 con 0x7f86880db3e0 2024-05-10T04:52:22.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cde00700 1 -- 172.21.15.47:0/1028496184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8073ad0 con 0x7f19c00debe0 2024-05-10T04:52:22.358 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f58a9c00700 1 Processor -- start 2024-05-10T04:52:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cca00700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19c000a990 0x7f19c0178650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f19cd400700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c0009870 0x7f19c0042040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.354+0000 7f58a9c00700 1 -- start start 2024-05-10T04:52:22.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.355+0000 7f868f200700 1 -- 172.21.15.47:0/2202919736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 msgr2=0x7f868800b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.355+0000 7f868f200700 1 --2- 172.21.15.47:0/2202919736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 0x7f868800b410 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f869004fff0 tx=0x7f8690062730 comp rx=0 tx=0).stop 2024-05-10T04:52:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.355+0000 7fba9bc00700 1 Processor -- start 2024-05-10T04:52:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.355+0000 7fba9bc00700 1 -- start start 2024-05-10T04:52:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.355+0000 7f868f200700 1 -- 172.21.15.47:0/2202919736 shutdown_connections 2024-05-10T04:52:22.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.356+0000 7f868f200700 1 --2- 172.21.15.47:0/2202919736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880db3e0 0x7f868800b410 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.356+0000 7f868f200700 1 -- 172.21.15.47:0/2202919736 >> 172.21.15.47:0/2202919736 conn(0x7f86880060b0 msgr2=0x7f86880064c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.356+0000 7f19cde00700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c00d4410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f19b400e840 tx=0x7f19b400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.356+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4013610 con 0x7f19c00debe0 2024-05-10T04:52:22.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.357+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19b4013770 con 0x7f19c00debe0 2024-05-10T04:52:22.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.357+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b4013b20 con 0x7f19c00debe0 2024-05-10T04:52:22.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.357+0000 7fba9bc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c032fe0 0x7fba8c0d8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7f58a9c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 0x7f589c041aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7fba9bc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba8c033530 0x7fba8c0463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7f58a9c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c0064f0 0x7f589c02f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7fba9bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c0dc610 0x7fba8c045190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7fba9bc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c046e40 con 0x7fba8c032fe0 2024-05-10T04:52:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7fba9bc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0d94d0 con 0x7fba8c033530 2024-05-10T04:52:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.358+0000 7fba99200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c032fe0 0x7fba8c0d8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.356+0000 7f868f200700 1 -- 172.21.15.47:0/2202919736 shutdown_connections 2024-05-10T04:52:22.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.356+0000 7f868f200700 1 -- 172.21.15.47:0/2202919736 wait complete. 2024-05-10T04:52:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.359+0000 7fba99200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c032fe0 0x7fba8c0d8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36764/0 (socket says 172.21.15.47:36764) 2024-05-10T04:52:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.359+0000 7fba99200700 1 -- 172.21.15.47:0/966042372 learned_addr learned my addr 172.21.15.47:0/966042372 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.359+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c0ee8f0 con 0x7fba8c0dc610 2024-05-10T04:52:22.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.359+0000 7fba93e00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba8c033530 0x7fba8c0463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.357+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19bc0094a0 con 0x7f19c00debe0 2024-05-10T04:52:22.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.357+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c0044c90 con 0x7f19c00debe0 2024-05-10T04:52:22.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.359+0000 7f58a2a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 0x7f589c041aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7f58a2a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 0x7f589c041aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53144/0 (socket says 172.21.15.47:53144) 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7f58a9c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c047ef0 0x7f589c0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7f58a2a00700 1 -- 172.21.15.47:0/3389787027 learned_addr learned my addr 172.21.15.47:0/3389787027 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f58a9c00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c03fae0 con 0x7f589c0064f0 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f58a9c00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589c030210 con 0x7f589c0060e0 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f58a9c00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589c0c6800 con 0x7f589c047ef0 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f58a2000700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c0064f0 0x7f589c02f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7fba99c00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c0dc610 0x7fba8c045190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7fba93e00700 1 -- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c0dc610 msgr2=0x7fba8c045190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7fba93e00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c0dc610 0x7fba8c045190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7fba93e00700 1 -- 172.21.15.47:0/966042372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c032fe0 msgr2=0x7fba8c0d8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7fba93e00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c032fe0 0x7fba8c0d8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.360+0000 7fba93e00700 1 -- 172.21.15.47:0/966042372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba94073ad0 con 0x7fba8c033530 2024-05-10T04:52:22.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f868f200700 1 Processor -- start 2024-05-10T04:52:22.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f868f200700 1 -- start start 2024-05-10T04:52:22.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.361+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a40052e0 con 0x7f19c00debe0 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.362+0000 7f58a3400700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c047ef0 0x7f589c0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7f58a2000700 1 -- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c047ef0 msgr2=0x7f589c0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7f58a2000700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c047ef0 0x7f589c0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7f58a2000700 1 -- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 msgr2=0x7f589c041aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7f58a2000700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 0x7f589c041aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7f58a2000700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4073ad0 con 0x7f589c0064f0 2024-05-10T04:52:22.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.362+0000 7fba93e00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba8c033530 0x7fba8c0463c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e600 tx=0x7fba8000e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7f58a2a00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 0x7f589c041aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80004230 con 0x7fba8c033530 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba80004390 con 0x7fba8c033530 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba800036a0 con 0x7fba8c033530 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c0d8fa0 con 0x7fba8c033530 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.363+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c17d950 con 0x7fba8c033530 2024-05-10T04:52:22.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.364+0000 7f58a2000700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c0064f0 0x7f589c02f800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f589c045fc0 tx=0x7f589400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.364+0000 7f3cc7800700 1 Processor -- start 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.364+0000 7f868f200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8688007090 0x7f86881743a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.365+0000 7f868f200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880465b0 0x7f868802fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.365+0000 7f868f200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 0x7f86880cca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.365+0000 7f868f200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868802f7c0 con 0x7f8688007090 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.366+0000 7f868f200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86880dc1f0 con 0x7f86880db3e0 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.366+0000 7f868e800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 0x7f86880cca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.366+0000 7f868e800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 0x7f86880cca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53172/0 (socket says 172.21.15.47:53172) 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.366+0000 7f868e800700 1 -- 172.21.15.47:0/2816646053 learned_addr learned my addr 172.21.15.47:0/2816646053 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.366+0000 7f868d400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880465b0 0x7f868802fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.366+0000 7f868f200700 1 -- 172.21.15.47:0/2816646053 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86880dec90 con 0x7f86880465b0 2024-05-10T04:52:22.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c0eeaa0 con 0x7fba8c033530 2024-05-10T04:52:22.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.364+0000 7f3cc7800700 1 -- start start 2024-05-10T04:52:22.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7f3cc7800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cc00c6cc0 0x7f3cc0152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7f3cc7800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc006d640 con 0x7f3cc00c5cf0 2024-05-10T04:52:22.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7f3cc7800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc00c6100 con 0x7f3cc006bdb0 2024-05-10T04:52:22.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7f3cc7800700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc00c9800 con 0x7f3cc00c6cc0 2024-05-10T04:52:22.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.364+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f19b4013c80 con 0x7f19c00debe0 2024-05-10T04:52:22.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7f19c5600700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f19a806ad60 0x7f19a806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.367+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f19b4089130 con 0x7f19c00debe0 2024-05-10T04:52:22.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894013470 con 0x7f589c0064f0 2024-05-10T04:52:22.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58940135d0 con 0x7f589c0064f0 2024-05-10T04:52:22.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f58a9c00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f589c041fe0 con 0x7f589c0064f0 2024-05-10T04:52:22.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5894013960 con 0x7f589c0064f0 2024-05-10T04:52:22.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f19cd400700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f19a806ad60 0x7f19a806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.369+0000 7f58a9c00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f589c030460 con 0x7f589c0064f0 2024-05-10T04:52:22.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.369+0000 7f868de00700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8688007090 0x7f86881743a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f3cc5800700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f3cc006bdb0 0x7f3cc006c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46104/0 (socket says 172.21.15.47:46104) 2024-05-10T04:52:22.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f3cc4e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cc00c6cc0 0x7f3cc0152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f3cc4e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3cc00c6cc0 0x7f3cc0152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53178/0 (socket says 172.21.15.47:53178) 2024-05-10T04:52:22.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.368+0000 7f3cc4e00700 1 -- 172.21.15.47:0/3038175272 learned_addr learned my addr 172.21.15.47:0/3038175272 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.369+0000 7f3cc4e00700 1 -- 172.21.15.47:0/3038175272 >> v1:172.21.15.117:6789/0 conn(0x7f3cc006bdb0 legacy=0x7f3cc006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868e800700 1 -- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880465b0 msgr2=0x7f868802fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868e800700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880465b0 0x7f868802fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba80003800 con 0x7fba8c033530 2024-05-10T04:52:22.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f19cd400700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f19a806ad60 0x7f19a806d270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19c8069330 tx=0x7f19c8067ad0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.371+0000 7f3cc4e00700 1 -- 172.21.15.47:0/3038175272 >> v1:172.21.15.47:6789/0 conn(0x7f3cc00c5cf0 legacy=0x7f3cc00c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.371+0000 7f3cc4e00700 1 -- 172.21.15.47:0/3038175272 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00c8910 con 0x7f3cc00c6cc0 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868e800700 1 -- 172.21.15.47:0/2816646053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8688007090 msgr2=0x7f86881743a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868e800700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8688007090 0x7f86881743a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868e800700 1 -- 172.21.15.47:0/2816646053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8690073ad0 con 0x7f86880db3e0 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868d400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880465b0 0x7f868802fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.370+0000 7f868de00700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8688007090 0x7f86881743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.371+0000 7f868e800700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 0x7f86880cca20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8690000eb0 tx=0x7f86900739c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.371+0000 7fba90c00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fba7406ad10 0x7fba7406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.371+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58780052e0 con 0x7f589c0064f0 2024-05-10T04:52:22.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.372+0000 7f3cc4e00700 1 --2- 172.21.15.47:0/3038175272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc0152bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0098f0 tx=0x7f3cac009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9816e7872f1bab38 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.372+0000 7fba99200700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fba7406ad10 0x7fba7406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.372+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba80088e70 con 0x7fba8c033530 2024-05-10T04:52:22.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.373+0000 7fba99200700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fba7406ad10 0x7fba7406d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba9406a570 tx=0x7fba94094040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7f3cbf400700 1 -- 172.21.15.47:0/3038175272 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac004230 con 0x7f3cc00c6cc0 2024-05-10T04:52:22.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690093860 con 0x7f86880db3e0 2024-05-10T04:52:22.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7f868f200700 1 -- 172.21.15.47:0/2816646053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86880dc390 con 0x7f86880db3e0 2024-05-10T04:52:22.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fba8c0eeaa0 con 0x7fba8c033530 2024-05-10T04:52:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7f3cbf400700 1 -- 172.21.15.47:0/3038175272 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac004390 con 0x7f3cc00c6cc0 2024-05-10T04:52:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900939c0 con 0x7f86880db3e0 2024-05-10T04:52:22.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.377+0000 7f3cbf400700 1 -- 172.21.15.47:0/3038175272 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac0036a0 con 0x7f3cc00c6cc0 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.378+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8690093860 con 0x7f86880db3e0 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.378+0000 7f868f200700 1 -- 172.21.15.47:0/2816646053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8688174e10 con 0x7f86880db3e0 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.379+0000 7f3cc7800700 1 -- 172.21.15.47:0/3038175272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 msgr2=0x7f3cc0152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.379+0000 7f3cc7800700 1 --2- 172.21.15.47:0/3038175272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc0152bb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3cac0098f0 tx=0x7f3cac009c00 comp rx=0 tx=0).stop 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.379+0000 7f3cc7800700 1 -- 172.21.15.47:0/3038175272 shutdown_connections 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.379+0000 7f3cc7800700 1 --2- 172.21.15.47:0/3038175272 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc0152bb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.379+0000 7f3cc7800700 1 -- 172.21.15.47:0/3038175272 >> 172.21.15.47:0/3038175272 conn(0x7f3cc00ca960 msgr2=0x7f3cc00cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.380+0000 7f868f200700 1 -- 172.21.15.47:0/2816646053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8688175060 con 0x7f86880db3e0 2024-05-10T04:52:22.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.380+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f19b4054000 con 0x7f19c00debe0 2024-05-10T04:52:22.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.381+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8690093b30 con 0x7f86880db3e0 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.383+0000 7f8686000700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f867006ace0 0x7f867006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.383+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86900c1020 con 0x7f86880db3e0 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.381+0000 7f3cc7800700 1 -- 172.21.15.47:0/3038175272 shutdown_connections 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.384+0000 7f868de00700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f867006ace0 0x7f867006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.381+0000 7f3cc7800700 1 -- 172.21.15.47:0/3038175272 wait complete. 2024-05-10T04:52:22.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.385+0000 7f868de00700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f867006ace0 0x7f867006d1f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f867c0017b0 tx=0x7f867c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.385+0000 7f3cc7800700 1 Processor -- start 2024-05-10T04:52:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.384+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5894013ac0 con 0x7f589c0064f0 2024-05-10T04:52:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.385+0000 7f589aa00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f588406acc0 0x7f588406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.386+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5894089b60 con 0x7f589c0064f0 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.386+0000 7f3cc7800700 1 -- start start 2024-05-10T04:52:22.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.386+0000 7f58a2a00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f588406acc0 0x7f588406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.387+0000 7f58a2a00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f588406acc0 0x7f588406d1d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58a4079de0 tx=0x7f58a406e030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.388+0000 7f3cc7800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006bdb0 0x7f3cc0155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.388+0000 7f3cc7800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cc00c5cf0 0x7f3cc01eef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.388+0000 7f3cc7800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc014a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.389+0000 7f3cc7800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc014d260 con 0x7f3cc00c5cf0 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.389+0000 7f3cc7800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc014d540 con 0x7f3cc00c6cc0 2024-05-10T04:52:22.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.389+0000 7f3cc7800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc014d820 con 0x7f3cc006bdb0 2024-05-10T04:52:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.389+0000 7f3cc5800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc014a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.389+0000 7f3cc5800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc014a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53188/0 (socket says 172.21.15.47:53188) 2024-05-10T04:52:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.389+0000 7f3cc5800700 1 -- 172.21.15.47:0/4284885855 learned_addr learned my addr 172.21.15.47:0/4284885855 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cc4e00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006bdb0 0x7f3cc0155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cbfe00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cc00c5cf0 0x7f3cc01eef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cc4e00700 1 -- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 msgr2=0x7f3cc014a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cc4e00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc014a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cc4e00700 1 -- 172.21.15.47:0/4284885855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cc00c5cf0 msgr2=0x7f3cc01eef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cc4e00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cc00c5cf0 0x7f3cc01eef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.390+0000 7f3cc4e00700 1 -- 172.21.15.47:0/4284885855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac009550 con 0x7f3cc006bdb0 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.391+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f86900d00d0 con 0x7f86880db3e0 2024-05-10T04:52:22.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.392+0000 7f3cc4e00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006bdb0 0x7f3cc0155560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3cac015000 tx=0x7f3cac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.392+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5894054ac0 con 0x7f589c0064f0 2024-05-10T04:52:22.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.392+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00b660 con 0x7f3cc006bdb0 2024-05-10T04:52:22.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.392+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc01eea70 con 0x7f3cc006bdb0 2024-05-10T04:52:22.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.392+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc014b2e0 con 0x7f3cc006bdb0 2024-05-10T04:52:22.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.393+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00b7c0 con 0x7f3cc006bdb0 2024-05-10T04:52:22.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.393+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00b660 con 0x7f3cc006bdb0 2024-05-10T04:52:22.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.396+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c9c0052e0 con 0x7f3cc006bdb0 2024-05-10T04:52:22.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.398+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3cac021070 con 0x7f3cc006bdb0 2024-05-10T04:52:22.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.399+0000 7f3cbcc00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3ca006acf0 0x7f3ca006d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.399+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3cac08a990 con 0x7f3cc006bdb0 2024-05-10T04:52:22.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.400+0000 7f3cbfe00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3ca006acf0 0x7f3ca006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.403+0000 7f3cbfe00700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3ca006acf0 0x7f3ca006d200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0155070 tx=0x7f3cb4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.409+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3cac055990 con 0x7f3cc006bdb0 2024-05-10T04:52:22.414 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.413+0000 7f6476800700 1 Processor -- start 2024-05-10T04:52:22.415 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.414+0000 7f6476800700 1 -- start start 2024-05-10T04:52:22.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.416+0000 7f0fc3800700 1 Processor -- start 2024-05-10T04:52:22.417 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f0fc3800700 1 -- start start 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f6476800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f64700c5ad0 0x7f6470152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f6476800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6470152810 con 0x7f647014f7a0 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f6476800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64700c6df0 con 0x7f6470073010 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f6476800700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64700c25e0 con 0x7f64700c5ad0 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f646f400700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6470073010 0x7f64700721a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46112/0 (socket says 172.21.15.47:46112) 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f646f400700 1 -- 172.21.15.47:0/2120506414 learned_addr learned my addr 172.21.15.47:0/2120506414 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:22.418 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.417+0000 7f646fe00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f647014f7a0 0x7f647015cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43616/0 (socket says 172.21.15.47:43616) 2024-05-10T04:52:22.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.418+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073522042 0 0) 0x7f64700c6df0 con 0x7f6470073010 2024-05-10T04:52:22.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.418+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64540035b0 con 0x7f6470073010 2024-05-10T04:52:22.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.419+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416426161 0 0) 0x7f6470152810 con 0x7f647014f7a0 2024-05-10T04:52:22.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.419+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64700c6df0 con 0x7f647014f7a0 2024-05-10T04:52:22.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.419+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2315527364 0 0) 0x7f64540035b0 con 0x7f6470073010 2024-05-10T04:52:22.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.419+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 >> v2:172.21.15.117:3300/0 conn(0x7f64700c5ad0 msgr2=0x7f6470152ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:52:22.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.419+0000 7f646e000700 1 --2- 172.21.15.47:0/2120506414 >> v2:172.21.15.117:3300/0 conn(0x7f64700c5ad0 0x7f6470152ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.419+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 >> v1:172.21.15.47:6789/0 conn(0x7f647014f7a0 legacy=0x7f647015cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700c1c20 con 0x7f6470073010 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f6460001670 con 0x7f6470073010 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 >> v1:172.21.15.117:6789/0 conn(0x7f6470073010 legacy=0x7f64700721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6454003be0 0x7f6454004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6454004850 0x7f6454004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64540053a0 0x7f6454009c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645400a460 con 0x7f6454003be0 2024-05-10T04:52:22.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645400a5d0 con 0x7f6454004850 2024-05-10T04:52:22.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645400a790 con 0x7f64540053a0 2024-05-10T04:52:22.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.421+0000 7f646f400700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6454003be0 0x7f6454004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.420+0000 7f0fc3800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0fbc0ab850 0x7f0fbc0c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f0fc3800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0fbc0c6b50 0x7f0fbc151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646f400700 1 -- 172.21.15.47:0/2120506414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64540053a0 msgr2=0x7f6454009c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646f400700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f64540053a0 0x7f6454009c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646f400700 1 -- 172.21.15.47:0/2120506414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6454004850 msgr2=0x7f6454004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f0fc0e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0fbc0ab850 0x7f0fbc0c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f0fc0e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0fbc0ab850 0x7f0fbc0c6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53214/0 (socket says 172.21.15.47:53214) 2024-05-10T04:52:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f0fc0e00700 1 -- 172.21.15.47:0/571940276 learned_addr learned my addr 172.21.15.47:0/571940276 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.423+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fbc0ab330 con 0x7f0fbc14f200 2024-05-10T04:52:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.423+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc0c1c50 con 0x7f0fbc0c6b50 2024-05-10T04:52:22.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.423+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fbc06eff0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646f400700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6454004850 0x7f6454004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646f400700 1 -- 172.21.15.47:0/2120506414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540035b0 con 0x7f6454003be0 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646fe00700 1 -- 172.21.15.47:0/2120506414 reap_dead start 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.422+0000 7f646f400700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6454003be0 0x7f6454004030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f647006cda0 tx=0x7f6454005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=813cacb6e7eda05c server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.423+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646000cc70 con 0x7f6454003be0 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.423+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646000cdd0 con 0x7f6454003be0 2024-05-10T04:52:22.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.423+0000 7f646e000700 1 -- 172.21.15.47:0/2120506414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6460005b60 con 0x7f6454003be0 2024-05-10T04:52:22.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.424+0000 7f0fbb400700 1 -- 172.21.15.47:0/571940276 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189672714 0 0) 0x7f0fbc0ab330 con 0x7f0fbc14f200 2024-05-10T04:52:22.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.424+0000 7f0fbb400700 1 -- 172.21.15.47:0/571940276 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa40057c0 con 0x7f0fbc14f200 2024-05-10T04:52:22.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.424+0000 7f6476800700 1 -- 172.21.15.47:0/2120506414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6454003be0 msgr2=0x7f6454004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.424+0000 7f6476800700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6454003be0 0x7f6454004030 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f647006cda0 tx=0x7f6454005880 comp rx=0 tx=0).stop 2024-05-10T04:52:22.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.424+0000 7f0fc0e00700 1 -- 172.21.15.47:0/571940276 >> v2:172.21.15.47:3300/0 conn(0x7f0fbc0c6b50 msgr2=0x7f0fbc151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f0fbb400700 1 -- 172.21.15.47:0/571940276 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1401742478 0 0) 0x7f0fa40057c0 con 0x7f0fbc14f200 2024-05-10T04:52:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f0fc0e00700 1 --2- 172.21.15.47:0/571940276 >> v2:172.21.15.47:3300/0 conn(0x7f0fbc0c6b50 0x7f0fbc151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f0fc0e00700 1 -- 172.21.15.47:0/571940276 >> v1:172.21.15.117:6789/0 conn(0x7f0fbc14f200 legacy=0x7f0fbc151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f0fc0e00700 1 -- 172.21.15.47:0/571940276 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fbc0ab000 con 0x7f0fbc0ab850 2024-05-10T04:52:22.427 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f6476800700 1 -- 172.21.15.47:0/2120506414 shutdown_connections 2024-05-10T04:52:22.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f6476800700 1 --2- 172.21.15.47:0/2120506414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6454003be0 0x7f6454004030 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f6476800700 1 -- 172.21.15.47:0/2120506414 >> 172.21.15.47:0/2120506414 conn(0x7f647006c330 msgr2=0x7f64700a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.428 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f6476800700 1 -- 172.21.15.47:0/2120506414 shutdown_connections 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.426+0000 7f0fc0e00700 1 --2- 172.21.15.47:0/571940276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc0c6610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc070380 tx=0x7f0fb000ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec3a9afe46448bde server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.427+0000 7f0fbb400700 1 -- 172.21.15.47:0/571940276 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb40019f0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.427+0000 7f0fbb400700 1 -- 172.21.15.47:0/571940276 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb0004030 con 0x7f0fbc0ab850 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.427+0000 7f0fbb400700 1 -- 172.21.15.47:0/571940276 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000aea0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.428+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0ab850 msgr2=0x7f0fbc0c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.428+0000 7f0fc3800700 1 --2- 172.21.15.47:0/571940276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc0c6610 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc070380 tx=0x7f0fb000ad70 comp rx=0 tx=0).stop 2024-05-10T04:52:22.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.425+0000 7f6476800700 1 -- 172.21.15.47:0/2120506414 wait complete. 2024-05-10T04:52:22.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.429+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 shutdown_connections 2024-05-10T04:52:22.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.429+0000 7f0fc3800700 1 --2- 172.21.15.47:0/571940276 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc0c6610 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.429+0000 7f0fc3800700 1 --2- 172.21.15.47:0/571940276 >> v2:172.21.15.47:3300/0 conn(0x7f0fbc0c6b50 0x7f0fbc151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.429+0000 7f68bc200700 1 Processor -- start 2024-05-10T04:52:22.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.429+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 >> 172.21.15.47:0/571940276 conn(0x7f0fbc0a8ae0 msgr2=0x7f0fbc0a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.430+0000 7f6476800700 1 Processor -- start 2024-05-10T04:52:22.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.430+0000 7f6476800700 1 -- start start 2024-05-10T04:52:22.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.431+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 shutdown_connections 2024-05-10T04:52:22.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.431+0000 7f0fc3800700 1 -- 172.21.15.47:0/571940276 wait complete. 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.429+0000 7f68bc200700 1 -- start start 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.432+0000 7f68bc200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f68b40c2940 0x7f68b4070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.432+0000 7f68bc200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f68b40c6a50 0x7f68b415dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.432+0000 7f68bc200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b4153ea0 con 0x7f68b40c6640 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.432+0000 7f68bc200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40c6e60 con 0x7f68b40c2940 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.432+0000 7f68bc200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b4154140 con 0x7f68b40c6a50 2024-05-10T04:52:22.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.433+0000 7f68b9800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f68b40c2940 0x7f68b4070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.433+0000 7f68b8e00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f68b40c6640 0x7f68b40c30c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46136/0 (socket says 172.21.15.47:46136) 2024-05-10T04:52:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.433+0000 7f68b8e00700 1 -- 172.21.15.47:0/4055885718 learned_addr learned my addr 172.21.15.47:0/4055885718 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:22.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f68ba200700 1 --2- 172.21.15.47:0/4055885718 >> v2:172.21.15.117:3300/0 conn(0x7f68b40c6a50 0x7f68b415dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f6476800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 0x7f64700ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f6476800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6470152c10 0x7f647014c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f68b3e00700 1 -- 172.21.15.47:0/4055885718 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1336589673 0 0) 0x7f68b4153ea0 con 0x7f68b40c6640 2024-05-10T04:52:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f68b3e00700 1 -- 172.21.15.47:0/4055885718 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f689c0035b0 con 0x7f68b40c6640 2024-05-10T04:52:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f68ba200700 1 -- 172.21.15.47:0/4055885718 >> v2:172.21.15.47:3300/0 conn(0x7f68b40c2940 msgr2=0x7f68b4070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:22.435 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.435+0000 7f68b3e00700 1 -- 172.21.15.47:0/4055885718 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2828237728 0 0) 0x7f689c0035b0 con 0x7f68b40c6640 2024-05-10T04:52:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.434+0000 7f6476800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64700c0700 0x7f64700c0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.435+0000 7f68ba200700 1 --2- 172.21.15.47:0/4055885718 >> v2:172.21.15.47:3300/0 conn(0x7f68b40c2940 0x7f68b4070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.435+0000 7f68ba200700 1 -- 172.21.15.47:0/4055885718 >> v1:172.21.15.117:6789/0 conn(0x7f68b40c6640 legacy=0x7f68b40c30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.436 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.435+0000 7f68ba200700 1 -- 172.21.15.47:0/4055885718 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4070960 con 0x7f68b40c6a50 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f646f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 0x7f64700ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f646f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 0x7f64700ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50606/0 (socket says 172.21.15.47:50606) 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f646f400700 1 -- 172.21.15.47:0/1408521373 learned_addr learned my addr 172.21.15.47:0/1408521373 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700abfb0 con 0x7f6470152c10 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64701f8200 con 0x7f64700c0700 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64700c1050 con 0x7f6454003be0 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f68ba200700 1 --2- 172.21.15.47:0/4055885718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c6a50 0x7f68b415dc00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f68b4072560 tx=0x7f68ac00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a907bedd52eafd74 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.437 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f68b9800700 1 --2- 172.21.15.47:0/4055885718 >> v2:172.21.15.47:3300/0 conn(0x7f68b40c2940 0x7f68b4070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:22.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f646fe00700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64700c0700 0x7f64700c0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f68b3e00700 1 -- 172.21.15.47:0/4055885718 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00e070 con 0x7f68b40c6a50 2024-05-10T04:52:22.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f0fc3800700 1 Processor -- start 2024-05-10T04:52:22.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f68b3e00700 1 -- 172.21.15.47:0/4055885718 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac003a20 con 0x7f68b40c6a50 2024-05-10T04:52:22.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f68b3e00700 1 -- 172.21.15.47:0/4055885718 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00e070 con 0x7f68b40c6a50 2024-05-10T04:52:22.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f0fc3800700 1 -- start start 2024-05-10T04:52:22.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.436+0000 7f646ea00700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6470152c10 0x7f647014c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f646fe00700 1 -- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 msgr2=0x7f64700ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f646fe00700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 0x7f64700ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f646fe00700 1 -- 172.21.15.47:0/1408521373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6470152c10 msgr2=0x7f647014c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f646fe00700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6470152c10 0x7f647014c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.437+0000 7f646fe00700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64700ad830 con 0x7f64700c0700 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f646f400700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 0x7f64700ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f68bc200700 1 -- 172.21.15.47:0/4055885718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c6a50 msgr2=0x7f68b415dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f68bc200700 1 --2- 172.21.15.47:0/4055885718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c6a50 0x7f68b415dc00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f68b4072560 tx=0x7f68ac00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:22.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f646fe00700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64700c0700 0x7f64700c0b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64700c2ef0 tx=0x7f645c00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f68bc200700 1 -- 172.21.15.47:0/4055885718 shutdown_connections 2024-05-10T04:52:22.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f68bc200700 1 --2- 172.21.15.47:0/4055885718 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c6a50 0x7f68b415dc00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f68bc200700 1 --2- 172.21.15.47:0/4055885718 >> v2:172.21.15.47:3300/0 conn(0x7f68b40c2940 0x7f68b4070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.438+0000 7f68bc200700 1 -- 172.21.15.47:0/4055885718 >> 172.21.15.47:0/4055885718 conn(0x7f68b40aa470 msgr2=0x7f68b40aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f68bc200700 1 -- 172.21.15.47:0/4055885718 shutdown_connections 2024-05-10T04:52:22.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c005cb0 con 0x7f64700c0700 2024-05-10T04:52:22.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f68bc200700 1 -- 172.21.15.47:0/4055885718 wait complete. 2024-05-10T04:52:22.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645c005e10 con 0x7f64700c0700 2024-05-10T04:52:22.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f645c0072b0 con 0x7f64700c0700 2024-05-10T04:52:22.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64700c1590 con 0x7f64700c0700 2024-05-10T04:52:22.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.439+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6470154d20 con 0x7f64700c0700 2024-05-10T04:52:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.440+0000 7f0fc3800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.440+0000 7f0fc0e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.440+0000 7f0fc0e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc1514d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36834/0 (socket says 172.21.15.47:36834) 2024-05-10T04:52:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.440+0000 7f0fc0e00700 1 -- 172.21.15.47:0/406339124 learned_addr learned my addr 172.21.15.47:0/406339124 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0c6b50 0x7f0fbc152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc14f200 0x7f0fbc146f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6470074720 con 0x7f64700c0700 2024-05-10T04:52:22.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc1eab00 con 0x7f0fbc0ab850 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc14fa10 con 0x7f0fbc0c6b50 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fbc14fcd0 con 0x7f0fbc14f200 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fc1800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc14f200 0x7f0fbc146f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.441+0000 7f0fbbe00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0c6b50 0x7f0fbc152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.442+0000 7f0fc0e00700 1 -- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc14f200 msgr2=0x7f0fbc146f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.442+0000 7f0fc0e00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc14f200 0x7f0fbc146f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.442+0000 7f0fc0e00700 1 -- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0c6b50 msgr2=0x7f0fbc152230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.442+0000 7f0fc0e00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0c6b50 0x7f0fbc152230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.442+0000 7f0fc0e00700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb000a6f0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.443+0000 7f0fc0e00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc1514d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0c1d90 tx=0x7f0fb0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.444+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb001f070 con 0x7f0fbc0ab850 2024-05-10T04:52:22.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.443+0000 7f68bc200700 1 Processor -- start 2024-05-10T04:52:22.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.444+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000cbc0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.444+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb00036a0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.444+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fbc072800 con 0x7f0fbc0ab850 2024-05-10T04:52:22.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.445+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fbc071b70 con 0x7f0fbc0ab850 2024-05-10T04:52:22.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.445+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f645c007410 con 0x7f64700c0700 2024-05-10T04:52:22.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.446+0000 7f6467400700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f645006ad90 0x7f645006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.446+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f645c088960 con 0x7f64700c0700 2024-05-10T04:52:22.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.446+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fbc071d30 con 0x7f0fbc0ab850 2024-05-10T04:52:22.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.447+0000 7f646f400700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f645006ad90 0x7f645006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.448+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fb0003800 con 0x7f0fbc0ab850 2024-05-10T04:52:22.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.447+0000 7f68bc200700 1 -- start start 2024-05-10T04:52:22.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.450+0000 7f68bc200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 0x7f68b41f2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.450+0000 7f0fb8c00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fa006ad10 0x7f0fa006d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.450+0000 7f68bc200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b40c6640 0x7f68b414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.450+0000 7f68bc200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68b40c6a50 0x7f68b40a9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68bc200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b414bd40 con 0x7f68b40c6640 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68bc200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b414c480 con 0x7f68b40c2940 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68b9800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 0x7f68b41f2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68b9800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 0x7f68b41f2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53268/0 (socket says 172.21.15.47:53268) 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68b9800700 1 -- 172.21.15.47:0/3154240545 learned_addr learned my addr 172.21.15.47:0/3154240545 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b414e480 con 0x7f68b40c6a50 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.451+0000 7f68b8e00700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b40c6640 0x7f68b414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.452+0000 7f68ba200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68b40c6a50 0x7f68b40a9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.452+0000 7f68b9800700 1 -- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68b40c6a50 msgr2=0x7f68b40a9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.452+0000 7f68b9800700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68b40c6a50 0x7f68b40a9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.452+0000 7f68b9800700 1 -- 172.21.15.47:0/3154240545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b40c6640 msgr2=0x7f68b414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.453+0000 7f68b9800700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b40c6640 0x7f68b414b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.453+0000 7f68b9800700 1 -- 172.21.15.47:0/3154240545 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a80094a0 con 0x7f68b40c2940 2024-05-10T04:52:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.453+0000 7f68ba200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68b40c6a50 0x7f68b40a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.453+0000 7f646f400700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f645006ad90 0x7f645006d2a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6460000c00 tx=0x7f6460007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.453+0000 7f68b8e00700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b40c6640 0x7f68b414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:22.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.453+0000 7f68b9800700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 0x7f68b41f2a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f68a800ec10 tx=0x7f68a8009e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fb0059150 con 0x7f0fbc0ab850 2024-05-10T04:52:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f0fbbe00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fa006ad10 0x7f0fa006d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800c8e0 con 0x7f68b40c2940 2024-05-10T04:52:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800ca40 con 0x7f68b40c2940 2024-05-10T04:52:22.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68ac009a70 con 0x7f68b40c2940 2024-05-10T04:52:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800cdd0 con 0x7f68b40c2940 2024-05-10T04:52:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.455+0000 7f0fbbe00700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fa006ad10 0x7f0fa006d220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fac006fd0 tx=0x7f0fac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.454+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b4150b20 con 0x7f68b40c2940 2024-05-10T04:52:22.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.456+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f645c053830 con 0x7f64700c0700 2024-05-10T04:52:22.457 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.457+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b414c630 con 0x7f68b40c2940 2024-05-10T04:52:22.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.461+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f68a8013470 con 0x7f68b40c2940 2024-05-10T04:52:22.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.462+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0fb008f060 con 0x7f0fbc0ab850 2024-05-10T04:52:22.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.463+0000 7f68b1600700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f689406ac90 0x7f689406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:22.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.463+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68a8089b60 con 0x7f68b40c2940 2024-05-10T04:52:22.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.465+0000 7f68b8e00700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f689406ac90 0x7f689406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:22.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.465+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f68b414c630 con 0x7f68b40c2940 2024-05-10T04:52:22.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.470+0000 7f68b8e00700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f689406ac90 0x7f689406d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68b4067e40 tx=0x7f68a0001990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:22.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.857+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5878005860 con 0x7f589c0064f0 2024-05-10T04:52:22.859 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.858+0000 7f589aa00700 1 -- 172.21.15.47:0/3389787027 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5894017020 con 0x7f589c0064f0 2024-05-10T04:52:22.862 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:22.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.862+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f19a4005590 con 0x7f19c00debe0 2024-05-10T04:52:22.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.863+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f588406acc0 msgr2=0x7f588406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.863 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.863+0000 7f588fe00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f588406acc0 0x7f588406d1d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f58a4079de0 tx=0x7f58a406e030 comp rx=0 tx=0).stop 2024-05-10T04:52:22.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.863+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c0064f0 msgr2=0x7f589c02f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.863+0000 7f588fe00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c0064f0 0x7f589c02f800 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f589c045fc0 tx=0x7f589400ec80 comp rx=0 tx=0).stop 2024-05-10T04:52:22.864 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.863+0000 7f19c5600700 1 -- 172.21.15.47:0/1028496184 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19b40093e0 con 0x7f19c00debe0 2024-05-10T04:52:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.864+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 shutdown_connections 2024-05-10T04:52:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.864+0000 7f588fe00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f588406acc0 0x7f588406d1d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.864+0000 7f588fe00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f589c047ef0 0x7f589c0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.864+0000 7f588fe00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f589c0060e0 0x7f589c041aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.865 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.864+0000 7f588fe00700 1 --2- 172.21.15.47:0/3389787027 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f589c0064f0 0x7f589c02f800 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.864+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 >> 172.21.15.47:0/3389787027 conn(0x7f589c02d580 msgr2=0x7f589c02bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.865+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 shutdown_connections 2024-05-10T04:52:22.866 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:22.866 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.865+0000 7f588fe00700 1 -- 172.21.15.47:0/3389787027 wait complete. 2024-05-10T04:52:22.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.869+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f19a806ad60 msgr2=0x7f19a806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.869+0000 7f19ce800700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f19a806ad60 0x7f19a806d270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f19c8069330 tx=0x7f19c8067ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.869+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 msgr2=0x7f19c00d4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.870 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.869+0000 7f19ce800700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c00d4410 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f19b400e840 tx=0x7f19b400ec00 comp rx=0 tx=0).stop 2024-05-10T04:52:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.870+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 shutdown_connections 2024-05-10T04:52:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.871+0000 7f19ce800700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f19c00debe0 0x7f19c00d4410 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.871+0000 7f19ce800700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f19a806ad60 0x7f19a806d270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.871+0000 7f19ce800700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f19c0009870 0x7f19c0042040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.871+0000 7f19ce800700 1 --2- 172.21.15.47:0/1028496184 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f19c000a990 0x7f19c0178650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.871+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 >> 172.21.15.47:0/1028496184 conn(0x7f19c004aa60 msgr2=0x7f19c00d6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.872+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 shutdown_connections 2024-05-10T04:52:22.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.872+0000 7f19ce800700 1 -- 172.21.15.47:0/1028496184 wait complete. 2024-05-10T04:52:22.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.882+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fba8c0eeaa0 con 0x7fba8c033530 2024-05-10T04:52:22.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.883+0000 7fba90c00700 1 -- 172.21.15.47:0/966042372 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fba8c0eeaa0 con 0x7fba8c033530 2024-05-10T04:52:22.884 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.887+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fba7406ad10 msgr2=0x7fba7406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.887+0000 7fba9bc00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fba7406ad10 0x7fba7406d220 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba9406a570 tx=0x7fba94094040 comp rx=0 tx=0).stop 2024-05-10T04:52:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.887+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba8c033530 msgr2=0x7fba8c0463c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.890 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.887+0000 7fba9bc00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba8c033530 0x7fba8c0463c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fba8000e600 tx=0x7fba8000e9c0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 shutdown_connections 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fba7406ad10 0x7fba7406d220 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fba8c0dc610 0x7fba8c045190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fba8c032fe0 0x7fba8c0d8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 --2- 172.21.15.47:0/966042372 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fba8c033530 0x7fba8c0463c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 >> 172.21.15.47:0/966042372 conn(0x7fba8c04dcf0 msgr2=0x7fba8c04e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.888+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 shutdown_connections 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.889+0000 7fba9bc00700 1 -- 172.21.15.47:0/966042372 wait complete. 2024-05-10T04:52:22.891 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.889+0000 7f868f200700 1 -- 172.21.15.47:0/2816646053 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8688175060 con 0x7f86880db3e0 2024-05-10T04:52:22.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.890+0000 7f8686000700 1 -- 172.21.15.47:0/2816646053 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86900d36f0 con 0x7f86880db3e0 2024-05-10T04:52:22.892 INFO:teuthology.orchestra.run.smithi047.stdout:60129542152 2024-05-10T04:52:22.895 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 -- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f867006ace0 msgr2=0x7f867006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f867006ace0 0x7f867006d1f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f867c0017b0 tx=0x7f867c009040 comp rx=0 tx=0).stop 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 -- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 msgr2=0x7f86880cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 0x7f86880cca20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8690000eb0 tx=0x7f86900739c0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 -- 172.21.15.47:0/2816646053 shutdown_connections 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f86880db3e0 0x7f86880cca20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8688007090 0x7f86881743a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f867006ace0 0x7f867006d1f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.896 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 --2- 172.21.15.47:0/2816646053 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f86880465b0 0x7f868802fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.895+0000 7f867b400700 1 -- 172.21.15.47:0/2816646053 >> 172.21.15.47:0/2816646053 conn(0x7f86880060b0 msgr2=0x7f868802cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.896+0000 7f867b400700 1 -- 172.21.15.47:0/2816646053 shutdown_connections 2024-05-10T04:52:22.897 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.896+0000 7f867b400700 1 -- 172.21.15.47:0/2816646053 wait complete. 2024-05-10T04:52:22.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.899+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f3c9c005590 con 0x7f3cc006bdb0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.900+0000 7f3cbcc00700 1 -- 172.21.15.47:0/4284885855 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3cac058fb0 con 0x7f3cc006bdb0 2024-05-10T04:52:22.901 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.904+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3ca006acf0 msgr2=0x7f3ca006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3ca006acf0 0x7f3ca006d200 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0155070 tx=0x7f3cb4008040 comp rx=0 tx=0).stop 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006bdb0 msgr2=0x7f3cc0155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006bdb0 0x7f3cc0155560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3cac015000 tx=0x7f3cac004750 comp rx=0 tx=0).stop 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 shutdown_connections 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3cc00c6cc0 0x7f3cc014a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3ca006acf0 0x7f3ca006d200 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3cc006bdb0 0x7f3cc0155560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 --2- 172.21.15.47:0/4284885855 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3cc00c5cf0 0x7f3cc01eef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.905+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 >> 172.21.15.47:0/4284885855 conn(0x7f3cc00ca960 msgr2=0x7f3cc006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.906+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 shutdown_connections 2024-05-10T04:52:22.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.906+0000 7f3cc7800700 1 -- 172.21.15.47:0/4284885855 wait complete. 2024-05-10T04:52:22.915 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2024-05-10T04:52:22.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.922+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f64700c21a0 con 0x7f64700c0700 2024-05-10T04:52:22.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.923+0000 7f6467400700 1 -- 172.21.15.47:0/1408521373 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f645c056e50 con 0x7f64700c0700 2024-05-10T04:52:22.924 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-05-10T04:52:22.924 INFO:teuthology.orchestra.run.smithi047.stdout:55834574858 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f645006ad90 msgr2=0x7f645006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f645006ad90 0x7f645006d2a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6460000c00 tx=0x7f6460007000 comp rx=0 tx=0).stop 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64700c0700 msgr2=0x7f64700c0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64700c0700 0x7f64700c0b10 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f64700c2ef0 tx=0x7f645c00c860 comp rx=0 tx=0).stop 2024-05-10T04:52:22.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 shutdown_connections 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f64700c0700 0x7f64700c0b10 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f645006ad90 0x7f645006d2a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6454003be0 0x7f64700ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 --2- 172.21.15.47:0/1408521373 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6470152c10 0x7f647014c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.926+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 >> 172.21.15.47:0/1408521373 conn(0x7f647006c330 msgr2=0x7f647014efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.927+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 shutdown_connections 2024-05-10T04:52:22.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.927+0000 7f6476800700 1 -- 172.21.15.47:0/1408521373 wait complete. 2024-05-10T04:52:22.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.3 2024-05-10T04:52:22.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.935+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0fbc1492a0 con 0x7f0fbc0ab850 2024-05-10T04:52:22.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.935+0000 7f0fb8c00700 1 -- 172.21.15.47:0/406339124 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fb0054d90 con 0x7f0fbc0ab850 2024-05-10T04:52:22.936 INFO:teuthology.orchestra.run.smithi047.stdout:60129542152 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fa006ad10 msgr2=0x7f0fa006d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fa006ad10 0x7f0fa006d220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0fac006fd0 tx=0x7f0fac008040 comp rx=0 tx=0).stop 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 msgr2=0x7f0fbc1514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc1514d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc0c1d90 tx=0x7f0fb0004750 comp rx=0 tx=0).stop 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 shutdown_connections 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fa006ad10 0x7f0fa006d220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0fbc14f200 0x7f0fbc146f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0fbc0ab850 0x7f0fbc1514d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.939 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 --2- 172.21.15.47:0/406339124 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0fbc0c6b50 0x7f0fbc152230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 >> 172.21.15.47:0/406339124 conn(0x7f0fbc0a8ae0 msgr2=0x7f0fbc14b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 shutdown_connections 2024-05-10T04:52:22.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.938+0000 7f0fc3800700 1 -- 172.21.15.47:0/406339124 wait complete. 2024-05-10T04:52:22.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.945+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f68b4074720 con 0x7f68b40c2940 2024-05-10T04:52:22.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.946+0000 7f68b1600700 1 -- 172.21.15.47:0/3154240545 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68a8017090 con 0x7f68b40c2940 2024-05-10T04:52:22.946 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:22.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.1 2024-05-10T04:52:22.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f689406ac90 msgr2=0x7f689406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f689406ac90 0x7f689406d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f68b4067e40 tx=0x7f68a0001990 comp rx=0 tx=0).stop 2024-05-10T04:52:22.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 msgr2=0x7f68b41f2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:22.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 0x7f68b41f2a30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f68a800ec10 tx=0x7f68a8009e20 comp rx=0 tx=0).stop 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 shutdown_connections 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f689406ac90 0x7f689406d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f68b40c6a50 0x7f68b40a9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f68b40c2940 0x7f68b41f2a30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 --2- 172.21.15.47:0/3154240545 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f68b40c6640 0x7f68b414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 >> 172.21.15.47:0/3154240545 conn(0x7f68b40aa470 msgr2=0x7f68b41532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 shutdown_connections 2024-05-10T04:52:22.952 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:22.950+0000 7f68bc200700 1 -- 172.21.15.47:0/3154240545 wait complete. 2024-05-10T04:52:22.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2024-05-10T04:52:22.957 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-05-10T04:52:22.978 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2024-05-10T04:52:22.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.7 2024-05-10T04:52:23.916 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-10T04:52:23.925 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-10T04:52:23.932 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-10T04:52:23.949 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-10T04:52:23.953 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-10T04:52:23.958 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-10T04:52:23.979 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-10T04:52:23.990 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-10T04:52:24.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.369+0000 7fb125c00700 1 Processor -- start 2024-05-10T04:52:24.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.370+0000 7fb125c00700 1 -- start start 2024-05-10T04:52:24.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.373+0000 7fb125c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb1180e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.373+0000 7fb125c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb118051110 0x7fb1180535e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.374+0000 7fb125c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb118053150 con 0x7fb118050d00 2024-05-10T04:52:24.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.374+0000 7fb125c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11804fe30 con 0x7fb118051110 2024-05-10T04:52:24.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.374+0000 7fb11e000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb118050d00 0x7fb1180e1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43624/0 (socket says 172.21.15.47:43624) 2024-05-10T04:52:24.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.375+0000 7fb125c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb118052820 con 0x7fb11804f590 2024-05-10T04:52:24.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.375+0000 7fb11f400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb118051110 0x7fb1180535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.375+0000 7fb11f400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb118051110 0x7fb1180535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53270/0 (socket says 172.21.15.47:53270) 2024-05-10T04:52:24.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.375+0000 7fb11f400700 1 -- 172.21.15.47:0/2054392736 learned_addr learned my addr 172.21.15.47:0/2054392736 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.376+0000 7fb11ea00700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb1180e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.376+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 511633453 0 0) 0x7fb118053150 con 0x7fb118050d00 2024-05-10T04:52:24.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.376+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1040035b0 con 0x7fb118050d00 2024-05-10T04:52:24.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.378+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2713536348 0 0) 0x7fb1040035b0 con 0x7fb118050d00 2024-05-10T04:52:24.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 msgr2=0x7fb1180e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb1180e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 >> v2:172.21.15.117:3300/0 conn(0x7fb118051110 msgr2=0x7fb1180535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 --2- 172.21.15.47:0/2054392736 >> v2:172.21.15.117:3300/0 conn(0x7fb118051110 0x7fb1180535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb118052b00 con 0x7fb118050d00 2024-05-10T04:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11f400700 1 --2- 172.21.15.47:0/2054392736 >> v2:172.21.15.117:3300/0 conn(0x7fb118051110 0x7fb1180535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7fb10c001670 con 0x7fb118050d00 2024-05-10T04:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 >> v1:172.21.15.47:6789/0 conn(0x7fb118050d00 legacy=0x7fb1180e1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.379+0000 7fb11d600700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb104003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.380+0000 7fb11d600700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb104003fd0 0x7fb104004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.380+0000 7fb11d600700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb104004d90 0x7fb1040051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.380+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb118052820 con 0x7fb104003fd0 2024-05-10T04:52:24.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.380+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10400bb20 con 0x7fb104004d90 2024-05-10T04:52:24.382 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.380+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10400bce0 con 0x7fb11804f590 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.381+0000 7fb11e000700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb104003fd0 0x7fb104004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.381+0000 7fb11f400700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb104004d90 0x7fb1040051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.381+0000 7fb11ea00700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb104003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.382+0000 7fb11ea00700 1 -- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb104004d90 msgr2=0x7fb1040051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.382+0000 7fb11ea00700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb104004d90 0x7fb1040051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.382+0000 7fb11ea00700 1 -- 172.21.15.47:0/2054392736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb104003fd0 msgr2=0x7fb104004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.382+0000 7fb11ea00700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb104003fd0 0x7fb104004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.382+0000 7fb11ea00700 1 -- 172.21.15.47:0/2054392736 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1040035b0 con 0x7fb11804f590 2024-05-10T04:52:24.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.383+0000 7fb11ea00700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb104003a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb120000eb0 tx=0x7fb104005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ffd1456c090c89d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.384 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.383+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12004f2c0 con 0x7fb11804f590 2024-05-10T04:52:24.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.383+0000 7fb11d600700 1 -- 172.21.15.47:0/2054392736 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120068430 con 0x7fb11804f590 2024-05-10T04:52:24.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.385+0000 7fb125c00700 1 -- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 msgr2=0x7fb104003a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.385+0000 7fb125c00700 1 --2- 172.21.15.47:0/2054392736 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb104003a00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb120000eb0 tx=0x7fb104005880 comp rx=0 tx=0).stop 2024-05-10T04:52:24.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.385+0000 7fb11f400700 1 -- 172.21.15.47:0/2054392736 reap_dead start 2024-05-10T04:52:24.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.385+0000 7fb125c00700 1 -- 172.21.15.47:0/2054392736 shutdown_connections 2024-05-10T04:52:24.386 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.386+0000 7fb125c00700 1 -- 172.21.15.47:0/2054392736 >> 172.21.15.47:0/2054392736 conn(0x7fb118035fe0 msgr2=0x7fb1180363f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.386+0000 7fb125c00700 1 -- 172.21.15.47:0/2054392736 shutdown_connections 2024-05-10T04:52:24.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.386+0000 7fb125c00700 1 -- 172.21.15.47:0/2054392736 wait complete. 2024-05-10T04:52:24.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.391+0000 7fb125c00700 1 Processor -- start 2024-05-10T04:52:24.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.391+0000 7fb125c00700 1 -- start start 2024-05-10T04:52:24.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.394+0000 7fb125c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb118048c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.395+0000 7fb125c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 0x7fb11804d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.395+0000 7fb125c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb118038a00 0x7fb1180d7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.395+0000 7fb125c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11804ca00 con 0x7fb118038a00 2024-05-10T04:52:24.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.396+0000 7fb125c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb11804db20 con 0x7fb118047dc0 2024-05-10T04:52:24.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.396+0000 7fb125c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb11804dcc0 con 0x7fb11804f590 2024-05-10T04:52:24.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.397+0000 7fb11ea00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb118048c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.397+0000 7fb11e000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 0x7fb11804d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.397+0000 7fb11e000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 0x7fb11804d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53296/0 (socket says 172.21.15.47:53296) 2024-05-10T04:52:24.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.397+0000 7fb11e000700 1 -- 172.21.15.47:0/1335608829 learned_addr learned my addr 172.21.15.47:0/1335608829 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.397+0000 7fb11f400700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb118038a00 0x7fb1180d7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11e000700 1 -- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 msgr2=0x7fb118048c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11e000700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb118048c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11e000700 1 -- 172.21.15.47:0/1335608829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb118038a00 msgr2=0x7fb1180d7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11e000700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb118038a00 0x7fb1180d7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11e000700 1 -- 172.21.15.47:0/1335608829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11804d1d0 con 0x7fb118047dc0 2024-05-10T04:52:24.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11ea00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb118048c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.399+0000 7fb11f400700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb118038a00 0x7fb1180d7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:24.401 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.401+0000 7fb11e000700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 0x7fb11804d5e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb10c001d90 tx=0x7fb10c007340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.401+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c011580 con 0x7fb118047dc0 2024-05-10T04:52:24.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.402+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10c0116e0 con 0x7fb118047dc0 2024-05-10T04:52:24.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.402+0000 7fb125c00700 1 -- 172.21.15.47:0/1335608829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb11804cc10 con 0x7fb118047dc0 2024-05-10T04:52:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.402+0000 7fb125c00700 1 -- 172.21.15.47:0/1335608829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1180486f0 con 0x7fb118047dc0 2024-05-10T04:52:24.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.402+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10c011580 con 0x7fb118047dc0 2024-05-10T04:52:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.405+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f40052e0 con 0x7fb118047dc0 2024-05-10T04:52:24.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.406+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb10c011870 con 0x7fb118047dc0 2024-05-10T04:52:24.408 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.407+0000 7fb116a00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fb10006acf0 0x7fb10006d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.409 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.408+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb10c0893c0 con 0x7fb118047dc0 2024-05-10T04:52:24.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.409+0000 7fb11ea00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fb10006acf0 0x7fb10006d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.411 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.410+0000 7fb11ea00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fb10006acf0 0x7fb10006d200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb10400be70 tx=0x7fb12006e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.413 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.413+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fb10c054210 con 0x7fb118047dc0 2024-05-10T04:52:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.457+0000 7f9102000700 1 Processor -- start 2024-05-10T04:52:24.458 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.458+0000 7f9102000700 1 -- start start 2024-05-10T04:52:24.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.460+0000 7f9102000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90f4035550 0x7f90f404b040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.460+0000 7f9102000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f90f40075d0 0x7f90f40db250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.460+0000 7f9102000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f400f0e0 con 0x7f90f40079e0 2024-05-10T04:52:24.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.460+0000 7f9102000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f4035960 con 0x7f90f40075d0 2024-05-10T04:52:24.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.460+0000 7f9102000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f400e4d0 con 0x7f90f4035550 2024-05-10T04:52:24.461 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.460+0000 7efcfe200700 1 Processor -- start 2024-05-10T04:52:24.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.461+0000 7f9100c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f90f4035550 0x7f90f404b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.461+0000 7f9101600700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f90f40079e0 0x7f90f404ddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46140/0 (socket says 172.21.15.47:46140) 2024-05-10T04:52:24.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.461+0000 7f9101600700 1 -- 172.21.15.47:0/2412362367 learned_addr learned my addr 172.21.15.47:0/2412362367 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:24.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.462+0000 7efcfe200700 1 -- start start 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f9100c00700 1 -- 172.21.15.47:0/2412362367 >> v2:172.21.15.47:3300/0 conn(0x7f90f40075d0 msgr2=0x7f90f40db250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f90fbe00700 1 --2- 172.21.15.47:0/2412362367 >> v2:172.21.15.47:3300/0 conn(0x7f90f40075d0 0x7f90f40db250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f9100c00700 1 --2- 172.21.15.47:0/2412362367 >> v2:172.21.15.47:3300/0 conn(0x7f90f40075d0 0x7f90f40db250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f9100c00700 1 -- 172.21.15.47:0/2412362367 >> v1:172.21.15.117:6789/0 conn(0x7f90f40079e0 legacy=0x7f90f404ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f9100c00700 1 -- 172.21.15.47:0/2412362367 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f400e7b0 con 0x7f90f4035550 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f90fb400700 1 -- 172.21.15.47:0/2412362367 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836144182 0 0) 0x7f90f400f0e0 con 0x7f90f40079e0 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.463+0000 7f90fbe00700 1 --2- 172.21.15.47:0/2412362367 >> v2:172.21.15.47:3300/0 conn(0x7f90f40075d0 0x7f90f40db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.464+0000 7f2e07a00700 1 Processor -- start 2024-05-10T04:52:24.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.464+0000 7f9100c00700 1 --2- 172.21.15.47:0/2412362367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4035550 0x7f90f404b040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90fc02d440 tx=0x7f90fc04fe00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52075a1379395ee0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7f90fb400700 1 -- 172.21.15.47:0/2412362367 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc068630 con 0x7f90f4035550 2024-05-10T04:52:24.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7f90fb400700 1 -- 172.21.15.47:0/2412362367 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc068790 con 0x7f90f4035550 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7f90fb400700 1 -- 172.21.15.47:0/2412362367 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc068630 con 0x7f90f4035550 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7efcfe200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efcf806df40 0x7efcf80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7efcfe200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf80c24a0 0x7efcf80c28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7efcfe200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf80ab580 con 0x7efcf8072620 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7efcfe200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf8072f50 con 0x7efcf806df40 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.465+0000 7efcfe200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c1970 con 0x7efcf80c24a0 2024-05-10T04:52:24.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.464+0000 7f2e07a00700 1 -- start start 2024-05-10T04:52:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.466+0000 7f9102000700 1 -- 172.21.15.47:0/2412362367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4035550 msgr2=0x7f90f404b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.466+0000 7f9102000700 1 --2- 172.21.15.47:0/2412362367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4035550 0x7f90f404b040 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90fc02d440 tx=0x7f90fc04fe00 comp rx=0 tx=0).stop 2024-05-10T04:52:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.466+0000 7f9102000700 1 -- 172.21.15.47:0/2412362367 shutdown_connections 2024-05-10T04:52:24.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7efcf7400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efcf806df40 0x7efcf80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.466+0000 7f9102000700 1 --2- 172.21.15.47:0/2412362367 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f4035550 0x7f90f404b040 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7efcf7400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7efcf806df40 0x7efcf80c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36878/0 (socket says 172.21.15.47:36878) 2024-05-10T04:52:24.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.466+0000 7f9102000700 1 --2- 172.21.15.47:0/2412362367 >> v2:172.21.15.47:3300/0 conn(0x7f90f40075d0 0x7f90f40db250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f9102000700 1 -- 172.21.15.47:0/2412362367 >> 172.21.15.47:0/2412362367 conn(0x7f90f404c850 msgr2=0x7f90f404cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f2e07a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e000aaee0 0x7f2e000c69d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f2e07a00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e00072bd0 con 0x7f2e000c1080 2024-05-10T04:52:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f2e07a00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0015a5d0 con 0x7f2e00072f80 2024-05-10T04:52:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f2e07a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e000ab2f0 con 0x7f2e000aaee0 2024-05-10T04:52:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7efcf7e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf80c24a0 0x7efcf80c28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.470 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7efcf7400700 1 -- 172.21.15.47:0/658290733 learned_addr learned my addr 172.21.15.47:0/658290733 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f9102000700 1 -- 172.21.15.47:0/2412362367 shutdown_connections 2024-05-10T04:52:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f2e05000700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f2e00072f80 0x7f2e0006ded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46160/0 (socket says 172.21.15.47:46160) 2024-05-10T04:52:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.467+0000 7f2e05000700 1 -- 172.21.15.47:0/1334788470 learned_addr learned my addr 172.21.15.47:0/1334788470 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7f2e05a00700 1 --2- 172.21.15.47:0/1334788470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e000aaee0 0x7f2e000c69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7f2e05a00700 1 -- 172.21.15.47:0/1334788470 >> v1:172.21.15.117:6789/0 conn(0x7f2e00072f80 legacy=0x7f2e0006ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7f2e05a00700 1 -- 172.21.15.47:0/1334788470 >> v1:172.21.15.47:6789/0 conn(0x7f2e000c1080 legacy=0x7f2e000aa7d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-10T04:52:24.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7f9102000700 1 -- 172.21.15.47:0/2412362367 wait complete. 2024-05-10T04:52:24.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7f2e05a00700 1 -- 172.21.15.47:0/1334788470 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e000aa4f0 con 0x7f2e000aaee0 2024-05-10T04:52:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7efcf7400700 1 -- 172.21.15.47:0/658290733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf80c24a0 msgr2=0x7efcf80c28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7efcf7400700 1 --2- 172.21.15.47:0/658290733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf80c24a0 0x7efcf80c28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7efcf7400700 1 -- 172.21.15.47:0/658290733 >> v1:172.21.15.117:6789/0 conn(0x7efcf8072620 legacy=0x7efcf8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7efcf7400700 1 -- 172.21.15.47:0/658290733 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf806eb40 con 0x7efcf806df40 2024-05-10T04:52:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.468+0000 7f8f16e00700 1 Processor -- start 2024-05-10T04:52:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.469+0000 7efcf7400700 1 --2- 172.21.15.47:0/658290733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf806df40 0x7efcf80c6a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009e50 tx=0x7efcf000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35aed60e7c14060e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.469+0000 7f2e05a00700 1 --2- 172.21.15.47:0/1334788470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e000aaee0 0x7f2e000c69d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009dc0 tx=0x7f2df800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e12d5e294e4febf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.469+0000 7f2dff400700 1 -- 172.21.15.47:0/1334788470 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800e070 con 0x7f2e000aaee0 2024-05-10T04:52:24.474 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.469+0000 7f8f16e00700 1 -- start start 2024-05-10T04:52:24.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.469+0000 7f2dff400700 1 -- 172.21.15.47:0/1334788470 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df800bb90 con 0x7f2e000aaee0 2024-05-10T04:52:24.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.469+0000 7f2dff400700 1 -- 172.21.15.47:0/1334788470 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8003a20 con 0x7f2e000aaee0 2024-05-10T04:52:24.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.470+0000 7efcf6000700 1 -- 172.21.15.47:0/658290733 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf000e070 con 0x7efcf806df40 2024-05-10T04:52:24.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.471+0000 7f2e07a00700 1 -- 172.21.15.47:0/1334788470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e000aaee0 msgr2=0x7f2e000c69d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.471+0000 7f2e07a00700 1 --2- 172.21.15.47:0/1334788470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e000aaee0 0x7f2e000c69d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2df8009dc0 tx=0x7f2df800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.470+0000 7efcf6000700 1 -- 172.21.15.47:0/658290733 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf0003a20 con 0x7efcf806df40 2024-05-10T04:52:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.470+0000 7efcf6000700 1 -- 172.21.15.47:0/658290733 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0003dd0 con 0x7efcf806df40 2024-05-10T04:52:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.471+0000 7efcfe200700 1 -- 172.21.15.47:0/658290733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf806df40 msgr2=0x7efcf80c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.471+0000 7efcfe200700 1 --2- 172.21.15.47:0/658290733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf806df40 0x7efcf80c6a40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009e50 tx=0x7efcf000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.472+0000 7f2e07a00700 1 -- 172.21.15.47:0/1334788470 shutdown_connections 2024-05-10T04:52:24.476 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.472+0000 7f2e07a00700 1 --2- 172.21.15.47:0/1334788470 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e000aaee0 0x7f2e000c69d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.472+0000 7f2e07a00700 1 -- 172.21.15.47:0/1334788470 >> 172.21.15.47:0/1334788470 conn(0x7f2e000a8ae0 msgr2=0x7f2e000a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.472+0000 7efcfe200700 1 -- 172.21.15.47:0/658290733 shutdown_connections 2024-05-10T04:52:24.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.472+0000 7efcfe200700 1 --2- 172.21.15.47:0/658290733 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf80c24a0 0x7efcf80c28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.472+0000 7efcfe200700 1 --2- 172.21.15.47:0/658290733 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf806df40 0x7efcf80c6a40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.473+0000 7efcfe200700 1 -- 172.21.15.47:0/658290733 >> 172.21.15.47:0/658290733 conn(0x7efcf80a86c0 msgr2=0x7efcf80a8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.477 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.473+0000 7efcfe200700 1 -- 172.21.15.47:0/658290733 shutdown_connections 2024-05-10T04:52:24.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.473+0000 7f2e07a00700 1 -- 172.21.15.47:0/1334788470 shutdown_connections 2024-05-10T04:52:24.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.473+0000 7f9102000700 1 Processor -- start 2024-05-10T04:52:24.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.473+0000 7f9102000700 1 -- start start 2024-05-10T04:52:24.478 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.474+0000 7f8f16e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8f100c2d30 0x7f8f100aa7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.473+0000 7efcfe200700 1 -- 172.21.15.47:0/658290733 wait complete. 2024-05-10T04:52:24.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.474+0000 7f2e07a00700 1 -- 172.21.15.47:0/1334788470 wait complete. 2024-05-10T04:52:24.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.475+0000 7f8f16e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100c1cc0 con 0x7f8f101529d0 2024-05-10T04:52:24.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.475+0000 7f8f16e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100c2a50 con 0x7f8f101554f0 2024-05-10T04:52:24.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.475+0000 7f8f16e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100c1670 con 0x7f8f100c2d30 2024-05-10T04:52:24.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.475+0000 7f8f0fe00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f8f100c2d30 0x7f8f100aa7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.475+0000 7f8f0f400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8f101529d0 0x7f8f100c6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43628/0 (socket says 172.21.15.47:43628) 2024-05-10T04:52:24.480 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.475+0000 7f8f0f400700 1 -- 172.21.15.47:0/1200262772 learned_addr learned my addr 172.21.15.47:0/1200262772 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.477+0000 7efcfe200700 1 Processor -- start 2024-05-10T04:52:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.477+0000 7efcfe200700 1 -- start start 2024-05-10T04:52:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.477+0000 7f8f0fe00700 1 -- 172.21.15.47:0/1200262772 >> v1:172.21.15.117:6789/0 conn(0x7f8f101554f0 legacy=0x7f8f10155900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.477+0000 7f8f0fe00700 1 -- 172.21.15.47:0/1200262772 >> v1:172.21.15.47:6789/0 conn(0x7f8f101529d0 legacy=0x7f8f100c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.477+0000 7f8f0fe00700 1 -- 172.21.15.47:0/1200262772 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100c1950 con 0x7f8f100c2d30 2024-05-10T04:52:24.481 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.477+0000 7f8f0fe00700 1 --2- 172.21.15.47:0/1200262772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f100aa7d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009d90 tx=0x7f8f0800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beaec1d80bb8a2de server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.479+0000 7f0a01000700 1 Processor -- start 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.479+0000 7f9102000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 0x7f90f40304f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9102000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90f4035550 0x7f90f40472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9102000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4047830 0x7f90f416d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9102000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4048d30 con 0x7f90f4035550 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9102000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40d0e20 con 0x7f90f40075d0 2024-05-10T04:52:24.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9102000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f41746e0 con 0x7f90f4047830 2024-05-10T04:52:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f8f0ea00700 1 -- 172.21.15.47:0/1200262772 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800e070 con 0x7f8f100c2d30 2024-05-10T04:52:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f8f0ea00700 1 -- 172.21.15.47:0/1200262772 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0800bad0 con 0x7f8f100c2d30 2024-05-10T04:52:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f8f0ea00700 1 -- 172.21.15.47:0/1200262772 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0800be60 con 0x7f8f100c2d30 2024-05-10T04:52:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.478+0000 7f2e07a00700 1 Processor -- start 2024-05-10T04:52:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.479+0000 7f2e07a00700 1 -- start start 2024-05-10T04:52:24.483 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7efcfe200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 0x7efcf8155ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9100c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 0x7f90f40304f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9100c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 0x7f90f40304f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53324/0 (socket says 172.21.15.47:53324) 2024-05-10T04:52:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f9100c00700 1 -- 172.21.15.47:0/2698419401 learned_addr learned my addr 172.21.15.47:0/2698419401 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7efcfe200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf8072620 0x7efcf815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f90fbe00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90f4035550 0x7f90f40472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f9101600700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4047830 0x7f90f416d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 -- 172.21.15.47:0/1200262772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 msgr2=0x7f8f100aa7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7efcfe200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf80c24a0 0x7efcf815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f9100c00700 1 -- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4047830 msgr2=0x7f90f416d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 --2- 172.21.15.47:0/1200262772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f100aa7d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009d90 tx=0x7f8f0800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 -- 172.21.15.47:0/1200262772 shutdown_connections 2024-05-10T04:52:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 --2- 172.21.15.47:0/1200262772 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f100aa7d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 -- 172.21.15.47:0/1200262772 >> 172.21.15.47:0/1200262772 conn(0x7f8f100a86c0 msgr2=0x7f8f100a8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 -- 172.21.15.47:0/1200262772 shutdown_connections 2024-05-10T04:52:24.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f9100c00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4047830 0x7f90f416d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f9100c00700 1 -- 172.21.15.47:0/2698419401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90f4035550 msgr2=0x7f90f40472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7f8f16e00700 1 -- 172.21.15.47:0/1200262772 wait complete. 2024-05-10T04:52:24.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f9100c00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90f4035550 0x7f90f40472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f9100c00700 1 -- 172.21.15.47:0/2698419401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90fc073ad0 con 0x7f90f40075d0 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.480+0000 7f0a01000700 1 -- start start 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f0a01000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f4047ef0 0x7f09f4030d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f0a01000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09f40064f0 0x7f09f40e9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f0a01000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09f4048300 con 0x7f09f40060e0 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f0a01000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09f4007a80 con 0x7f09f40064f0 2024-05-10T04:52:24.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f0a01000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f4007550 con 0x7f09f4047ef0 2024-05-10T04:52:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7f90fbe00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90f4035550 0x7f90f40472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f2e07a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 0x7f2e0015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f2e07a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e000aaee0 0x7f2e001e4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f9100c00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 0x7f90f40304f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90fc079d30 tx=0x7f90fc0739c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f09fb400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f4047ef0 0x7f09f4030d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f09fbe00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09f40064f0 0x7f09f40e9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f09fbe00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f09f40064f0 0x7f09f40e9700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53336/0 (socket says 172.21.15.47:53336) 2024-05-10T04:52:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f09fbe00700 1 -- 172.21.15.47:0/655447200 learned_addr learned my addr 172.21.15.47:0/655447200 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f09faa00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f09f40060e0 0x7f09f403ea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46172/0 (socket says 172.21.15.47:46172) 2024-05-10T04:52:24.490 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f2e05000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 0x7f2e0015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.483+0000 7f2e05000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 0x7f2e0015d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50694/0 (socket says 172.21.15.47:50694) 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f2e07a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e000c1080 0x7f2e000c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f2e07a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0015ac90 con 0x7f2e000aaee0 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f2e07a00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0015b0f0 con 0x7f2e000c1080 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f2e07a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e001e6c10 con 0x7f2e00072f80 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f2e05000700 1 -- 172.21.15.47:0/388608906 learned_addr learned my addr 172.21.15.47:0/388608906 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f09fbe00700 1 -- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f4047ef0 msgr2=0x7f09f4030d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.491 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f09fbe00700 1 --2- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f4047ef0 0x7f09f4030d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc09c5f0 con 0x7f90f40075d0 2024-05-10T04:52:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f09fbe00700 1 -- 172.21.15.47:0/655447200 >> v1:172.21.15.117:6789/0 conn(0x7f09f40060e0 legacy=0x7f09f403ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7efcf7400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 0x7efcf8155ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.481+0000 7efcf7400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 0x7efcf8155ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50686/0 (socket says 172.21.15.47:50686) 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7efcf6a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf8072620 0x7efcf815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.482+0000 7efcf6a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf8072620 0x7efcf815b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53326/0 (socket says 172.21.15.47:53326) 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f09fbe00700 1 -- 172.21.15.47:0/655447200 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09f404b870 con 0x7f09f40064f0 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f09fb400700 1 --2- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f4047ef0 0x7f09f4030d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc098040 con 0x7f90f40075d0 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc09c5f0 con 0x7f90f40075d0 2024-05-10T04:52:24.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.484+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f4048010 con 0x7f90f40075d0 2024-05-10T04:52:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f09fbe00700 1 --2- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40064f0 0x7f09f40e9700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f09fc04fff0 tx=0x7f09fc04f200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b7d58b116a1e98 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2e05000700 1 -- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e000c1080 msgr2=0x7f2e000c04f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-10T04:52:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2e05000700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e000c1080 0x7f2e000c04f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2e05000700 1 -- 172.21.15.47:0/388608906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e000aaee0 msgr2=0x7f2e001e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7efcfe200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf814d2d0 con 0x7efcf80c24a0 2024-05-10T04:52:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7efcfe200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf815c2e0 con 0x7efcf8072620 2024-05-10T04:52:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2dffe00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e000aaee0 0x7f2e001e4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7efcfe200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf80c0c50 con 0x7efcf806df40 2024-05-10T04:52:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f4046e60 con 0x7f90f40075d0 2024-05-10T04:52:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7efcf7400700 1 -- 172.21.15.47:0/1922553953 learned_addr learned my addr 172.21.15.47:0/1922553953 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2e05000700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e000aaee0 0x7f2e001e4f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7efcf7e00700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf80c24a0 0x7efcf815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7efcf7400700 1 -- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf8072620 msgr2=0x7efcf815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7efcf7400700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf8072620 0x7efcf815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7efcf7400700 1 -- 172.21.15.47:0/1922553953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf80c24a0 msgr2=0x7efcf815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7efcf7400700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf80c24a0 0x7efcf815c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7efcf7400700 1 -- 172.21.15.47:0/1922553953 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf0009b30 con 0x7efcf806df40 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2e05000700 1 -- 172.21.15.47:0/388608906 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df8009a70 con 0x7f2e00072f80 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f2dffe00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e000aaee0 0x7f2e001e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7f2e05000700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 0x7f2e0015d720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00b580 tx=0x7f2dec00b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f09fa000700 1 -- 172.21.15.47:0/655447200 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc068630 con 0x7f09f40064f0 2024-05-10T04:52:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f09fa000700 1 -- 172.21.15.47:0/655447200 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc068790 con 0x7f09f40064f0 2024-05-10T04:52:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.485+0000 7f09fa000700 1 -- 172.21.15.47:0/655447200 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc092600 con 0x7f09f40064f0 2024-05-10T04:52:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.486+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011830 con 0x7f2e00072f80 2024-05-10T04:52:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec011990 con 0x7f2e00072f80 2024-05-10T04:52:24.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0014f820 con 0x7f2e00072f80 2024-05-10T04:52:24.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f0a01000700 1 -- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40064f0 msgr2=0x7f09f40e9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f0a01000700 1 --2- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40064f0 0x7f09f40e9700 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f09fc04fff0 tx=0x7f09fc04f200 comp rx=0 tx=0).stop 2024-05-10T04:52:24.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f41741b0 con 0x7f90f40075d0 2024-05-10T04:52:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f0a01000700 1 -- 172.21.15.47:0/655447200 shutdown_connections 2024-05-10T04:52:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f0a01000700 1 --2- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40064f0 0x7f09f40e9700 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e001e3370 con 0x7f2e00072f80 2024-05-10T04:52:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f0a01000700 1 --2- 172.21.15.47:0/655447200 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f4047ef0 0x7f09f4030d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011830 con 0x7f2e00072f80 2024-05-10T04:52:24.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f0a01000700 1 -- 172.21.15.47:0/655447200 >> 172.21.15.47:0/655447200 conn(0x7f09f402d580 msgr2=0x7f09f402d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7f8f16e00700 1 Processor -- start 2024-05-10T04:52:24.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.487+0000 7efcf7400700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 0x7efcf8155ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcf000b730 tx=0x7efcf0004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.488+0000 7f8f16e00700 1 -- start start 2024-05-10T04:52:24.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.488+0000 7f0a01000700 1 -- 172.21.15.47:0/655447200 shutdown_connections 2024-05-10T04:52:24.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.488+0000 7f0a01000700 1 -- 172.21.15.47:0/655447200 wait complete. 2024-05-10T04:52:24.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.489+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0004440 con 0x7efcf806df40 2024-05-10T04:52:24.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.489+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00045a0 con 0x7efcf806df40 2024-05-10T04:52:24.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.489+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf0004950 con 0x7efcf806df40 2024-05-10T04:52:24.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.489+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf80717c0 con 0x7efcf806df40 2024-05-10T04:52:24.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.489+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf81f2a50 con 0x7efcf806df40 2024-05-10T04:52:24.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.490+0000 7f8f16e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f1014e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.491+0000 7f8f16e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f101529d0 0x7f8f101f2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.491+0000 7f8f0fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f1014e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.491+0000 7f8f0fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f1014e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53344/0 (socket says 172.21.15.47:53344) 2024-05-10T04:52:24.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.491+0000 7f8f0fe00700 1 -- 172.21.15.47:0/4294345566 learned_addr learned my addr 172.21.15.47:0/4294345566 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.491+0000 7f0a01000700 1 Processor -- start 2024-05-10T04:52:24.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.491+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf8074720 con 0x7efcf806df40 2024-05-10T04:52:24.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f8f0f400700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f101529d0 0x7f8f101f2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f101554f0 0x7f8f10145b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ddc0052e0 con 0x7f2e00072f80 2024-05-10T04:52:24.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f0a01000700 1 -- start start 2024-05-10T04:52:24.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90fc09c750 con 0x7f90f40075d0 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101f3950 con 0x7f8f101554f0 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f101e3770 con 0x7f8f100c2d30 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.492+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f10146980 con 0x7f8f101529d0 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.493+0000 7f8f0f400700 1 -- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 msgr2=0x7f8f1014e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.493+0000 7f8f0f400700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f1014e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.493+0000 7f8f0f400700 1 -- 172.21.15.47:0/4294345566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f101554f0 msgr2=0x7f8f10145b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-10T04:52:24.507 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.493+0000 7f8f14e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f101554f0 0x7f8f10145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.494+0000 7f90f8c00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90dc06ad20 0x7f90dc06d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.494+0000 7f8f0f400700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f101554f0 0x7f8f10145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.494+0000 7f8f0f400700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f08009a70 con 0x7f8f101529d0 2024-05-10T04:52:24.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.494+0000 7f8f14e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f101554f0 0x7f8f10145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.493+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efcf0019070 con 0x7efcf806df40 2024-05-10T04:52:24.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.494+0000 7efcef400700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efcd806ad60 0x7efcd806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efcf008a7e0 con 0x7efcf806df40 2024-05-10T04:52:24.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f8f0f400700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f101529d0 0x7f8f101f2b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00c480 tx=0x7f8efc00c790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2dec011b00 con 0x7f2e00072f80 2024-05-10T04:52:24.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90fc1056d0 con 0x7f90f40075d0 2024-05-10T04:52:24.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f0a01000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40060e0 0x7f09f40e18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f0a01000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 0x7f09f4044fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7efcf6a00700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efcd806ad60 0x7efcd806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f0a01000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f4047ef0 0x7f09f4180970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f0a01000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40e0100 con 0x7f09f4047ef0 2024-05-10T04:52:24.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f90fbe00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90dc06ad20 0x7f90dc06d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f0a01000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40e23a0 con 0x7f09f40060e0 2024-05-10T04:52:24.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.495+0000 7f0a01000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09f40dc250 con 0x7f09f40064f0 2024-05-10T04:52:24.511 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 0x7f09f4044fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 0x7f09f4044fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50710/0 (socket says 172.21.15.47:50710) 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 -- 172.21.15.47:0/2013017859 learned_addr learned my addr 172.21.15.47:0/2013017859 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09fbe00700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f4047ef0 0x7f09f4180970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09fb400700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40060e0 0x7f09f40e18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 -- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40060e0 msgr2=0x7f09f40e18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f2dfcc00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2de006ad20 0x7f2de006d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.497+0000 7efcf6a00700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efcd806ad60 0x7efcd806d270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efcf8156840 tx=0x7efce8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.497+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2dec0891f0 con 0x7f2e00072f80 2024-05-10T04:52:24.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.497+0000 7f2dffe00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2de006ad20 0x7f2de006d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40060e0 0x7f09f40e18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 -- 172.21.15.47:0/2013017859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f4047ef0 msgr2=0x7f09f4180970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f4047ef0 0x7f09f4180970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.497+0000 7f90fbe00700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90dc06ad20 0x7f90dc06d230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f90f0006fd0 tx=0x7f90f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09faa00700 1 -- 172.21.15.47:0/2013017859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc073ad0 con 0x7f09f40064f0 2024-05-10T04:52:24.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.496+0000 7f09fb400700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40060e0 0x7f09f40e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.497+0000 7f09fbe00700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f4047ef0 0x7f09f4180970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.514 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.497+0000 7f09faa00700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 0x7f09f4044fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c780 tx=0x7f09e800cb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.498+0000 7f2dffe00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2de006ad20 0x7f2de006d230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2df4006fd0 tx=0x7f2df4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.503+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f90fc0d3fc0 con 0x7f90f40075d0 2024-05-10T04:52:24.515 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.504+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efcf00591d0 con 0x7efcf806df40 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc004c80 con 0x7f8f101529d0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8efc004de0 con 0x7f8f101529d0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8efc007310 con 0x7f8f101529d0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f101466d0 con 0x7f8f101529d0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1014ecf0 con 0x7f8f101529d0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8004c80 con 0x7f09f40064f0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09e8004e00 con 0x7f09f40064f0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09e8007310 con 0x7f09f40064f0 2024-05-10T04:52:24.516 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09f40dc7d0 con 0x7f09f40064f0 2024-05-10T04:52:24.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.509+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09f40e0550 con 0x7f09f40064f0 2024-05-10T04:52:24.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.511+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2dec0540d0 con 0x7f2e00072f80 2024-05-10T04:52:24.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.512+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1006e980 con 0x7f8f101529d0 2024-05-10T04:52:24.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.513+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8efc007470 con 0x7f8f101529d0 2024-05-10T04:52:24.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.513+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09f40e0270 con 0x7f09f40064f0 2024-05-10T04:52:24.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.515+0000 7f8f07e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8ef006ad60 0x7f8ef006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.514+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09e8007470 con 0x7f09f40064f0 2024-05-10T04:52:24.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.515+0000 7f09ef400700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f09dc06ad90 0x7f09dc06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.515+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f09e8088b70 con 0x7f09f40064f0 2024-05-10T04:52:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.515+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8efc0891c0 con 0x7f8f101529d0 2024-05-10T04:52:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.516+0000 7f8f0fe00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8ef006ad60 0x7f8ef006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.516+0000 7f09fb400700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f09dc06ad90 0x7f09dc06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.517+0000 7f09fb400700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f09dc06ad90 0x7f09dc06d2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09f0006fd0 tx=0x7f09f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.518+0000 7f8f0fe00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8ef006ad60 0x7f8ef006d270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b370 tx=0x7f8f08010000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.519+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8efc054120 con 0x7f8f101529d0 2024-05-10T04:52:24.521 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.521+0000 7f1372400700 1 Processor -- start 2024-05-10T04:52:24.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.521+0000 7f1372400700 1 -- start start 2024-05-10T04:52:24.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.524+0000 7f1372400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c0c49e0 0x7f136c156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.524+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f09f40e0270 con 0x7f09f40064f0 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.524+0000 7f1372400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f136c06cd90 0x7f136c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.524+0000 7f1372400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c0c1940 con 0x7f136c152b50 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.524+0000 7f1372400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c0c2e20 con 0x7f136c06cd90 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.524+0000 7f1372400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c0c5ae0 con 0x7f136c0c49e0 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.525+0000 7f136aa00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f136c152b50 0x7f136c0c53d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43640/0 (socket says 172.21.15.47:43640) 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.525+0000 7f136aa00700 1 -- 172.21.15.47:0/3514265332 learned_addr learned my addr 172.21.15.47:0/3514265332 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.525+0000 7f136b400700 1 --2- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c0c49e0 0x7f136c156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.525+0000 7f136be00700 1 --2- 172.21.15.47:0/3514265332 >> v2:172.21.15.117:3300/0 conn(0x7f136c06cd90 0x7f136c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.526+0000 7f136be00700 1 -- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c0c49e0 msgr2=0x7f136c156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.526+0000 7f136be00700 1 --2- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c0c49e0 0x7f136c156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.526+0000 7f136be00700 1 -- 172.21.15.47:0/3514265332 >> v1:172.21.15.47:6789/0 conn(0x7f136c152b50 legacy=0x7f136c0c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.526+0000 7f136be00700 1 -- 172.21.15.47:0/3514265332 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0c6cb0 con 0x7f136c06cd90 2024-05-10T04:52:24.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.527+0000 7f136be00700 1 --2- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c06cd90 0x7f136c06d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1364009d90 tx=0x7f136400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99386bed298c23dd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.527+0000 7f136a000700 1 -- 172.21.15.47:0/3514265332 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136400e070 con 0x7f136c06cd90 2024-05-10T04:52:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.527+0000 7f136a000700 1 -- 172.21.15.47:0/3514265332 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136400bb20 con 0x7f136c06cd90 2024-05-10T04:52:24.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.527+0000 7f136a000700 1 -- 172.21.15.47:0/3514265332 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364012430 con 0x7f136c06cd90 2024-05-10T04:52:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 -- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c06cd90 msgr2=0x7f136c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 --2- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c06cd90 0x7f136c06d1a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1364009d90 tx=0x7f136400b330 comp rx=0 tx=0).stop 2024-05-10T04:52:24.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 -- 172.21.15.47:0/3514265332 shutdown_connections 2024-05-10T04:52:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 --2- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c06cd90 0x7f136c06d1a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 --2- 172.21.15.47:0/3514265332 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c0c49e0 0x7f136c156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 -- 172.21.15.47:0/3514265332 >> 172.21.15.47:0/3514265332 conn(0x7f136c0cac30 msgr2=0x7f136c0cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 -- 172.21.15.47:0/3514265332 shutdown_connections 2024-05-10T04:52:24.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.529+0000 7f1372400700 1 -- 172.21.15.47:0/3514265332 wait complete. 2024-05-10T04:52:24.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.532+0000 7f1372400700 1 Processor -- start 2024-05-10T04:52:24.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.532+0000 7f1372400700 1 -- start start 2024-05-10T04:52:24.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.533+0000 7f22ec600700 1 Processor -- start 2024-05-10T04:52:24.536 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.534+0000 7f22ec600700 1 -- start start 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.536+0000 7f22ec600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f22e4072be0 0x7f22e406e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.536+0000 7f1372400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 0x7f136c0c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.536+0000 7f1372400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f136c0c49e0 0x7f136c150520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f1372400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c152b50 0x7f136c0c9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f1372400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14a8d0 con 0x7f136c0c49e0 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f1372400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14c960 con 0x7f136c152b50 2024-05-10T04:52:24.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f1372400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c14c370 con 0x7f136c06cd90 2024-05-10T04:52:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f136b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 0x7f136c0c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f136b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 0x7f136c0c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50720/0 (socket says 172.21.15.47:50720) 2024-05-10T04:52:24.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f136be00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c152b50 0x7f136c0c9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f22ec600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f22e4152340 0x7f22e415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f22e9200700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f22e406ea40 0x7f22e4151c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46174/0 (socket says 172.21.15.47:46174) 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f22e9200700 1 -- 172.21.15.47:0/3648937750 learned_addr learned my addr 172.21.15.47:0/3648937750 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e4073270 con 0x7f22e406ea40 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e40abc70 con 0x7f22e4072be0 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e4072ff0 con 0x7f22e4152340 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.537+0000 7f136be00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c152b50 0x7f136c0c9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:53380/0 (socket says 172.21.15.47:53380) 2024-05-10T04:52:24.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136b400700 1 -- 172.21.15.47:0/376793535 learned_addr learned my addr 172.21.15.47:0/376793535 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e9c00700 1 --2- 172.21.15.47:0/3648937750 >> v2:172.21.15.47:3300/0 conn(0x7f22e4072be0 0x7f22e406e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091791752 0 0) 0x7f22e4073270 con 0x7f22e406ea40 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22cc003590 con 0x7f22e406ea40 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22ea600700 1 --2- 172.21.15.47:0/3648937750 >> v2:172.21.15.117:3300/0 conn(0x7f22e4152340 0x7f22e415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 <== mon.1 v1:172.21.15.117:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1955284448 0 0) 0x7f22cc003590 con 0x7f22e406ea40 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 >> v2:172.21.15.117:3300/0 conn(0x7f22e4152340 msgr2=0x7f22e415bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 --2- 172.21.15.47:0/3648937750 >> v2:172.21.15.117:3300/0 conn(0x7f22e4152340 0x7f22e415bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 >> v2:172.21.15.47:3300/0 conn(0x7f22e4072be0 msgr2=0x7f22e406e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136aa00700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f136c0c49e0 0x7f136c150520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136b400700 1 -- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c152b50 msgr2=0x7f136c0c9bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136b400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c152b50 0x7f136c0c9bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136b400700 1 -- 172.21.15.47:0/376793535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f136c0c49e0 msgr2=0x7f136c150520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136b400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f136c0c49e0 0x7f136c150520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136b400700 1 -- 172.21.15.47:0/376793535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1364009a70 con 0x7f136c06cd90 2024-05-10T04:52:24.541 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f136aa00700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f136c0c49e0 0x7f136c150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 --2- 172.21.15.47:0/3648937750 >> v2:172.21.15.47:3300/0 conn(0x7f22e4072be0 0x7f22e406e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 --> v1:172.21.15.117:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40c1190 con 0x7f22e406ea40 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 <== mon.1 v1:172.21.15.117:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f22d0001650 con 0x7f22e406ea40 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.538+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 >> v1:172.21.15.117:6789/0 conn(0x7f22e406ea40 legacy=0x7f22e4151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e3e00700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc003d60 0x7f22cc004170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e3e00700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22cc004700 0x7f22cc00b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e3e00700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22cc00b6e0 0x7f22cc00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e40abc70 con 0x7f22cc004700 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4072ff0 con 0x7f22cc003d60 2024-05-10T04:52:24.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc004f20 con 0x7f22cc00b6e0 2024-05-10T04:52:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f136b400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 0x7f136c0c8ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f135c00e840 tx=0x7f135c00eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c009590 con 0x7f136c06cd90 2024-05-10T04:52:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c013680 con 0x7f136c06cd90 2024-05-10T04:52:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c013a10 con 0x7f136c06cd90 2024-05-10T04:52:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.539+0000 7f22e9c00700 1 --2- 172.21.15.47:0/3648937750 >> v2:172.21.15.47:3300/0 conn(0x7f22e4072be0 0x7f22e406e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.543 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.540+0000 7f22e9200700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22cc004700 0x7f22cc00b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c1ec0c0 con 0x7f136c06cd90 2024-05-10T04:52:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f22e9200700 1 -- 172.21.15.47:0/3648937750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22cc00b6e0 msgr2=0x7f22cc00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f22e9200700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22cc00b6e0 0x7f22cc00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f22e9200700 1 -- 172.21.15.47:0/3648937750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc003d60 msgr2=0x7f22cc004170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-10T04:52:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f22e9200700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc003d60 0x7f22cc004170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f22e9200700 1 -- 172.21.15.47:0/3648937750 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc003590 con 0x7f22cc004700 2024-05-10T04:52:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c14c5f0 con 0x7f136c06cd90 2024-05-10T04:52:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.541+0000 7f22e9200700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22cc004700 0x7f22cc00b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22e40a9770 tx=0x7f22cc004de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce29d5ab00927b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.543+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c074720 con 0x7f136c06cd90 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.542+0000 7f22ea600700 1 -- 172.21.15.47:0/3648937750 reap_dead start 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.542+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0004930 con 0x7f22cc004700 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.542+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0004a90 con 0x7f22cc004700 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.542+0000 7f22e3e00700 1 -- 172.21.15.47:0/3648937750 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0004e60 con 0x7f22cc004700 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.543+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22cc004700 msgr2=0x7f22cc00b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.543+0000 7f22ec600700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22cc004700 0x7f22cc00b0a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f22e40a9770 tx=0x7f22cc004de0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.543+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 shutdown_connections 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.544+0000 7f22ec600700 1 --2- 172.21.15.47:0/3648937750 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22cc004700 0x7f22cc00b0a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.546 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.544+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 >> 172.21.15.47:0/3648937750 conn(0x7f22e40a8ae0 msgr2=0x7f22e40a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.544+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f135c013b70 con 0x7f136c06cd90 2024-05-10T04:52:24.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.545+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 shutdown_connections 2024-05-10T04:52:24.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.545+0000 7f22ec600700 1 -- 172.21.15.47:0/3648937750 wait complete. 2024-05-10T04:52:24.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.546+0000 7f1363400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f134c06acc0 0x7f134c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.548+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f135c058740 con 0x7f136c06cd90 2024-05-10T04:52:24.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.548+0000 7f136aa00700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f134c06acc0 0x7f134c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.548+0000 7f22ec600700 1 Processor -- start 2024-05-10T04:52:24.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.549+0000 7f22ec600700 1 -- start start 2024-05-10T04:52:24.550 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.550+0000 7f136aa00700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f134c06acc0 0x7f134c06d1d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f136c0cb390 tx=0x7f1358009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.551+0000 7f22ec600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc004700 0x7f22e40bc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.551+0000 7f22ec600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e40bf930 0x7f22e41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.551+0000 7f22ec600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 0x7f22e4141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.551+0000 7f22ec600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4155400 con 0x7f22e40bfd40 2024-05-10T04:52:24.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.551+0000 7f22ec600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e414c860 con 0x7f22cc004700 2024-05-10T04:52:24.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.551+0000 7f22ec600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e41e7180 con 0x7f22e40bf930 2024-05-10T04:52:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 0x7f22e4141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 0x7f22e4141c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36962/0 (socket says 172.21.15.47:36962) 2024-05-10T04:52:24.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 -- 172.21.15.47:0/362247100 learned_addr learned my addr 172.21.15.47:0/362247100 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22e9200700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e40bf930 0x7f22e41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22e9c00700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc004700 0x7f22e40bc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 -- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e40bf930 msgr2=0x7f22e41546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e40bf930 0x7f22e41546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 -- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc004700 msgr2=0x7f22e40bc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc004700 0x7f22e40bc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.552+0000 7f22ea600700 1 -- 172.21.15.47:0/362247100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e41e7440 con 0x7f22e40bfd40 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.553+0000 7f22e9200700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e40bf930 0x7f22e41546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:24.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.553+0000 7f22e9c00700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc004700 0x7f22e40bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:24.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.554+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f135c054b10 con 0x7f136c06cd90 2024-05-10T04:52:24.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.554+0000 7f22ea600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 0x7f22e4141c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22e4151600 tx=0x7f22dc00e780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.555+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc00c070 con 0x7f22e40bfd40 2024-05-10T04:52:24.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.555+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc013410 con 0x7f22e40bfd40 2024-05-10T04:52:24.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.555+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0137c0 con 0x7f22e40bfd40 2024-05-10T04:52:24.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.555+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e4153c00 con 0x7f22e40bfd40 2024-05-10T04:52:24.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.555+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e41541c0 con 0x7f22e40bfd40 2024-05-10T04:52:24.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.557+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e4154350 con 0x7f22e40bfd40 2024-05-10T04:52:24.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.559+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f22dc013920 con 0x7f22e40bfd40 2024-05-10T04:52:24.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.560+0000 7f22e1600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f22c406ac90 0x7f22c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.562+0000 7f22e9c00700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f22c406ac90 0x7f22c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:24.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.563+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f22dc057760 con 0x7f22e40bfd40 2024-05-10T04:52:24.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.563+0000 7f22e9c00700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f22c406ac90 0x7f22c406d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22d80094c0 tx=0x7f22d800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:24.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.570+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f22dc0533a0 con 0x7f22e40bfd40 2024-05-10T04:52:24.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.891+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0f4005590 con 0x7fb118047dc0 2024-05-10T04:52:24.893 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.892+0000 7fb116a00700 1 -- 172.21.15.47:0/1335608829 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb10c057830 con 0x7fb118047dc0 2024-05-10T04:52:24.896 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:24.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.899+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fb10006acf0 msgr2=0x7fb10006d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.899+0000 7fb10be00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fb10006acf0 0x7fb10006d200 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb10400be70 tx=0x7fb12006e000 comp rx=0 tx=0).stop 2024-05-10T04:52:24.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.899+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 msgr2=0x7fb11804d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.899+0000 7fb10be00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 0x7fb11804d5e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb10c001d90 tx=0x7fb10c007340 comp rx=0 tx=0).stop 2024-05-10T04:52:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.900+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 shutdown_connections 2024-05-10T04:52:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.900+0000 7fb10be00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb118038a00 0x7fb1180d7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.900+0000 7fb10be00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fb10006acf0 0x7fb10006d200 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.900+0000 7fb10be00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb11804f590 0x7fb118048c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.900+0000 7fb10be00700 1 --2- 172.21.15.47:0/1335608829 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb118047dc0 0x7fb11804d5e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.900+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 >> 172.21.15.47:0/1335608829 conn(0x7fb118035fe0 msgr2=0x7fb1180de740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.901+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 shutdown_connections 2024-05-10T04:52:24.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.901+0000 7fb10be00700 1 -- 172.21.15.47:0/1335608829 wait complete. 2024-05-10T04:52:24.948 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.0 2024-05-10T04:52:24.948 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:24.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.962+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f90f4005590 con 0x7f90f40075d0 2024-05-10T04:52:24.963 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.963+0000 7f90f8c00700 1 -- 172.21.15.47:0/2698419401 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f90fc0d3b50 con 0x7f90f40075d0 2024-05-10T04:52:24.963 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:24.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.965+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90dc06ad20 msgr2=0x7f90dc06d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.965+0000 7f9102000700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90dc06ad20 0x7f90dc06d230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f90f0006fd0 tx=0x7f90f0008040 comp rx=0 tx=0).stop 2024-05-10T04:52:24.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.965+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 msgr2=0x7f90f40304f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.965+0000 7f9102000700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 0x7f90f40304f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f90fc079d30 tx=0x7f90fc0739c0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 shutdown_connections 2024-05-10T04:52:24.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90dc06ad20 0x7f90dc06d230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90f4047830 0x7f90f416d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90f40075d0 0x7f90f40304f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 --2- 172.21.15.47:0/2698419401 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90f4035550 0x7f90f40472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 >> 172.21.15.47:0/2698419401 conn(0x7f90f404c850 msgr2=0x7f90f40d8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 shutdown_connections 2024-05-10T04:52:24.968 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.966+0000 7f9102000700 1 -- 172.21.15.47:0/2698419401 wait complete. 2024-05-10T04:52:24.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.982+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7efcf80c3d70 con 0x7efcf806df40 2024-05-10T04:52:24.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.983+0000 7efcef400700 1 -- 172.21.15.47:0/1922553953 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efcf0058d60 con 0x7efcf806df40 2024-05-10T04:52:24.983 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:24.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efcd806ad60 msgr2=0x7efcd806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efcd806ad60 0x7efcd806d270 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efcf8156840 tx=0x7efce8008040 comp rx=0 tx=0).stop 2024-05-10T04:52:24.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 msgr2=0x7efcf8155ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:24.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 0x7efcf8155ff0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcf000b730 tx=0x7efcf0004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 shutdown_connections 2024-05-10T04:52:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efcf80c24a0 0x7efcf815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efcd806ad60 0x7efcd806d270 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7efcf8156840 tx=0x7efce8008040 comp rx=0 tx=0).stop 2024-05-10T04:52:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efcf806df40 0x7efcf8155ff0 secure :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcf000b730 tx=0x7efcf0004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 --2- 172.21.15.47:0/1922553953 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efcf8072620 0x7efcf815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:24.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 >> 172.21.15.47:0/1922553953 conn(0x7efcf80a86c0 msgr2=0x7efcf8150960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:24.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.987+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 shutdown_connections 2024-05-10T04:52:24.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:24.988+0000 7efcfe200700 1 -- 172.21.15.47:0/1922553953 wait complete. 2024-05-10T04:52:24.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2024-05-10T04:52:24.997 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.003+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f1006b850 con 0x7f8f101529d0 2024-05-10T04:52:25.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.004+0000 7f8f07e00700 1 -- 172.21.15.47:0/4294345566 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8efc007720 con 0x7f8f101529d0 2024-05-10T04:52:25.005 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:25.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09f4048300 con 0x7f09f40064f0 2024-05-10T04:52:25.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8ef006ad60 msgr2=0x7f8ef006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8ef006ad60 0x7f8ef006d270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800b370 tx=0x7f8f08010000 comp rx=0 tx=0).stop 2024-05-10T04:52:25.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f101529d0 msgr2=0x7f8f101f2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f101529d0 0x7f8f101f2b60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8efc00c480 tx=0x7f8efc00c790 comp rx=0 tx=0).stop 2024-05-10T04:52:25.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 shutdown_connections 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8f101554f0 0x7f8f10145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8f100c2d30 0x7f8f1014e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8ef006ad60 0x7f8ef006d270 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 --2- 172.21.15.47:0/4294345566 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8f101529d0 0x7f8f101f2b60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 >> 172.21.15.47:0/4294345566 conn(0x7f8f100a86c0 msgr2=0x7f8f1014aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 shutdown_connections 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f09ef400700 1 -- 172.21.15.47:0/2013017859 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09f4048300 con 0x7f09f40064f0 2024-05-10T04:52:25.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.008+0000 7f8f16e00700 1 -- 172.21.15.47:0/4294345566 wait complete. 2024-05-10T04:52:25.011 INFO:teuthology.orchestra.run.smithi047.stdout:55834574859 2024-05-10T04:52:25.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.012+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f09dc06ad90 msgr2=0x7f09dc06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.012+0000 7f0a01000700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f09dc06ad90 0x7f09dc06d2a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f09f0006fd0 tx=0x7f09f0008040 comp rx=0 tx=0).stop 2024-05-10T04:52:25.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.012+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 msgr2=0x7f09f4044fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.012+0000 7f0a01000700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 0x7f09f4044fd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f09e800c780 tx=0x7f09e800cb40 comp rx=0 tx=0).stop 2024-05-10T04:52:25.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 shutdown_connections 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f09f4047ef0 0x7f09f4180970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f09f40060e0 0x7f09f40e18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f09dc06ad90 0x7f09dc06d2a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 --2- 172.21.15.47:0/2013017859 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f09f40064f0 0x7f09f4044fd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 >> 172.21.15.47:0/2013017859 conn(0x7f09f402d580 msgr2=0x7f09f40dd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 shutdown_connections 2024-05-10T04:52:25.014 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.013+0000 7f0a01000700 1 -- 172.21.15.47:0/2013017859 wait complete. 2024-05-10T04:52:25.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-05-10T04:52:25.017 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.019+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2ddc005590 con 0x7f2e00072f80 2024-05-10T04:52:25.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.020+0000 7f2dfcc00700 1 -- 172.21.15.47:0/388608906 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dec011db0 con 0x7f2e00072f80 2024-05-10T04:52:25.021 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2de006ad20 msgr2=0x7f2de006d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2de006ad20 0x7f2de006d230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2df4006fd0 tx=0x7f2df4008040 comp rx=0 tx=0).stop 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 msgr2=0x7f2e0015d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 0x7f2e0015d720 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00b580 tx=0x7f2dec00b940 comp rx=0 tx=0).stop 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 shutdown_connections 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2e000c1080 0x7f2e000c04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2de006ad20 0x7f2de006d230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2e00072f80 0x7f2e0015d720 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 --2- 172.21.15.47:0/388608906 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2e000aaee0 0x7f2e001e4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.024 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 >> 172.21.15.47:0/388608906 conn(0x7f2e000a8ae0 msgr2=0x7f2e000723c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 shutdown_connections 2024-05-10T04:52:25.025 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.023+0000 7f2e07a00700 1 -- 172.21.15.47:0/388608906 wait complete. 2024-05-10T04:52:25.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.028+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f136c0b07c0 con 0x7f136c06cd90 2024-05-10T04:52:25.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.028+0000 7f1363400700 1 -- 172.21.15.47:0/376793535 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f135c017030 con 0x7f136c06cd90 2024-05-10T04:52:25.030 INFO:teuthology.orchestra.run.smithi047.stdout:60129542153 2024-05-10T04:52:25.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f134c06acc0 msgr2=0x7f134c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f134c06acc0 0x7f134c06d1d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f136c0cb390 tx=0x7f1358009040 comp rx=0 tx=0).stop 2024-05-10T04:52:25.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 msgr2=0x7f136c0c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 0x7f136c0c8ea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f135c00e840 tx=0x7f135c00eb50 comp rx=0 tx=0).stop 2024-05-10T04:52:25.032 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 shutdown_connections 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f136c152b50 0x7f136c0c9bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f134c06acc0 0x7f134c06d1d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f136c06cd90 0x7f136c0c8ea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 --2- 172.21.15.47:0/376793535 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f136c0c49e0 0x7f136c150520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 >> 172.21.15.47:0/376793535 conn(0x7f136c0cac30 msgr2=0x7f136c0c0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 shutdown_connections 2024-05-10T04:52:25.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.031+0000 7f1372400700 1 -- 172.21.15.47:0/376793535 wait complete. 2024-05-10T04:52:25.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.053+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f22e414c6b0 con 0x7f22e40bfd40 2024-05-10T04:52:25.054 INFO:teuthology.orchestra.run.smithi047.stdout:60129542154 2024-05-10T04:52:25.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.053+0000 7f22e1600700 1 -- 172.21.15.47:0/362247100 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f22dc0569c0 con 0x7f22e40bfd40 2024-05-10T04:52:25.059 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2024-05-10T04:52:25.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f22c406ac90 msgr2=0x7f22c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f22c406ac90 0x7f22c406d1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f22d80094c0 tx=0x7f22d800b040 comp rx=0 tx=0).stop 2024-05-10T04:52:25.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 msgr2=0x7f22e4141c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 0x7f22e4141c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f22e4151600 tx=0x7f22dc00e780 comp rx=0 tx=0).stop 2024-05-10T04:52:25.060 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.060 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-05-10T04:52:25.061 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 shutdown_connections 2024-05-10T04:52:25.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f22e40bfd40 0x7f22e4141c50 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f22cc004700 0x7f22e40bc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f22c406ac90 0x7f22c406d1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 --2- 172.21.15.47:0/362247100 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f22e40bf930 0x7f22e41546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 >> 172.21.15.47:0/362247100 conn(0x7f22e40a8ae0 msgr2=0x7f22e414e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 shutdown_connections 2024-05-10T04:52:25.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.057+0000 7f22ec600700 1 -- 172.21.15.47:0/362247100 wait complete. 2024-05-10T04:52:25.062 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2024-05-10T04:52:25.063 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.4 2024-05-10T04:52:25.064 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.084 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-05-10T04:52:25.085 DEBUG:teuthology.parallel:result is None 2024-05-10T04:52:25.085 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T04:52:25.085 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:25.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.392+0000 7fd40a400700 1 Processor -- start 2024-05-10T04:52:25.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.392+0000 7fd40a400700 1 -- start start 2024-05-10T04:52:25.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd40a400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4040c5a00 0x7fd4041529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd40a400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4041588d0 0x7fd404158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd40a400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd40406cbd0 con 0x7fd404155360 2024-05-10T04:52:25.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd40a400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd404159660 con 0x7fd4041588d0 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd40a400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40406ce20 con 0x7fd4040c5a00 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd403e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd4041588d0 0x7fd404158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd409a00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fd404155360 0x7fd404155770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43650/0 (socket says 172.21.15.47:43650) 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.394+0000 7fd409a00700 1 -- 172.21.15.47:0/3215630489 learned_addr learned my addr 172.21.15.47:0/3215630489 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd409000700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4040c5a00 0x7fd4041529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403e00700 1 -- 172.21.15.47:0/3215630489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4040c5a00 msgr2=0x7fd4041529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403e00700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4040c5a00 0x7fd4041529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403e00700 1 -- 172.21.15.47:0/3215630489 >> v1:172.21.15.47:6789/0 conn(0x7fd404155360 legacy=0x7fd404155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403e00700 1 -- 172.21.15.47:0/3215630489 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd40406d100 con 0x7fd4041588d0 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd409000700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4040c5a00 0x7fd4041529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:25.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403e00700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4041588d0 0x7fd404158ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009840 tx=0x7fd3f0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9c04c98f8dd5fa server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403400700 1 -- 172.21.15.47:0/3215630489 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011830 con 0x7fd4041588d0 2024-05-10T04:52:25.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403400700 1 -- 172.21.15.47:0/3215630489 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f0011990 con 0x7fd4041588d0 2024-05-10T04:52:25.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.395+0000 7fd403400700 1 -- 172.21.15.47:0/3215630489 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0011d20 con 0x7fd4041588d0 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 -- 172.21.15.47:0/3215630489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4041588d0 msgr2=0x7fd404158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4041588d0 0x7fd404158ce0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0009840 tx=0x7fd3f0009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 -- 172.21.15.47:0/3215630489 shutdown_connections 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4040c5a00 0x7fd4041529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 --2- 172.21.15.47:0/3215630489 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd4041588d0 0x7fd404158ce0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 -- 172.21.15.47:0/3215630489 >> 172.21.15.47:0/3215630489 conn(0x7fd4040ca700 msgr2=0x7fd4040cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 -- 172.21.15.47:0/3215630489 shutdown_connections 2024-05-10T04:52:25.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.396+0000 7fd40a400700 1 -- 172.21.15.47:0/3215630489 wait complete. 2024-05-10T04:52:25.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.398+0000 7fd40a400700 1 Processor -- start 2024-05-10T04:52:25.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.399+0000 7fd40a400700 1 -- start start 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd40a400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4040c5a00 0x7fd404157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd40a400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 0x7fd4040ad970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd40a400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4041588d0 0x7fd4040adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd40a400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40414ec30 con 0x7fd404155360 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd40a400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040ae440 con 0x7fd4040c5a00 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd40a400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd40414bb70 con 0x7fd4041588d0 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd403e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 0x7fd4040ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd403e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 0x7fd4040ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:36988/0 (socket says 172.21.15.47:36988) 2024-05-10T04:52:25.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd403e00700 1 -- 172.21.15.47:0/3460309327 learned_addr learned my addr 172.21.15.47:0/3460309327 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd409000700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4040c5a00 0x7fd404157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.400+0000 7fd409a00700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4041588d0 0x7fd4040adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd403e00700 1 -- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4041588d0 msgr2=0x7fd4040adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd403e00700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4041588d0 0x7fd4040adeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd403e00700 1 -- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4040c5a00 msgr2=0x7fd404157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd403e00700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4040c5a00 0x7fd404157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd403e00700 1 -- 172.21.15.47:0/3460309327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f00094a0 con 0x7fd404155360 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd409000700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4040c5a00 0x7fd404157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd403e00700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 0x7fd4040ad970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0014040 tx=0x7fd3f0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f00045f0 con 0x7fd404155360 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f001f070 con 0x7fd404155360 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0003b00 con 0x7fd404155360 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4041eba00 con 0x7fd404155360 2024-05-10T04:52:25.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.401+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40414f8f0 con 0x7fd404155360 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.402+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4041ebb90 con 0x7fd404155360 2024-05-10T04:52:25.404 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.404+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3f0003c60 con 0x7fd404155360 2024-05-10T04:52:25.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.404+0000 7fd400c00700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd3e406ac90 0x7fd3e406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.405+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3f0021070 con 0x7fd404155360 2024-05-10T04:52:25.405 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.405+0000 7fd409000700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd3e406ac90 0x7fd3e406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.406 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.406+0000 7fd409000700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd3e406ac90 0x7fd3e406d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800aa20 tx=0x7fd3f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.410 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.410+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd3f0056010 con 0x7fd404155360 2024-05-10T04:52:25.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.621+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd4040c8600 con 0x7fd3e406ac90 2024-05-10T04:52:25.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.632+0000 7fd400c00700 1 -- 172.21.15.47:0/3460309327 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7fd3f800a6f0 con 0x7fd3e406ac90 2024-05-10T04:52:25.637 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd3e406ac90 msgr2=0x7fd3e406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd3e406ac90 0x7fd3e406d1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd3f800aa20 tx=0x7fd3f8008040 comp rx=0 tx=0).stop 2024-05-10T04:52:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 msgr2=0x7fd4040ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 0x7fd4040ad970 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0014040 tx=0x7fd3f0004750 comp rx=0 tx=0).stop 2024-05-10T04:52:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 shutdown_connections 2024-05-10T04:52:25.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd3e406ac90 0x7fd3e406d1a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd4041588d0 0x7fd4040adeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd4040c5a00 0x7fd404157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 --2- 172.21.15.47:0/3460309327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd404155360 0x7fd4040ad970 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 >> 172.21.15.47:0/3460309327 conn(0x7fd4040ca700 msgr2=0x7fd4041531d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 shutdown_connections 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.637+0000 7fd40a400700 1 -- 172.21.15.47:0/3460309327 wait complete. 2024-05-10T04:52:25.641 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T04:52:25.666 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-10T04:52:25.162037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235916,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738804,"statfs":{"total":773094113280,"available":772852535296,"internally_reserved":0,"allocated":3448832,"data_stored":2051764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003791"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219600+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T04:51:57.219600+0000","last_peered":"2024-05-10T04:51:57.219600+0000","last_clean":"2024-05-10T04:51:57.219600+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T04:51:57.219600+0000","last_undegraded":"2024-05-10T04:51:57.219600+0000","last_fullsized":"2024-05-10T04:51:57.219600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174451+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T04:51:57.174451+0000","last_peered":"2024-05-10T04:51:57.174451+0000","last_clean":"2024-05-10T04:51:57.174451+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T04:51:57.174451+0000","last_undegraded":"2024-05-10T04:51:57.174451+0000","last_fullsized":"2024-05-10T04:51:57.174451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142131+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T04:51:57.142131+0000","last_peered":"2024-05-10T04:51:57.142131+0000","last_clean":"2024-05-10T04:51:57.142131+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T04:51:57.142131+0000","last_undegraded":"2024-05-10T04:51:57.142131+0000","last_fullsized":"2024-05-10T04:51:57.142131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159614+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T04:51:57.159614+0000","last_peered":"2024-05-10T04:51:57.159614+0000","last_clean":"2024-05-10T04:51:57.159614+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T04:51:57.159614+0000","last_undegraded":"2024-05-10T04:51:57.159614+0000","last_fullsized":"2024-05-10T04:51:57.159614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215270+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T04:51:57.215270+0000","last_peered":"2024-05-10T04:51:57.215270+0000","last_clean":"2024-05-10T04:51:57.215270+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T04:51:57.215270+0000","last_undegraded":"2024-05-10T04:51:57.215270+0000","last_fullsized":"2024-05-10T04:51:57.215270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158970+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T04:51:57.158970+0000","last_peered":"2024-05-10T04:51:57.158970+0000","last_clean":"2024-05-10T04:51:57.158970+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T04:51:57.158970+0000","last_undegraded":"2024-05-10T04:51:57.158970+0000","last_fullsized":"2024-05-10T04:51:57.158970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219056+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T04:51:57.219056+0000","last_peered":"2024-05-10T04:51:57.219056+0000","last_clean":"2024-05-10T04:51:57.219056+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T04:51:57.219056+0000","last_undegraded":"2024-05-10T04:51:57.219056+0000","last_fullsized":"2024-05-10T04:51:57.219056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165516+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T04:51:57.165516+0000","last_peered":"2024-05-10T04:51:57.165516+0000","last_clean":"2024-05-10T04:51:57.165516+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T04:51:57.165516+0000","last_undegraded":"2024-05-10T04:51:57.165516+0000","last_fullsized":"2024-05-10T04:51:57.165516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219499+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T04:51:57.219499+0000","last_peered":"2024-05-10T04:51:57.219499+0000","last_clean":"2024-05-10T04:51:57.219499+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T04:51:57.219499+0000","last_undegraded":"2024-05-10T04:51:57.219499+0000","last_fullsized":"2024-05-10T04:51:57.219499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148505+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T04:51:57.148505+0000","last_peered":"2024-05-10T04:51:57.148505+0000","last_clean":"2024-05-10T04:51:57.148505+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T04:51:57.148505+0000","last_undegraded":"2024-05-10T04:51:57.148505+0000","last_fullsized":"2024-05-10T04:51:57.148505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.147947+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T04:51:57.147947+0000","last_peered":"2024-05-10T04:51:57.147947+0000","last_clean":"2024-05-10T04:51:57.147947+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T04:51:57.147947+0000","last_undegraded":"2024-05-10T04:51:57.147947+0000","last_fullsized":"2024-05-10T04:51:57.147947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145857+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T04:51:57.145857+0000","last_peered":"2024-05-10T04:51:57.145857+0000","last_clean":"2024-05-10T04:51:57.145857+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T04:51:57.145857+0000","last_undegraded":"2024-05-10T04:51:57.145857+0000","last_fullsized":"2024-05-10T04:51:57.145857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169259+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T04:51:57.169259+0000","last_peered":"2024-05-10T04:51:57.169259+0000","last_clean":"2024-05-10T04:51:57.169259+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T04:51:57.169259+0000","last_undegraded":"2024-05-10T04:51:57.169259+0000","last_fullsized":"2024-05-10T04:51:57.169259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141852+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T04:51:57.141852+0000","last_peered":"2024-05-10T04:51:57.141852+0000","last_clean":"2024-05-10T04:51:57.141852+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T04:51:57.141852+0000","last_undegraded":"2024-05-10T04:51:57.141852+0000","last_fullsized":"2024-05-10T04:51:57.141852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173288+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T04:51:57.173288+0000","last_peered":"2024-05-10T04:51:57.173288+0000","last_clean":"2024-05-10T04:51:57.173288+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T04:51:57.173288+0000","last_undegraded":"2024-05-10T04:51:57.173288+0000","last_fullsized":"2024-05-10T04:51:57.173288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158567+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T04:51:57.158567+0000","last_peered":"2024-05-10T04:51:57.158567+0000","last_clean":"2024-05-10T04:51:57.158567+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T04:51:57.158567+0000","last_undegraded":"2024-05-10T04:51:57.158567+0000","last_fullsized":"2024-05-10T04:51:57.158567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160353+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T04:51:57.160353+0000","last_peered":"2024-05-10T04:51:57.160353+0000","last_clean":"2024-05-10T04:51:57.160353+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T04:51:57.160353+0000","last_undegraded":"2024-05-10T04:51:57.160353+0000","last_fullsized":"2024-05-10T04:51:57.160353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138643+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T04:51:57.138643+0000","last_peered":"2024-05-10T04:51:57.138643+0000","last_clean":"2024-05-10T04:51:57.138643+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T04:51:57.138643+0000","last_undegraded":"2024-05-10T04:51:57.138643+0000","last_fullsized":"2024-05-10T04:51:57.138643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.220600+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T04:51:57.220600+0000","last_peered":"2024-05-10T04:51:57.220600+0000","last_clean":"2024-05-10T04:51:57.220600+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T04:51:57.220600+0000","last_undegraded":"2024-05-10T04:51:57.220600+0000","last_fullsized":"2024-05-10T04:51:57.220600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138962+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T04:51:58.138962+0000","last_peered":"2024-05-10T04:51:58.138962+0000","last_clean":"2024-05-10T04:51:58.138962+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T04:51:58.138962+0000","last_undegraded":"2024-05-10T04:51:58.138962+0000","last_fullsized":"2024-05-10T04:51:58.138962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142910+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T04:51:57.142910+0000","last_peered":"2024-05-10T04:51:57.142910+0000","last_clean":"2024-05-10T04:51:57.142910+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T04:51:57.142910+0000","last_undegraded":"2024-05-10T04:51:57.142910+0000","last_fullsized":"2024-05-10T04:51:57.142910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171479+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T04:51:57.171479+0000","last_peered":"2024-05-10T04:51:57.171479+0000","last_clean":"2024-05-10T04:51:57.171479+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T04:51:57.171479+0000","last_undegraded":"2024-05-10T04:51:57.171479+0000","last_fullsized":"2024-05-10T04:51:57.171479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773136+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T04:51:57.773136+0000","last_peered":"2024-05-10T04:51:57.773136+0000","last_clean":"2024-05-10T04:51:57.773136+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T04:51:57.773136+0000","last_undegraded":"2024-05-10T04:51:57.773136+0000","last_fullsized":"2024-05-10T04:51:57.773136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171605+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T04:51:57.171605+0000","last_peered":"2024-05-10T04:51:57.171605+0000","last_clean":"2024-05-10T04:51:57.171605+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T04:51:57.171605+0000","last_undegraded":"2024-05-10T04:51:57.171605+0000","last_fullsized":"2024-05-10T04:51:57.171605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142772+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T04:51:57.142772+0000","last_peered":"2024-05-10T04:51:57.142772+0000","last_clean":"2024-05-10T04:51:57.142772+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T04:51:57.142772+0000","last_undegraded":"2024-05-10T04:51:57.142772+0000","last_fullsized":"2024-05-10T04:51:57.142772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773231+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T04:51:57.773231+0000","last_peered":"2024-05-10T04:51:57.773231+0000","last_clean":"2024-05-10T04:51:57.773231+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T04:51:57.773231+0000","last_undegraded":"2024-05-10T04:51:57.773231+0000","last_fullsized":"2024-05-10T04:51:57.773231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218564+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T04:51:57.218564+0000","last_peered":"2024-05-10T04:51:57.218564+0000","last_clean":"2024-05-10T04:51:57.218564+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T04:51:57.218564+0000","last_undegraded":"2024-05-10T04:51:57.218564+0000","last_fullsized":"2024-05-10T04:51:57.218564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159502+0000","last_change":"2024-05-10T04:51:52.757879+0000","last_active":"2024-05-10T04:51:57.159502+0000","last_peered":"2024-05-10T04:51:57.159502+0000","last_clean":"2024-05-10T04:51:57.159502+0000","last_became_active":"2024-05-10T04:51:52.757556+0000","last_became_peered":"2024-05-10T04:51:52.757556+0000","last_unstale":"2024-05-10T04:51:57.159502+0000","last_undegraded":"2024-05-10T04:51:57.159502+0000","last_fullsized":"2024-05-10T04:51:57.159502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:29.588613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.774138+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T04:51:57.774138+0000","last_peered":"2024-05-10T04:51:57.774138+0000","last_clean":"2024-05-10T04:51:57.774138+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T04:51:57.774138+0000","last_undegraded":"2024-05-10T04:51:57.774138+0000","last_fullsized":"2024-05-10T04:51:57.774138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217441+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T04:51:57.217441+0000","last_peered":"2024-05-10T04:51:57.217441+0000","last_clean":"2024-05-10T04:51:57.217441+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T04:51:57.217441+0000","last_undegraded":"2024-05-10T04:51:57.217441+0000","last_fullsized":"2024-05-10T04:51:57.217441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159784+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T04:51:57.159784+0000","last_peered":"2024-05-10T04:51:57.159784+0000","last_clean":"2024-05-10T04:51:57.159784+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T04:51:57.159784+0000","last_undegraded":"2024-05-10T04:51:57.159784+0000","last_fullsized":"2024-05-10T04:51:57.159784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139714+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T04:51:58.139714+0000","last_peered":"2024-05-10T04:51:58.139714+0000","last_clean":"2024-05-10T04:51:58.139714+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T04:51:58.139714+0000","last_undegraded":"2024-05-10T04:51:58.139714+0000","last_fullsized":"2024-05-10T04:51:58.139714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169375+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T04:51:57.169375+0000","last_peered":"2024-05-10T04:51:57.169375+0000","last_clean":"2024-05-10T04:51:57.169375+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T04:51:57.169375+0000","last_undegraded":"2024-05-10T04:51:57.169375+0000","last_fullsized":"2024-05-10T04:51:57.169375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144171+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T04:51:57.144171+0000","last_peered":"2024-05-10T04:51:57.144171+0000","last_clean":"2024-05-10T04:51:57.144171+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T04:51:57.144171+0000","last_undegraded":"2024-05-10T04:51:57.144171+0000","last_fullsized":"2024-05-10T04:51:57.144171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.770902+0000","last_change":"2024-05-10T04:51:57.175748+0000","last_active":"2024-05-10T04:51:57.770902+0000","last_peered":"2024-05-10T04:51:57.770902+0000","last_clean":"2024-05-10T04:51:57.770902+0000","last_became_active":"2024-05-10T04:51:57.175321+0000","last_became_peered":"2024-05-10T04:51:57.175321+0000","last_unstale":"2024-05-10T04:51:57.770902+0000","last_undegraded":"2024-05-10T04:51:57.770902+0000","last_fullsized":"2024-05-10T04:51:57.770902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:55.866371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146693+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T04:51:57.146693+0000","last_peered":"2024-05-10T04:51:57.146693+0000","last_clean":"2024-05-10T04:51:57.146693+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T04:51:57.146693+0000","last_undegraded":"2024-05-10T04:51:57.146693+0000","last_fullsized":"2024-05-10T04:51:57.146693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142418+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T04:51:57.142418+0000","last_peered":"2024-05-10T04:51:57.142418+0000","last_clean":"2024-05-10T04:51:57.142418+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T04:51:57.142418+0000","last_undegraded":"2024-05-10T04:51:57.142418+0000","last_fullsized":"2024-05-10T04:51:57.142418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773586+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T04:51:57.773586+0000","last_peered":"2024-05-10T04:51:57.773586+0000","last_clean":"2024-05-10T04:51:57.773586+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T04:51:57.773586+0000","last_undegraded":"2024-05-10T04:51:57.773586+0000","last_fullsized":"2024-05-10T04:51:57.773586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167516+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T04:51:57.167516+0000","last_peered":"2024-05-10T04:51:57.167516+0000","last_clean":"2024-05-10T04:51:57.167516+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T04:51:57.167516+0000","last_undegraded":"2024-05-10T04:51:57.167516+0000","last_fullsized":"2024-05-10T04:51:57.167516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165279+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T04:51:57.165279+0000","last_peered":"2024-05-10T04:51:57.165279+0000","last_clean":"2024-05-10T04:51:57.165279+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T04:51:57.165279+0000","last_undegraded":"2024-05-10T04:51:57.165279+0000","last_fullsized":"2024-05-10T04:51:57.165279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787071+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T04:51:57.787071+0000","last_peered":"2024-05-10T04:51:57.787071+0000","last_clean":"2024-05-10T04:51:57.787071+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T04:51:57.787071+0000","last_undegraded":"2024-05-10T04:51:57.787071+0000","last_fullsized":"2024-05-10T04:51:57.787071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158867+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T04:51:57.158867+0000","last_peered":"2024-05-10T04:51:57.158867+0000","last_clean":"2024-05-10T04:51:57.158867+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T04:51:57.158867+0000","last_undegraded":"2024-05-10T04:51:57.158867+0000","last_fullsized":"2024-05-10T04:51:57.158867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173508+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T04:51:57.173508+0000","last_peered":"2024-05-10T04:51:57.173508+0000","last_clean":"2024-05-10T04:51:57.173508+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T04:51:57.173508+0000","last_undegraded":"2024-05-10T04:51:57.173508+0000","last_fullsized":"2024-05-10T04:51:57.173508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138787+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T04:51:58.138787+0000","last_peered":"2024-05-10T04:51:58.138787+0000","last_clean":"2024-05-10T04:51:58.138787+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T04:51:58.138787+0000","last_undegraded":"2024-05-10T04:51:58.138787+0000","last_fullsized":"2024-05-10T04:51:58.138787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148696+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T04:51:57.148696+0000","last_peered":"2024-05-10T04:51:57.148696+0000","last_clean":"2024-05-10T04:51:57.148696+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T04:51:57.148696+0000","last_undegraded":"2024-05-10T04:51:57.148696+0000","last_fullsized":"2024-05-10T04:51:57.148696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160203+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T04:51:57.160203+0000","last_peered":"2024-05-10T04:51:57.160203+0000","last_clean":"2024-05-10T04:51:57.160203+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T04:51:57.160203+0000","last_undegraded":"2024-05-10T04:51:57.160203+0000","last_fullsized":"2024-05-10T04:51:57.160203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139616+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T04:51:58.139616+0000","last_peered":"2024-05-10T04:51:58.139616+0000","last_clean":"2024-05-10T04:51:58.139616+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T04:51:58.139616+0000","last_undegraded":"2024-05-10T04:51:58.139616+0000","last_fullsized":"2024-05-10T04:51:58.139616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160118+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T04:51:57.160118+0000","last_peered":"2024-05-10T04:51:57.160118+0000","last_clean":"2024-05-10T04:51:57.160118+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T04:51:57.160118+0000","last_undegraded":"2024-05-10T04:51:57.160118+0000","last_fullsized":"2024-05-10T04:51:57.160118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143146+0000","last_change":"2024-05-10T04:51:52.753381+0000","last_active":"2024-05-10T04:51:57.143146+0000","last_peered":"2024-05-10T04:51:57.143146+0000","last_clean":"2024-05-10T04:51:57.143146+0000","last_became_active":"2024-05-10T04:51:52.753069+0000","last_became_peered":"2024-05-10T04:51:52.753069+0000","last_unstale":"2024-05-10T04:51:57.143146+0000","last_undegraded":"2024-05-10T04:51:57.143146+0000","last_fullsized":"2024-05-10T04:51:57.143146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773410+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T04:51:57.773410+0000","last_peered":"2024-05-10T04:51:57.773410+0000","last_clean":"2024-05-10T04:51:57.773410+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T04:51:57.773410+0000","last_undegraded":"2024-05-10T04:51:57.773410+0000","last_fullsized":"2024-05-10T04:51:57.773410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174304+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T04:51:57.174304+0000","last_peered":"2024-05-10T04:51:57.174304+0000","last_clean":"2024-05-10T04:51:57.174304+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T04:51:57.174304+0000","last_undegraded":"2024-05-10T04:51:57.174304+0000","last_fullsized":"2024-05-10T04:51:57.174304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145744+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T04:51:57.145744+0000","last_peered":"2024-05-10T04:51:57.145744+0000","last_clean":"2024-05-10T04:51:57.145744+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T04:51:57.145744+0000","last_undegraded":"2024-05-10T04:51:57.145744+0000","last_fullsized":"2024-05-10T04:51:57.145744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139068+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T04:51:58.139068+0000","last_peered":"2024-05-10T04:51:58.139068+0000","last_clean":"2024-05-10T04:51:58.139068+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T04:51:58.139068+0000","last_undegraded":"2024-05-10T04:51:58.139068+0000","last_fullsized":"2024-05-10T04:51:58.139068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:52:13.587589+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T04:52:13.587589+0000","last_peered":"2024-05-10T04:52:13.587589+0000","last_clean":"2024-05-10T04:52:13.587589+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T04:52:13.587589+0000","last_undegraded":"2024-05-10T04:52:13.587589+0000","last_fullsized":"2024-05-10T04:52:13.587589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218710+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T04:51:57.218710+0000","last_peered":"2024-05-10T04:51:57.218710+0000","last_clean":"2024-05-10T04:51:57.218710+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T04:51:57.218710+0000","last_undegraded":"2024-05-10T04:51:57.218710+0000","last_fullsized":"2024-05-10T04:51:57.218710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140198+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T04:51:58.140198+0000","last_peered":"2024-05-10T04:51:58.140198+0000","last_clean":"2024-05-10T04:51:58.140198+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T04:51:58.140198+0000","last_undegraded":"2024-05-10T04:51:58.140198+0000","last_fullsized":"2024-05-10T04:51:58.140198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143030+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T04:51:57.143030+0000","last_peered":"2024-05-10T04:51:57.143030+0000","last_clean":"2024-05-10T04:51:57.143030+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T04:51:57.143030+0000","last_undegraded":"2024-05-10T04:51:57.143030+0000","last_fullsized":"2024-05-10T04:51:57.143030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141996+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T04:51:57.141996+0000","last_peered":"2024-05-10T04:51:57.141996+0000","last_clean":"2024-05-10T04:51:57.141996+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T04:51:57.141996+0000","last_undegraded":"2024-05-10T04:51:57.141996+0000","last_fullsized":"2024-05-10T04:51:57.141996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140050+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T04:51:58.140050+0000","last_peered":"2024-05-10T04:51:58.140050+0000","last_clean":"2024-05-10T04:51:58.140050+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T04:51:58.140050+0000","last_undegraded":"2024-05-10T04:51:58.140050+0000","last_fullsized":"2024-05-10T04:51:58.140050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158654+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T04:51:57.158654+0000","last_peered":"2024-05-10T04:51:57.158654+0000","last_clean":"2024-05-10T04:51:57.158654+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T04:51:57.158654+0000","last_undegraded":"2024-05-10T04:51:57.158654+0000","last_fullsized":"2024-05-10T04:51:57.158654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215369+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T04:51:57.215369+0000","last_peered":"2024-05-10T04:51:57.215369+0000","last_clean":"2024-05-10T04:51:57.215369+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T04:51:57.215369+0000","last_undegraded":"2024-05-10T04:51:57.215369+0000","last_fullsized":"2024-05-10T04:51:57.215369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140671+0000","last_change":"2024-05-10T04:51:57.220214+0000","last_active":"2024-05-10T04:51:58.140671+0000","last_peered":"2024-05-10T04:51:58.140671+0000","last_clean":"2024-05-10T04:51:58.140671+0000","last_became_active":"2024-05-10T04:51:57.219512+0000","last_became_peered":"2024-05-10T04:51:57.219512+0000","last_unstale":"2024-05-10T04:51:58.140671+0000","last_undegraded":"2024-05-10T04:51:58.140671+0000","last_fullsized":"2024-05-10T04:51:58.140671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:41.778039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148801+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T04:51:57.148801+0000","last_peered":"2024-05-10T04:51:57.148801+0000","last_clean":"2024-05-10T04:51:57.148801+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T04:51:57.148801+0000","last_undegraded":"2024-05-10T04:51:57.148801+0000","last_fullsized":"2024-05-10T04:51:57.148801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145710+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T04:51:57.145710+0000","last_peered":"2024-05-10T04:51:57.145710+0000","last_clean":"2024-05-10T04:51:57.145710+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T04:51:57.145710+0000","last_undegraded":"2024-05-10T04:51:57.145710+0000","last_fullsized":"2024-05-10T04:51:57.145710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786825+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T04:51:57.786825+0000","last_peered":"2024-05-10T04:51:57.786825+0000","last_clean":"2024-05-10T04:51:57.786825+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T04:51:57.786825+0000","last_undegraded":"2024-05-10T04:51:57.786825+0000","last_fullsized":"2024-05-10T04:51:57.786825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138766+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T04:51:57.138766+0000","last_peered":"2024-05-10T04:51:57.138766+0000","last_clean":"2024-05-10T04:51:57.138766+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T04:51:57.138766+0000","last_undegraded":"2024-05-10T04:51:57.138766+0000","last_fullsized":"2024-05-10T04:51:57.138766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217588+0000","last_change":"2024-05-10T04:51:52.773374+0000","last_active":"2024-05-10T04:51:57.217588+0000","last_peered":"2024-05-10T04:51:57.217588+0000","last_clean":"2024-05-10T04:51:57.217588+0000","last_became_active":"2024-05-10T04:51:52.773109+0000","last_became_peered":"2024-05-10T04:51:52.773109+0000","last_unstale":"2024-05-10T04:51:57.217588+0000","last_undegraded":"2024-05-10T04:51:57.217588+0000","last_fullsized":"2024-05-10T04:51:57.217588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:34.386904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773863+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T04:51:57.773863+0000","last_peered":"2024-05-10T04:51:57.773863+0000","last_clean":"2024-05-10T04:51:57.773863+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T04:51:57.773863+0000","last_undegraded":"2024-05-10T04:51:57.773863+0000","last_fullsized":"2024-05-10T04:51:57.773863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144228+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T04:51:57.144228+0000","last_peered":"2024-05-10T04:51:57.144228+0000","last_clean":"2024-05-10T04:51:57.144228+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T04:51:57.144228+0000","last_undegraded":"2024-05-10T04:51:57.144228+0000","last_fullsized":"2024-05-10T04:51:57.144228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218635+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T04:51:57.218635+0000","last_peered":"2024-05-10T04:51:57.218635+0000","last_clean":"2024-05-10T04:51:57.218635+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T04:51:57.218635+0000","last_undegraded":"2024-05-10T04:51:57.218635+0000","last_fullsized":"2024-05-10T04:51:57.218635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138952+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T04:51:58.138952+0000","last_peered":"2024-05-10T04:51:58.138952+0000","last_clean":"2024-05-10T04:51:58.138952+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T04:51:58.138952+0000","last_undegraded":"2024-05-10T04:51:58.138952+0000","last_fullsized":"2024-05-10T04:51:58.138952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173824+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T04:51:57.173824+0000","last_peered":"2024-05-10T04:51:57.173824+0000","last_clean":"2024-05-10T04:51:57.173824+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T04:51:57.173824+0000","last_undegraded":"2024-05-10T04:51:57.173824+0000","last_fullsized":"2024-05-10T04:51:57.173824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159946+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T04:51:57.159946+0000","last_peered":"2024-05-10T04:51:57.159946+0000","last_clean":"2024-05-10T04:51:57.159946+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T04:51:57.159946+0000","last_undegraded":"2024-05-10T04:51:57.159946+0000","last_fullsized":"2024-05-10T04:51:57.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138685+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T04:51:58.138685+0000","last_peered":"2024-05-10T04:51:58.138685+0000","last_clean":"2024-05-10T04:51:58.138685+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T04:51:58.138685+0000","last_undegraded":"2024-05-10T04:51:58.138685+0000","last_fullsized":"2024-05-10T04:51:58.138685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158550+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T04:51:57.158550+0000","last_peered":"2024-05-10T04:51:57.158550+0000","last_clean":"2024-05-10T04:51:57.158550+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T04:51:57.158550+0000","last_undegraded":"2024-05-10T04:51:57.158550+0000","last_fullsized":"2024-05-10T04:51:57.158550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145115+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T04:51:57.145115+0000","last_peered":"2024-05-10T04:51:57.145115+0000","last_clean":"2024-05-10T04:51:57.145115+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T04:51:57.145115+0000","last_undegraded":"2024-05-10T04:51:57.145115+0000","last_fullsized":"2024-05-10T04:51:57.145115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139840+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T04:51:58.139840+0000","last_peered":"2024-05-10T04:51:58.139840+0000","last_clean":"2024-05-10T04:51:58.139840+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T04:51:58.139840+0000","last_undegraded":"2024-05-10T04:51:58.139840+0000","last_fullsized":"2024-05-10T04:51:58.139840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173195+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T04:51:57.173195+0000","last_peered":"2024-05-10T04:51:57.173195+0000","last_clean":"2024-05-10T04:51:57.173195+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T04:51:57.173195+0000","last_undegraded":"2024-05-10T04:51:57.173195+0000","last_fullsized":"2024-05-10T04:51:57.173195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138457+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T04:51:57.138457+0000","last_peered":"2024-05-10T04:51:57.138457+0000","last_clean":"2024-05-10T04:51:57.138457+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T04:51:57.138457+0000","last_undegraded":"2024-05-10T04:51:57.138457+0000","last_fullsized":"2024-05-10T04:51:57.138457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772271+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T04:51:57.772271+0000","last_peered":"2024-05-10T04:51:57.772271+0000","last_clean":"2024-05-10T04:51:57.772271+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T04:51:57.772271+0000","last_undegraded":"2024-05-10T04:51:57.772271+0000","last_fullsized":"2024-05-10T04:51:57.772271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167290+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T04:51:57.167290+0000","last_peered":"2024-05-10T04:51:57.167290+0000","last_clean":"2024-05-10T04:51:57.167290+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T04:51:57.167290+0000","last_undegraded":"2024-05-10T04:51:57.167290+0000","last_fullsized":"2024-05-10T04:51:57.167290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158794+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T04:51:57.158794+0000","last_peered":"2024-05-10T04:51:57.158794+0000","last_clean":"2024-05-10T04:51:57.158794+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T04:51:57.158794+0000","last_undegraded":"2024-05-10T04:51:57.158794+0000","last_fullsized":"2024-05-10T04:51:57.158794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214929+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T04:51:57.214929+0000","last_peered":"2024-05-10T04:51:57.214929+0000","last_clean":"2024-05-10T04:51:57.214929+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T04:51:57.214929+0000","last_undegraded":"2024-05-10T04:51:57.214929+0000","last_fullsized":"2024-05-10T04:51:57.214929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786989+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T04:51:57.786989+0000","last_peered":"2024-05-10T04:51:57.786989+0000","last_clean":"2024-05-10T04:51:57.786989+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T04:51:57.786989+0000","last_undegraded":"2024-05-10T04:51:57.786989+0000","last_fullsized":"2024-05-10T04:51:57.786989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141828+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T04:51:57.141828+0000","last_peered":"2024-05-10T04:51:57.141828+0000","last_clean":"2024-05-10T04:51:57.141828+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T04:51:57.141828+0000","last_undegraded":"2024-05-10T04:51:57.141828+0000","last_fullsized":"2024-05-10T04:51:57.141828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215071+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T04:51:57.215071+0000","last_peered":"2024-05-10T04:51:57.215071+0000","last_clean":"2024-05-10T04:51:57.215071+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T04:51:57.215071+0000","last_undegraded":"2024-05-10T04:51:57.215071+0000","last_fullsized":"2024-05-10T04:51:57.215071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786742+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T04:51:57.786742+0000","last_peered":"2024-05-10T04:51:57.786742+0000","last_clean":"2024-05-10T04:51:57.786742+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T04:51:57.786742+0000","last_undegraded":"2024-05-10T04:51:57.786742+0000","last_fullsized":"2024-05-10T04:51:57.786742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218062+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T04:51:57.218062+0000","last_peered":"2024-05-10T04:51:57.218062+0000","last_clean":"2024-05-10T04:51:57.218062+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T04:51:57.218062+0000","last_undegraded":"2024-05-10T04:51:57.218062+0000","last_fullsized":"2024-05-10T04:51:57.218062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174509+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T04:51:57.174509+0000","last_peered":"2024-05-10T04:51:57.174509+0000","last_clean":"2024-05-10T04:51:57.174509+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T04:51:57.174509+0000","last_undegraded":"2024-05-10T04:51:57.174509+0000","last_fullsized":"2024-05-10T04:51:57.174509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138706+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T04:51:58.138706+0000","last_peered":"2024-05-10T04:51:58.138706+0000","last_clean":"2024-05-10T04:51:58.138706+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T04:51:58.138706+0000","last_undegraded":"2024-05-10T04:51:58.138706+0000","last_fullsized":"2024-05-10T04:51:58.138706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174200+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T04:51:57.174200+0000","last_peered":"2024-05-10T04:51:57.174200+0000","last_clean":"2024-05-10T04:51:57.174200+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T04:51:57.174200+0000","last_undegraded":"2024-05-10T04:51:57.174200+0000","last_fullsized":"2024-05-10T04:51:57.174200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172446+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T04:51:57.172446+0000","last_peered":"2024-05-10T04:51:57.172446+0000","last_clean":"2024-05-10T04:51:57.172446+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T04:51:57.172446+0000","last_undegraded":"2024-05-10T04:51:57.172446+0000","last_fullsized":"2024-05-10T04:51:57.172446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773872+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T04:51:57.773872+0000","last_peered":"2024-05-10T04:51:57.773872+0000","last_clean":"2024-05-10T04:51:57.773872+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T04:51:57.773872+0000","last_undegraded":"2024-05-10T04:51:57.773872+0000","last_fullsized":"2024-05-10T04:51:57.773872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148508+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T04:51:57.148508+0000","last_peered":"2024-05-10T04:51:57.148508+0000","last_clean":"2024-05-10T04:51:57.148508+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T04:51:57.148508+0000","last_undegraded":"2024-05-10T04:51:57.148508+0000","last_fullsized":"2024-05-10T04:51:57.148508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145749+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T04:51:57.145749+0000","last_peered":"2024-05-10T04:51:57.145749+0000","last_clean":"2024-05-10T04:51:57.145749+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T04:51:57.145749+0000","last_undegraded":"2024-05-10T04:51:57.145749+0000","last_fullsized":"2024-05-10T04:51:57.145749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773762+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T04:51:57.773762+0000","last_peered":"2024-05-10T04:51:57.773762+0000","last_clean":"2024-05-10T04:51:57.773762+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T04:51:57.773762+0000","last_undegraded":"2024-05-10T04:51:57.773762+0000","last_fullsized":"2024-05-10T04:51:57.773762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214825+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T04:51:57.214825+0000","last_peered":"2024-05-10T04:51:57.214825+0000","last_clean":"2024-05-10T04:51:57.214825+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T04:51:57.214825+0000","last_undegraded":"2024-05-10T04:51:57.214825+0000","last_fullsized":"2024-05-10T04:51:57.214825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144036+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T04:51:57.144036+0000","last_peered":"2024-05-10T04:51:57.144036+0000","last_clean":"2024-05-10T04:51:57.144036+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T04:51:57.144036+0000","last_undegraded":"2024-05-10T04:51:57.144036+0000","last_fullsized":"2024-05-10T04:51:57.144036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139976+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T04:51:58.139976+0000","last_peered":"2024-05-10T04:51:58.139976+0000","last_clean":"2024-05-10T04:51:58.139976+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T04:51:58.139976+0000","last_undegraded":"2024-05-10T04:51:58.139976+0000","last_fullsized":"2024-05-10T04:51:58.139976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173379+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T04:51:57.173379+0000","last_peered":"2024-05-10T04:51:57.173379+0000","last_clean":"2024-05-10T04:51:57.173379+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T04:51:57.173379+0000","last_undegraded":"2024-05-10T04:51:57.173379+0000","last_fullsized":"2024-05-10T04:51:57.173379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165406+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T04:51:57.165406+0000","last_peered":"2024-05-10T04:51:57.165406+0000","last_clean":"2024-05-10T04:51:57.165406+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T04:51:57.165406+0000","last_undegraded":"2024-05-10T04:51:57.165406+0000","last_fullsized":"2024-05-10T04:51:57.165406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773193+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T04:51:57.773193+0000","last_peered":"2024-05-10T04:51:57.773193+0000","last_clean":"2024-05-10T04:51:57.773193+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T04:51:57.773193+0000","last_undegraded":"2024-05-10T04:51:57.773193+0000","last_fullsized":"2024-05-10T04:51:57.773193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173739+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T04:51:57.173739+0000","last_peered":"2024-05-10T04:51:57.173739+0000","last_clean":"2024-05-10T04:51:57.173739+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T04:51:57.173739+0000","last_undegraded":"2024-05-10T04:51:57.173739+0000","last_fullsized":"2024-05-10T04:51:57.173739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169440+0000","last_change":"2024-05-10T04:51:52.747037+0000","last_active":"2024-05-10T04:51:57.169440+0000","last_peered":"2024-05-10T04:51:57.169440+0000","last_clean":"2024-05-10T04:51:57.169440+0000","last_became_active":"2024-05-10T04:51:52.746784+0000","last_became_peered":"2024-05-10T04:51:52.746784+0000","last_unstale":"2024-05-10T04:51:57.169440+0000","last_undegraded":"2024-05-10T04:51:57.169440+0000","last_fullsized":"2024-05-10T04:51:57.169440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:49.520262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773616+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T04:51:57.773616+0000","last_peered":"2024-05-10T04:51:57.773616+0000","last_clean":"2024-05-10T04:51:57.773616+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T04:51:57.773616+0000","last_undegraded":"2024-05-10T04:51:57.773616+0000","last_fullsized":"2024-05-10T04:51:57.773616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215454+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T04:51:57.215454+0000","last_peered":"2024-05-10T04:51:57.215454+0000","last_clean":"2024-05-10T04:51:57.215454+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T04:51:57.215454+0000","last_undegraded":"2024-05-10T04:51:57.215454+0000","last_fullsized":"2024-05-10T04:51:57.215454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146811+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T04:51:57.146811+0000","last_peered":"2024-05-10T04:51:57.146811+0000","last_clean":"2024-05-10T04:51:57.146811+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T04:51:57.146811+0000","last_undegraded":"2024-05-10T04:51:57.146811+0000","last_fullsized":"2024-05-10T04:51:57.146811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772398+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T04:51:57.772398+0000","last_peered":"2024-05-10T04:51:57.772398+0000","last_clean":"2024-05-10T04:51:57.772398+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T04:51:57.772398+0000","last_undegraded":"2024-05-10T04:51:57.772398+0000","last_fullsized":"2024-05-10T04:51:57.772398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138613+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T04:51:57.138613+0000","last_peered":"2024-05-10T04:51:57.138613+0000","last_clean":"2024-05-10T04:51:57.138613+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T04:51:57.138613+0000","last_undegraded":"2024-05-10T04:51:57.138613+0000","last_fullsized":"2024-05-10T04:51:57.138613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218593+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T04:51:57.218593+0000","last_peered":"2024-05-10T04:51:57.218593+0000","last_clean":"2024-05-10T04:51:57.218593+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T04:51:57.218593+0000","last_undegraded":"2024-05-10T04:51:57.218593+0000","last_fullsized":"2024-05-10T04:51:57.218593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787056+0000","last_change":"2024-05-10T04:51:57.160643+0000","last_active":"2024-05-10T04:51:57.787056+0000","last_peered":"2024-05-10T04:51:57.787056+0000","last_clean":"2024-05-10T04:51:57.787056+0000","last_became_active":"2024-05-10T04:51:57.160203+0000","last_became_peered":"2024-05-10T04:51:57.160203+0000","last_unstale":"2024-05-10T04:51:57.787056+0000","last_undegraded":"2024-05-10T04:51:57.787056+0000","last_fullsized":"2024-05-10T04:51:57.787056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174457+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T04:51:57.174457+0000","last_peered":"2024-05-10T04:51:57.174457+0000","last_clean":"2024-05-10T04:51:57.174457+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T04:51:57.174457+0000","last_undegraded":"2024-05-10T04:51:57.174457+0000","last_fullsized":"2024-05-10T04:51:57.174457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159470+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T04:51:57.159470+0000","last_peered":"2024-05-10T04:51:57.159470+0000","last_clean":"2024-05-10T04:51:57.159470+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T04:51:57.159470+0000","last_undegraded":"2024-05-10T04:51:57.159470+0000","last_fullsized":"2024-05-10T04:51:57.159470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138927+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T04:51:58.138927+0000","last_peered":"2024-05-10T04:51:58.138927+0000","last_clean":"2024-05-10T04:51:58.138927+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T04:51:58.138927+0000","last_undegraded":"2024-05-10T04:51:58.138927+0000","last_fullsized":"2024-05-10T04:51:58.138927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138575+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T04:51:57.138575+0000","last_peered":"2024-05-10T04:51:57.138575+0000","last_clean":"2024-05-10T04:51:57.138575+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T04:51:57.138575+0000","last_undegraded":"2024-05-10T04:51:57.138575+0000","last_fullsized":"2024-05-10T04:51:57.138575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219349+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T04:51:57.219349+0000","last_peered":"2024-05-10T04:51:57.219349+0000","last_clean":"2024-05-10T04:51:57.219349+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T04:51:57.219349+0000","last_undegraded":"2024-05-10T04:51:57.219349+0000","last_fullsized":"2024-05-10T04:51:57.219349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146339+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T04:51:57.146339+0000","last_peered":"2024-05-10T04:51:57.146339+0000","last_clean":"2024-05-10T04:51:57.146339+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T04:51:57.146339+0000","last_undegraded":"2024-05-10T04:51:57.146339+0000","last_fullsized":"2024-05-10T04:51:57.146339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138542+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T04:51:57.138542+0000","last_peered":"2024-05-10T04:51:57.138542+0000","last_clean":"2024-05-10T04:51:57.138542+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T04:51:57.138542+0000","last_undegraded":"2024-05-10T04:51:57.138542+0000","last_fullsized":"2024-05-10T04:51:57.138542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158869+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T04:51:57.158869+0000","last_peered":"2024-05-10T04:51:57.158869+0000","last_clean":"2024-05-10T04:51:57.158869+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T04:51:57.158869+0000","last_undegraded":"2024-05-10T04:51:57.158869+0000","last_fullsized":"2024-05-10T04:51:57.158869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142526+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T04:51:57.142526+0000","last_peered":"2024-05-10T04:51:57.142526+0000","last_clean":"2024-05-10T04:51:57.142526+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T04:51:57.142526+0000","last_undegraded":"2024-05-10T04:51:57.142526+0000","last_fullsized":"2024-05-10T04:51:57.142526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169312+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T04:51:57.169312+0000","last_peered":"2024-05-10T04:51:57.169312+0000","last_clean":"2024-05-10T04:51:57.169312+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T04:51:57.169312+0000","last_undegraded":"2024-05-10T04:51:57.169312+0000","last_fullsized":"2024-05-10T04:51:57.169312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174203+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T04:51:57.174203+0000","last_peered":"2024-05-10T04:51:57.174203+0000","last_clean":"2024-05-10T04:51:57.174203+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T04:51:57.174203+0000","last_undegraded":"2024-05-10T04:51:57.174203+0000","last_fullsized":"2024-05-10T04:51:57.174203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148326+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T04:51:57.148326+0000","last_peered":"2024-05-10T04:51:57.148326+0000","last_clean":"2024-05-10T04:51:57.148326+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T04:51:57.148326+0000","last_undegraded":"2024-05-10T04:51:57.148326+0000","last_fullsized":"2024-05-10T04:51:57.148326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172553+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T04:51:57.172553+0000","last_peered":"2024-05-10T04:51:57.172553+0000","last_clean":"2024-05-10T04:51:57.172553+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T04:51:57.172553+0000","last_undegraded":"2024-05-10T04:51:57.172553+0000","last_fullsized":"2024-05-10T04:51:57.172553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158805+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T04:51:57.158805+0000","last_peered":"2024-05-10T04:51:57.158805+0000","last_clean":"2024-05-10T04:51:57.158805+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T04:51:57.158805+0000","last_undegraded":"2024-05-10T04:51:57.158805+0000","last_fullsized":"2024-05-10T04:51:57.158805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167615+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T04:51:57.167615+0000","last_peered":"2024-05-10T04:51:57.167615+0000","last_clean":"2024-05-10T04:51:57.167615+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T04:51:57.167615+0000","last_undegraded":"2024-05-10T04:51:57.167615+0000","last_fullsized":"2024-05-10T04:51:57.167615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159086+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T04:51:57.159086+0000","last_peered":"2024-05-10T04:51:57.159086+0000","last_clean":"2024-05-10T04:51:57.159086+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T04:51:57.159086+0000","last_undegraded":"2024-05-10T04:51:57.159086+0000","last_fullsized":"2024-05-10T04:51:57.159086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142627+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T04:51:57.142627+0000","last_peered":"2024-05-10T04:51:57.142627+0000","last_clean":"2024-05-10T04:51:57.142627+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T04:51:57.142627+0000","last_undegraded":"2024-05-10T04:51:57.142627+0000","last_fullsized":"2024-05-10T04:51:57.142627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148006+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T04:51:57.148006+0000","last_peered":"2024-05-10T04:51:57.148006+0000","last_clean":"2024-05-10T04:51:57.148006+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T04:51:57.148006+0000","last_undegraded":"2024-05-10T04:51:57.148006+0000","last_fullsized":"2024-05-10T04:51:57.148006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9380000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":880640,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":111526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:25.672 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T04:52:25.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.976+0000 7f8c41e00700 1 Processor -- start 2024-05-10T04:52:25.977 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.976+0000 7f8c41e00700 1 -- start start 2024-05-10T04:52:25.978 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.978+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c155e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.978+0000 7f8c41e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0c62d0 con 0x7f8c3c0ca900 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.978+0000 7f8c41e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c3c0cb120 con 0x7f8c3c0cad10 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.978+0000 7f8c41e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c1563c0 con 0x7f8c3c152be0 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c3aa00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c33e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8c3c0ca900 0x7f8c3c0c37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43652/0 (socket says 172.21.15.47:43652) 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c3aa00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:50766/0 (socket says 172.21.15.47:50766) 2024-05-10T04:52:25.979 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c33e00700 1 -- 172.21.15.47:0/3838770656 learned_addr learned my addr 172.21.15.47:0/3838770656 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:25.980 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c3a000700 1 -- 172.21.15.47:0/3838770656 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570413769 0 0) 0x7f8c3c0c62d0 con 0x7f8c3c0ca900 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c3aa00700 1 -- 172.21.15.47:0/3838770656 >> v1:172.21.15.117:6789/0 conn(0x7f8c3c0cad10 legacy=0x7f8c3c0c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c3aa00700 1 -- 172.21.15.47:0/3838770656 >> v1:172.21.15.47:6789/0 conn(0x7f8c3c0ca900 legacy=0x7f8c3c0c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.979+0000 7f8c3aa00700 1 -- 172.21.15.47:0/3838770656 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c3c0c56c0 con 0x7f8c3c152be0 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.980+0000 7f8c3aa00700 1 --2- 172.21.15.47:0/3838770656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c155e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097f0 tx=0x7f8c2c009b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1ad5840f0703ef server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.980+0000 7f8c3a000700 1 -- 172.21.15.47:0/3838770656 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c004230 con 0x7f8c3c152be0 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.980+0000 7f8c3a000700 1 -- 172.21.15.47:0/3838770656 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c2c004390 con 0x7f8c3c152be0 2024-05-10T04:52:25.981 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.980+0000 7f8c3a000700 1 -- 172.21.15.47:0/3838770656 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2c0036a0 con 0x7f8c3c152be0 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 -- 172.21.15.47:0/3838770656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 msgr2=0x7f8c3c155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 --2- 172.21.15.47:0/3838770656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c155e80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097f0 tx=0x7f8c2c009b00 comp rx=0 tx=0).stop 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 -- 172.21.15.47:0/3838770656 shutdown_connections 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 --2- 172.21.15.47:0/3838770656 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c155e80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 -- 172.21.15.47:0/3838770656 >> 172.21.15.47:0/3838770656 conn(0x7f8c3c0c7630 msgr2=0x7f8c3c0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 -- 172.21.15.47:0/3838770656 shutdown_connections 2024-05-10T04:52:25.982 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.981+0000 7f8c41e00700 1 -- 172.21.15.47:0/3838770656 wait complete. 2024-05-10T04:52:25.983 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.983+0000 7f8c41e00700 1 Processor -- start 2024-05-10T04:52:25.984 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.983+0000 7f8c41e00700 1 -- start start 2024-05-10T04:52:25.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c3c0ca900 0x7f8c3c0c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 0x7f8c3c158e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c41e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c41e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c155240 con 0x7f8c3c0cad10 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c41e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c159880 con 0x7f8c3c0ca900 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c41e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c3c1ef8f0 con 0x7f8c3c152be0 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 0x7f8c3c158e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 0x7f8c3c158e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37000/0 (socket says 172.21.15.47:37000) 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 -- 172.21.15.47:0/2727377048 learned_addr learned my addr 172.21.15.47:0/2727377048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c3aa00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c3c0ca900 0x7f8c3c0c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c3b400700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 -- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 msgr2=0x7f8c3c142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 -- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c3c0ca900 msgr2=0x7f8c3c0c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:25.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c3c0ca900 0x7f8c3c0c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.985+0000 7f8c33e00700 1 -- 172.21.15.47:0/2727377048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0094a0 con 0x7f8c3c0cad10 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.986+0000 7f8c33e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 0x7f8c3c158e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c450 tx=0x7f8c2400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.986+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24004c80 con 0x7f8c3c0cad10 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.986+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c24004e00 con 0x7f8c3c0cad10 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.986+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c24007310 con 0x7f8c3c0cad10 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.986+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c3c158660 con 0x7f8c3c0cad10 2024-05-10T04:52:25.988 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.986+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3c154ae0 con 0x7f8c3c0cad10 2024-05-10T04:52:25.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.987+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3c074720 con 0x7f8c3c0cad10 2024-05-10T04:52:25.989 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.988+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c24007470 con 0x7f8c3c0cad10 2024-05-10T04:52:25.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.989+0000 7f8c33400700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c1806acc0 0x7f8c1806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:25.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.989+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c240891b0 con 0x7f8c3c0cad10 2024-05-10T04:52:25.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.990+0000 7f8c3aa00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c1806acc0 0x7f8c1806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:25.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.991+0000 7f8c3aa00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c1806acc0 0x7f8c1806d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097f0 tx=0x7f8c2c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:25.994 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:25.994+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8c240540a0 con 0x7f8c3c0cad10 2024-05-10T04:52:26.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.205+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8c3c0c5f60 con 0x7f8c1806acc0 2024-05-10T04:52:26.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.215+0000 7f8c33400700 1 -- 172.21.15.47:0/2727377048 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345261 (secure 0 0 0) 0x7f8c2c003890 con 0x7f8c1806acc0 2024-05-10T04:52:26.221 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:26.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c1806acc0 msgr2=0x7f8c1806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c1806acc0 0x7f8c1806d1d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0097f0 tx=0x7f8c2c008030 comp rx=0 tx=0).stop 2024-05-10T04:52:26.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 msgr2=0x7f8c3c158e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 0x7f8c3c158e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8c2400c450 tx=0x7f8c2400c760 comp rx=0 tx=0).stop 2024-05-10T04:52:26.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 shutdown_connections 2024-05-10T04:52:26.224 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c1806acc0 0x7f8c1806d1d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c3c152be0 0x7f8c3c142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c3c0ca900 0x7f8c3c0c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 --2- 172.21.15.47:0/2727377048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c3c0cad10 0x7f8c3c158e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 >> 172.21.15.47:0/2727377048 conn(0x7f8c3c0c7630 msgr2=0x7f8c3c151850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 shutdown_connections 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.220+0000 7f8c41e00700 1 -- 172.21.15.47:0/2727377048 wait complete. 2024-05-10T04:52:26.225 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T04:52:26.249 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-05-10T04:52:25.162037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594962,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235916,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738804,"statfs":{"total":773094113280,"available":772852535296,"internally_reserved":0,"allocated":3448832,"data_stored":2051764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003791"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219600+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T04:51:57.219600+0000","last_peered":"2024-05-10T04:51:57.219600+0000","last_clean":"2024-05-10T04:51:57.219600+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T04:51:57.219600+0000","last_undegraded":"2024-05-10T04:51:57.219600+0000","last_fullsized":"2024-05-10T04:51:57.219600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174451+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T04:51:57.174451+0000","last_peered":"2024-05-10T04:51:57.174451+0000","last_clean":"2024-05-10T04:51:57.174451+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T04:51:57.174451+0000","last_undegraded":"2024-05-10T04:51:57.174451+0000","last_fullsized":"2024-05-10T04:51:57.174451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142131+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T04:51:57.142131+0000","last_peered":"2024-05-10T04:51:57.142131+0000","last_clean":"2024-05-10T04:51:57.142131+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T04:51:57.142131+0000","last_undegraded":"2024-05-10T04:51:57.142131+0000","last_fullsized":"2024-05-10T04:51:57.142131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159614+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T04:51:57.159614+0000","last_peered":"2024-05-10T04:51:57.159614+0000","last_clean":"2024-05-10T04:51:57.159614+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T04:51:57.159614+0000","last_undegraded":"2024-05-10T04:51:57.159614+0000","last_fullsized":"2024-05-10T04:51:57.159614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215270+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T04:51:57.215270+0000","last_peered":"2024-05-10T04:51:57.215270+0000","last_clean":"2024-05-10T04:51:57.215270+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T04:51:57.215270+0000","last_undegraded":"2024-05-10T04:51:57.215270+0000","last_fullsized":"2024-05-10T04:51:57.215270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158970+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T04:51:57.158970+0000","last_peered":"2024-05-10T04:51:57.158970+0000","last_clean":"2024-05-10T04:51:57.158970+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T04:51:57.158970+0000","last_undegraded":"2024-05-10T04:51:57.158970+0000","last_fullsized":"2024-05-10T04:51:57.158970+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219056+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T04:51:57.219056+0000","last_peered":"2024-05-10T04:51:57.219056+0000","last_clean":"2024-05-10T04:51:57.219056+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T04:51:57.219056+0000","last_undegraded":"2024-05-10T04:51:57.219056+0000","last_fullsized":"2024-05-10T04:51:57.219056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165516+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T04:51:57.165516+0000","last_peered":"2024-05-10T04:51:57.165516+0000","last_clean":"2024-05-10T04:51:57.165516+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T04:51:57.165516+0000","last_undegraded":"2024-05-10T04:51:57.165516+0000","last_fullsized":"2024-05-10T04:51:57.165516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219499+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T04:51:57.219499+0000","last_peered":"2024-05-10T04:51:57.219499+0000","last_clean":"2024-05-10T04:51:57.219499+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T04:51:57.219499+0000","last_undegraded":"2024-05-10T04:51:57.219499+0000","last_fullsized":"2024-05-10T04:51:57.219499+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148505+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T04:51:57.148505+0000","last_peered":"2024-05-10T04:51:57.148505+0000","last_clean":"2024-05-10T04:51:57.148505+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T04:51:57.148505+0000","last_undegraded":"2024-05-10T04:51:57.148505+0000","last_fullsized":"2024-05-10T04:51:57.148505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.147947+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T04:51:57.147947+0000","last_peered":"2024-05-10T04:51:57.147947+0000","last_clean":"2024-05-10T04:51:57.147947+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T04:51:57.147947+0000","last_undegraded":"2024-05-10T04:51:57.147947+0000","last_fullsized":"2024-05-10T04:51:57.147947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145857+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T04:51:57.145857+0000","last_peered":"2024-05-10T04:51:57.145857+0000","last_clean":"2024-05-10T04:51:57.145857+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T04:51:57.145857+0000","last_undegraded":"2024-05-10T04:51:57.145857+0000","last_fullsized":"2024-05-10T04:51:57.145857+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169259+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T04:51:57.169259+0000","last_peered":"2024-05-10T04:51:57.169259+0000","last_clean":"2024-05-10T04:51:57.169259+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T04:51:57.169259+0000","last_undegraded":"2024-05-10T04:51:57.169259+0000","last_fullsized":"2024-05-10T04:51:57.169259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141852+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T04:51:57.141852+0000","last_peered":"2024-05-10T04:51:57.141852+0000","last_clean":"2024-05-10T04:51:57.141852+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T04:51:57.141852+0000","last_undegraded":"2024-05-10T04:51:57.141852+0000","last_fullsized":"2024-05-10T04:51:57.141852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173288+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T04:51:57.173288+0000","last_peered":"2024-05-10T04:51:57.173288+0000","last_clean":"2024-05-10T04:51:57.173288+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T04:51:57.173288+0000","last_undegraded":"2024-05-10T04:51:57.173288+0000","last_fullsized":"2024-05-10T04:51:57.173288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158567+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T04:51:57.158567+0000","last_peered":"2024-05-10T04:51:57.158567+0000","last_clean":"2024-05-10T04:51:57.158567+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T04:51:57.158567+0000","last_undegraded":"2024-05-10T04:51:57.158567+0000","last_fullsized":"2024-05-10T04:51:57.158567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160353+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T04:51:57.160353+0000","last_peered":"2024-05-10T04:51:57.160353+0000","last_clean":"2024-05-10T04:51:57.160353+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T04:51:57.160353+0000","last_undegraded":"2024-05-10T04:51:57.160353+0000","last_fullsized":"2024-05-10T04:51:57.160353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138643+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T04:51:57.138643+0000","last_peered":"2024-05-10T04:51:57.138643+0000","last_clean":"2024-05-10T04:51:57.138643+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T04:51:57.138643+0000","last_undegraded":"2024-05-10T04:51:57.138643+0000","last_fullsized":"2024-05-10T04:51:57.138643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.220600+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T04:51:57.220600+0000","last_peered":"2024-05-10T04:51:57.220600+0000","last_clean":"2024-05-10T04:51:57.220600+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T04:51:57.220600+0000","last_undegraded":"2024-05-10T04:51:57.220600+0000","last_fullsized":"2024-05-10T04:51:57.220600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138962+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T04:51:58.138962+0000","last_peered":"2024-05-10T04:51:58.138962+0000","last_clean":"2024-05-10T04:51:58.138962+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T04:51:58.138962+0000","last_undegraded":"2024-05-10T04:51:58.138962+0000","last_fullsized":"2024-05-10T04:51:58.138962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142910+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T04:51:57.142910+0000","last_peered":"2024-05-10T04:51:57.142910+0000","last_clean":"2024-05-10T04:51:57.142910+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T04:51:57.142910+0000","last_undegraded":"2024-05-10T04:51:57.142910+0000","last_fullsized":"2024-05-10T04:51:57.142910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171479+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T04:51:57.171479+0000","last_peered":"2024-05-10T04:51:57.171479+0000","last_clean":"2024-05-10T04:51:57.171479+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T04:51:57.171479+0000","last_undegraded":"2024-05-10T04:51:57.171479+0000","last_fullsized":"2024-05-10T04:51:57.171479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773136+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T04:51:57.773136+0000","last_peered":"2024-05-10T04:51:57.773136+0000","last_clean":"2024-05-10T04:51:57.773136+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T04:51:57.773136+0000","last_undegraded":"2024-05-10T04:51:57.773136+0000","last_fullsized":"2024-05-10T04:51:57.773136+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.171605+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T04:51:57.171605+0000","last_peered":"2024-05-10T04:51:57.171605+0000","last_clean":"2024-05-10T04:51:57.171605+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T04:51:57.171605+0000","last_undegraded":"2024-05-10T04:51:57.171605+0000","last_fullsized":"2024-05-10T04:51:57.171605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142772+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T04:51:57.142772+0000","last_peered":"2024-05-10T04:51:57.142772+0000","last_clean":"2024-05-10T04:51:57.142772+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T04:51:57.142772+0000","last_undegraded":"2024-05-10T04:51:57.142772+0000","last_fullsized":"2024-05-10T04:51:57.142772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773231+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T04:51:57.773231+0000","last_peered":"2024-05-10T04:51:57.773231+0000","last_clean":"2024-05-10T04:51:57.773231+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T04:51:57.773231+0000","last_undegraded":"2024-05-10T04:51:57.773231+0000","last_fullsized":"2024-05-10T04:51:57.773231+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218564+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T04:51:57.218564+0000","last_peered":"2024-05-10T04:51:57.218564+0000","last_clean":"2024-05-10T04:51:57.218564+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T04:51:57.218564+0000","last_undegraded":"2024-05-10T04:51:57.218564+0000","last_fullsized":"2024-05-10T04:51:57.218564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159502+0000","last_change":"2024-05-10T04:51:52.757879+0000","last_active":"2024-05-10T04:51:57.159502+0000","last_peered":"2024-05-10T04:51:57.159502+0000","last_clean":"2024-05-10T04:51:57.159502+0000","last_became_active":"2024-05-10T04:51:52.757556+0000","last_became_peered":"2024-05-10T04:51:52.757556+0000","last_unstale":"2024-05-10T04:51:57.159502+0000","last_undegraded":"2024-05-10T04:51:57.159502+0000","last_fullsized":"2024-05-10T04:51:57.159502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:29.588613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.774138+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T04:51:57.774138+0000","last_peered":"2024-05-10T04:51:57.774138+0000","last_clean":"2024-05-10T04:51:57.774138+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T04:51:57.774138+0000","last_undegraded":"2024-05-10T04:51:57.774138+0000","last_fullsized":"2024-05-10T04:51:57.774138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217441+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T04:51:57.217441+0000","last_peered":"2024-05-10T04:51:57.217441+0000","last_clean":"2024-05-10T04:51:57.217441+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T04:51:57.217441+0000","last_undegraded":"2024-05-10T04:51:57.217441+0000","last_fullsized":"2024-05-10T04:51:57.217441+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159784+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T04:51:57.159784+0000","last_peered":"2024-05-10T04:51:57.159784+0000","last_clean":"2024-05-10T04:51:57.159784+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T04:51:57.159784+0000","last_undegraded":"2024-05-10T04:51:57.159784+0000","last_fullsized":"2024-05-10T04:51:57.159784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139714+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T04:51:58.139714+0000","last_peered":"2024-05-10T04:51:58.139714+0000","last_clean":"2024-05-10T04:51:58.139714+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T04:51:58.139714+0000","last_undegraded":"2024-05-10T04:51:58.139714+0000","last_fullsized":"2024-05-10T04:51:58.139714+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169375+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T04:51:57.169375+0000","last_peered":"2024-05-10T04:51:57.169375+0000","last_clean":"2024-05-10T04:51:57.169375+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T04:51:57.169375+0000","last_undegraded":"2024-05-10T04:51:57.169375+0000","last_fullsized":"2024-05-10T04:51:57.169375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144171+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T04:51:57.144171+0000","last_peered":"2024-05-10T04:51:57.144171+0000","last_clean":"2024-05-10T04:51:57.144171+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T04:51:57.144171+0000","last_undegraded":"2024-05-10T04:51:57.144171+0000","last_fullsized":"2024-05-10T04:51:57.144171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.770902+0000","last_change":"2024-05-10T04:51:57.175748+0000","last_active":"2024-05-10T04:51:57.770902+0000","last_peered":"2024-05-10T04:51:57.770902+0000","last_clean":"2024-05-10T04:51:57.770902+0000","last_became_active":"2024-05-10T04:51:57.175321+0000","last_became_peered":"2024-05-10T04:51:57.175321+0000","last_unstale":"2024-05-10T04:51:57.770902+0000","last_undegraded":"2024-05-10T04:51:57.770902+0000","last_fullsized":"2024-05-10T04:51:57.770902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:55.866371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146693+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T04:51:57.146693+0000","last_peered":"2024-05-10T04:51:57.146693+0000","last_clean":"2024-05-10T04:51:57.146693+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T04:51:57.146693+0000","last_undegraded":"2024-05-10T04:51:57.146693+0000","last_fullsized":"2024-05-10T04:51:57.146693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142418+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T04:51:57.142418+0000","last_peered":"2024-05-10T04:51:57.142418+0000","last_clean":"2024-05-10T04:51:57.142418+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T04:51:57.142418+0000","last_undegraded":"2024-05-10T04:51:57.142418+0000","last_fullsized":"2024-05-10T04:51:57.142418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773586+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T04:51:57.773586+0000","last_peered":"2024-05-10T04:51:57.773586+0000","last_clean":"2024-05-10T04:51:57.773586+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T04:51:57.773586+0000","last_undegraded":"2024-05-10T04:51:57.773586+0000","last_fullsized":"2024-05-10T04:51:57.773586+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167516+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T04:51:57.167516+0000","last_peered":"2024-05-10T04:51:57.167516+0000","last_clean":"2024-05-10T04:51:57.167516+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T04:51:57.167516+0000","last_undegraded":"2024-05-10T04:51:57.167516+0000","last_fullsized":"2024-05-10T04:51:57.167516+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165279+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T04:51:57.165279+0000","last_peered":"2024-05-10T04:51:57.165279+0000","last_clean":"2024-05-10T04:51:57.165279+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T04:51:57.165279+0000","last_undegraded":"2024-05-10T04:51:57.165279+0000","last_fullsized":"2024-05-10T04:51:57.165279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787071+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T04:51:57.787071+0000","last_peered":"2024-05-10T04:51:57.787071+0000","last_clean":"2024-05-10T04:51:57.787071+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T04:51:57.787071+0000","last_undegraded":"2024-05-10T04:51:57.787071+0000","last_fullsized":"2024-05-10T04:51:57.787071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158867+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T04:51:57.158867+0000","last_peered":"2024-05-10T04:51:57.158867+0000","last_clean":"2024-05-10T04:51:57.158867+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T04:51:57.158867+0000","last_undegraded":"2024-05-10T04:51:57.158867+0000","last_fullsized":"2024-05-10T04:51:57.158867+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173508+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T04:51:57.173508+0000","last_peered":"2024-05-10T04:51:57.173508+0000","last_clean":"2024-05-10T04:51:57.173508+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T04:51:57.173508+0000","last_undegraded":"2024-05-10T04:51:57.173508+0000","last_fullsized":"2024-05-10T04:51:57.173508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138787+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T04:51:58.138787+0000","last_peered":"2024-05-10T04:51:58.138787+0000","last_clean":"2024-05-10T04:51:58.138787+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T04:51:58.138787+0000","last_undegraded":"2024-05-10T04:51:58.138787+0000","last_fullsized":"2024-05-10T04:51:58.138787+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148696+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T04:51:57.148696+0000","last_peered":"2024-05-10T04:51:57.148696+0000","last_clean":"2024-05-10T04:51:57.148696+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T04:51:57.148696+0000","last_undegraded":"2024-05-10T04:51:57.148696+0000","last_fullsized":"2024-05-10T04:51:57.148696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160203+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T04:51:57.160203+0000","last_peered":"2024-05-10T04:51:57.160203+0000","last_clean":"2024-05-10T04:51:57.160203+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T04:51:57.160203+0000","last_undegraded":"2024-05-10T04:51:57.160203+0000","last_fullsized":"2024-05-10T04:51:57.160203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139616+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T04:51:58.139616+0000","last_peered":"2024-05-10T04:51:58.139616+0000","last_clean":"2024-05-10T04:51:58.139616+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T04:51:58.139616+0000","last_undegraded":"2024-05-10T04:51:58.139616+0000","last_fullsized":"2024-05-10T04:51:58.139616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.160118+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T04:51:57.160118+0000","last_peered":"2024-05-10T04:51:57.160118+0000","last_clean":"2024-05-10T04:51:57.160118+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T04:51:57.160118+0000","last_undegraded":"2024-05-10T04:51:57.160118+0000","last_fullsized":"2024-05-10T04:51:57.160118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143146+0000","last_change":"2024-05-10T04:51:52.753381+0000","last_active":"2024-05-10T04:51:57.143146+0000","last_peered":"2024-05-10T04:51:57.143146+0000","last_clean":"2024-05-10T04:51:57.143146+0000","last_became_active":"2024-05-10T04:51:52.753069+0000","last_became_peered":"2024-05-10T04:51:52.753069+0000","last_unstale":"2024-05-10T04:51:57.143146+0000","last_undegraded":"2024-05-10T04:51:57.143146+0000","last_fullsized":"2024-05-10T04:51:57.143146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773410+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T04:51:57.773410+0000","last_peered":"2024-05-10T04:51:57.773410+0000","last_clean":"2024-05-10T04:51:57.773410+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T04:51:57.773410+0000","last_undegraded":"2024-05-10T04:51:57.773410+0000","last_fullsized":"2024-05-10T04:51:57.773410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174304+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T04:51:57.174304+0000","last_peered":"2024-05-10T04:51:57.174304+0000","last_clean":"2024-05-10T04:51:57.174304+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T04:51:57.174304+0000","last_undegraded":"2024-05-10T04:51:57.174304+0000","last_fullsized":"2024-05-10T04:51:57.174304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145744+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T04:51:57.145744+0000","last_peered":"2024-05-10T04:51:57.145744+0000","last_clean":"2024-05-10T04:51:57.145744+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T04:51:57.145744+0000","last_undegraded":"2024-05-10T04:51:57.145744+0000","last_fullsized":"2024-05-10T04:51:57.145744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139068+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T04:51:58.139068+0000","last_peered":"2024-05-10T04:51:58.139068+0000","last_clean":"2024-05-10T04:51:58.139068+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T04:51:58.139068+0000","last_undegraded":"2024-05-10T04:51:58.139068+0000","last_fullsized":"2024-05-10T04:51:58.139068+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:52:13.587589+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T04:52:13.587589+0000","last_peered":"2024-05-10T04:52:13.587589+0000","last_clean":"2024-05-10T04:52:13.587589+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T04:52:13.587589+0000","last_undegraded":"2024-05-10T04:52:13.587589+0000","last_fullsized":"2024-05-10T04:52:13.587589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3796,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218710+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T04:51:57.218710+0000","last_peered":"2024-05-10T04:51:57.218710+0000","last_clean":"2024-05-10T04:51:57.218710+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T04:51:57.218710+0000","last_undegraded":"2024-05-10T04:51:57.218710+0000","last_fullsized":"2024-05-10T04:51:57.218710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140198+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T04:51:58.140198+0000","last_peered":"2024-05-10T04:51:58.140198+0000","last_clean":"2024-05-10T04:51:58.140198+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T04:51:58.140198+0000","last_undegraded":"2024-05-10T04:51:58.140198+0000","last_fullsized":"2024-05-10T04:51:58.140198+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.143030+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T04:51:57.143030+0000","last_peered":"2024-05-10T04:51:57.143030+0000","last_clean":"2024-05-10T04:51:57.143030+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T04:51:57.143030+0000","last_undegraded":"2024-05-10T04:51:57.143030+0000","last_fullsized":"2024-05-10T04:51:57.143030+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141996+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T04:51:57.141996+0000","last_peered":"2024-05-10T04:51:57.141996+0000","last_clean":"2024-05-10T04:51:57.141996+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T04:51:57.141996+0000","last_undegraded":"2024-05-10T04:51:57.141996+0000","last_fullsized":"2024-05-10T04:51:57.141996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140050+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T04:51:58.140050+0000","last_peered":"2024-05-10T04:51:58.140050+0000","last_clean":"2024-05-10T04:51:58.140050+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T04:51:58.140050+0000","last_undegraded":"2024-05-10T04:51:58.140050+0000","last_fullsized":"2024-05-10T04:51:58.140050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158654+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T04:51:57.158654+0000","last_peered":"2024-05-10T04:51:57.158654+0000","last_clean":"2024-05-10T04:51:57.158654+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T04:51:57.158654+0000","last_undegraded":"2024-05-10T04:51:57.158654+0000","last_fullsized":"2024-05-10T04:51:57.158654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215369+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T04:51:57.215369+0000","last_peered":"2024-05-10T04:51:57.215369+0000","last_clean":"2024-05-10T04:51:57.215369+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T04:51:57.215369+0000","last_undegraded":"2024-05-10T04:51:57.215369+0000","last_fullsized":"2024-05-10T04:51:57.215369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.140671+0000","last_change":"2024-05-10T04:51:57.220214+0000","last_active":"2024-05-10T04:51:58.140671+0000","last_peered":"2024-05-10T04:51:58.140671+0000","last_clean":"2024-05-10T04:51:58.140671+0000","last_became_active":"2024-05-10T04:51:57.219512+0000","last_became_peered":"2024-05-10T04:51:57.219512+0000","last_unstale":"2024-05-10T04:51:58.140671+0000","last_undegraded":"2024-05-10T04:51:58.140671+0000","last_fullsized":"2024-05-10T04:51:58.140671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:41.778039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148801+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T04:51:57.148801+0000","last_peered":"2024-05-10T04:51:57.148801+0000","last_clean":"2024-05-10T04:51:57.148801+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T04:51:57.148801+0000","last_undegraded":"2024-05-10T04:51:57.148801+0000","last_fullsized":"2024-05-10T04:51:57.148801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145710+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T04:51:57.145710+0000","last_peered":"2024-05-10T04:51:57.145710+0000","last_clean":"2024-05-10T04:51:57.145710+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T04:51:57.145710+0000","last_undegraded":"2024-05-10T04:51:57.145710+0000","last_fullsized":"2024-05-10T04:51:57.145710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786825+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T04:51:57.786825+0000","last_peered":"2024-05-10T04:51:57.786825+0000","last_clean":"2024-05-10T04:51:57.786825+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T04:51:57.786825+0000","last_undegraded":"2024-05-10T04:51:57.786825+0000","last_fullsized":"2024-05-10T04:51:57.786825+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138766+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T04:51:57.138766+0000","last_peered":"2024-05-10T04:51:57.138766+0000","last_clean":"2024-05-10T04:51:57.138766+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T04:51:57.138766+0000","last_undegraded":"2024-05-10T04:51:57.138766+0000","last_fullsized":"2024-05-10T04:51:57.138766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.217588+0000","last_change":"2024-05-10T04:51:52.773374+0000","last_active":"2024-05-10T04:51:57.217588+0000","last_peered":"2024-05-10T04:51:57.217588+0000","last_clean":"2024-05-10T04:51:57.217588+0000","last_became_active":"2024-05-10T04:51:52.773109+0000","last_became_peered":"2024-05-10T04:51:52.773109+0000","last_unstale":"2024-05-10T04:51:57.217588+0000","last_undegraded":"2024-05-10T04:51:57.217588+0000","last_fullsized":"2024-05-10T04:51:57.217588+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:34.386904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773863+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T04:51:57.773863+0000","last_peered":"2024-05-10T04:51:57.773863+0000","last_clean":"2024-05-10T04:51:57.773863+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T04:51:57.773863+0000","last_undegraded":"2024-05-10T04:51:57.773863+0000","last_fullsized":"2024-05-10T04:51:57.773863+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144228+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T04:51:57.144228+0000","last_peered":"2024-05-10T04:51:57.144228+0000","last_clean":"2024-05-10T04:51:57.144228+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T04:51:57.144228+0000","last_undegraded":"2024-05-10T04:51:57.144228+0000","last_fullsized":"2024-05-10T04:51:57.144228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218635+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T04:51:57.218635+0000","last_peered":"2024-05-10T04:51:57.218635+0000","last_clean":"2024-05-10T04:51:57.218635+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T04:51:57.218635+0000","last_undegraded":"2024-05-10T04:51:57.218635+0000","last_fullsized":"2024-05-10T04:51:57.218635+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138952+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T04:51:58.138952+0000","last_peered":"2024-05-10T04:51:58.138952+0000","last_clean":"2024-05-10T04:51:58.138952+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T04:51:58.138952+0000","last_undegraded":"2024-05-10T04:51:58.138952+0000","last_fullsized":"2024-05-10T04:51:58.138952+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173824+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T04:51:57.173824+0000","last_peered":"2024-05-10T04:51:57.173824+0000","last_clean":"2024-05-10T04:51:57.173824+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T04:51:57.173824+0000","last_undegraded":"2024-05-10T04:51:57.173824+0000","last_fullsized":"2024-05-10T04:51:57.173824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159946+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T04:51:57.159946+0000","last_peered":"2024-05-10T04:51:57.159946+0000","last_clean":"2024-05-10T04:51:57.159946+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T04:51:57.159946+0000","last_undegraded":"2024-05-10T04:51:57.159946+0000","last_fullsized":"2024-05-10T04:51:57.159946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138685+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T04:51:58.138685+0000","last_peered":"2024-05-10T04:51:58.138685+0000","last_clean":"2024-05-10T04:51:58.138685+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T04:51:58.138685+0000","last_undegraded":"2024-05-10T04:51:58.138685+0000","last_fullsized":"2024-05-10T04:51:58.138685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158550+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T04:51:57.158550+0000","last_peered":"2024-05-10T04:51:57.158550+0000","last_clean":"2024-05-10T04:51:57.158550+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T04:51:57.158550+0000","last_undegraded":"2024-05-10T04:51:57.158550+0000","last_fullsized":"2024-05-10T04:51:57.158550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145115+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T04:51:57.145115+0000","last_peered":"2024-05-10T04:51:57.145115+0000","last_clean":"2024-05-10T04:51:57.145115+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T04:51:57.145115+0000","last_undegraded":"2024-05-10T04:51:57.145115+0000","last_fullsized":"2024-05-10T04:51:57.145115+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139840+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T04:51:58.139840+0000","last_peered":"2024-05-10T04:51:58.139840+0000","last_clean":"2024-05-10T04:51:58.139840+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T04:51:58.139840+0000","last_undegraded":"2024-05-10T04:51:58.139840+0000","last_fullsized":"2024-05-10T04:51:58.139840+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173195+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T04:51:57.173195+0000","last_peered":"2024-05-10T04:51:57.173195+0000","last_clean":"2024-05-10T04:51:57.173195+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T04:51:57.173195+0000","last_undegraded":"2024-05-10T04:51:57.173195+0000","last_fullsized":"2024-05-10T04:51:57.173195+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138457+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T04:51:57.138457+0000","last_peered":"2024-05-10T04:51:57.138457+0000","last_clean":"2024-05-10T04:51:57.138457+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T04:51:57.138457+0000","last_undegraded":"2024-05-10T04:51:57.138457+0000","last_fullsized":"2024-05-10T04:51:57.138457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772271+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T04:51:57.772271+0000","last_peered":"2024-05-10T04:51:57.772271+0000","last_clean":"2024-05-10T04:51:57.772271+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T04:51:57.772271+0000","last_undegraded":"2024-05-10T04:51:57.772271+0000","last_fullsized":"2024-05-10T04:51:57.772271+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167290+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T04:51:57.167290+0000","last_peered":"2024-05-10T04:51:57.167290+0000","last_clean":"2024-05-10T04:51:57.167290+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T04:51:57.167290+0000","last_undegraded":"2024-05-10T04:51:57.167290+0000","last_fullsized":"2024-05-10T04:51:57.167290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158794+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T04:51:57.158794+0000","last_peered":"2024-05-10T04:51:57.158794+0000","last_clean":"2024-05-10T04:51:57.158794+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T04:51:57.158794+0000","last_undegraded":"2024-05-10T04:51:57.158794+0000","last_fullsized":"2024-05-10T04:51:57.158794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214929+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T04:51:57.214929+0000","last_peered":"2024-05-10T04:51:57.214929+0000","last_clean":"2024-05-10T04:51:57.214929+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T04:51:57.214929+0000","last_undegraded":"2024-05-10T04:51:57.214929+0000","last_fullsized":"2024-05-10T04:51:57.214929+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786989+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T04:51:57.786989+0000","last_peered":"2024-05-10T04:51:57.786989+0000","last_clean":"2024-05-10T04:51:57.786989+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T04:51:57.786989+0000","last_undegraded":"2024-05-10T04:51:57.786989+0000","last_fullsized":"2024-05-10T04:51:57.786989+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.141828+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T04:51:57.141828+0000","last_peered":"2024-05-10T04:51:57.141828+0000","last_clean":"2024-05-10T04:51:57.141828+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T04:51:57.141828+0000","last_undegraded":"2024-05-10T04:51:57.141828+0000","last_fullsized":"2024-05-10T04:51:57.141828+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215071+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T04:51:57.215071+0000","last_peered":"2024-05-10T04:51:57.215071+0000","last_clean":"2024-05-10T04:51:57.215071+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T04:51:57.215071+0000","last_undegraded":"2024-05-10T04:51:57.215071+0000","last_fullsized":"2024-05-10T04:51:57.215071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.786742+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T04:51:57.786742+0000","last_peered":"2024-05-10T04:51:57.786742+0000","last_clean":"2024-05-10T04:51:57.786742+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T04:51:57.786742+0000","last_undegraded":"2024-05-10T04:51:57.786742+0000","last_fullsized":"2024-05-10T04:51:57.786742+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218062+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T04:51:57.218062+0000","last_peered":"2024-05-10T04:51:57.218062+0000","last_clean":"2024-05-10T04:51:57.218062+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T04:51:57.218062+0000","last_undegraded":"2024-05-10T04:51:57.218062+0000","last_fullsized":"2024-05-10T04:51:57.218062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174509+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T04:51:57.174509+0000","last_peered":"2024-05-10T04:51:57.174509+0000","last_clean":"2024-05-10T04:51:57.174509+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T04:51:57.174509+0000","last_undegraded":"2024-05-10T04:51:57.174509+0000","last_fullsized":"2024-05-10T04:51:57.174509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138706+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T04:51:58.138706+0000","last_peered":"2024-05-10T04:51:58.138706+0000","last_clean":"2024-05-10T04:51:58.138706+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T04:51:58.138706+0000","last_undegraded":"2024-05-10T04:51:58.138706+0000","last_fullsized":"2024-05-10T04:51:58.138706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174200+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T04:51:57.174200+0000","last_peered":"2024-05-10T04:51:57.174200+0000","last_clean":"2024-05-10T04:51:57.174200+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T04:51:57.174200+0000","last_undegraded":"2024-05-10T04:51:57.174200+0000","last_fullsized":"2024-05-10T04:51:57.174200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172446+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T04:51:57.172446+0000","last_peered":"2024-05-10T04:51:57.172446+0000","last_clean":"2024-05-10T04:51:57.172446+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T04:51:57.172446+0000","last_undegraded":"2024-05-10T04:51:57.172446+0000","last_fullsized":"2024-05-10T04:51:57.172446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773872+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T04:51:57.773872+0000","last_peered":"2024-05-10T04:51:57.773872+0000","last_clean":"2024-05-10T04:51:57.773872+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T04:51:57.773872+0000","last_undegraded":"2024-05-10T04:51:57.773872+0000","last_fullsized":"2024-05-10T04:51:57.773872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148508+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T04:51:57.148508+0000","last_peered":"2024-05-10T04:51:57.148508+0000","last_clean":"2024-05-10T04:51:57.148508+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T04:51:57.148508+0000","last_undegraded":"2024-05-10T04:51:57.148508+0000","last_fullsized":"2024-05-10T04:51:57.148508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.145749+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T04:51:57.145749+0000","last_peered":"2024-05-10T04:51:57.145749+0000","last_clean":"2024-05-10T04:51:57.145749+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T04:51:57.145749+0000","last_undegraded":"2024-05-10T04:51:57.145749+0000","last_fullsized":"2024-05-10T04:51:57.145749+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773762+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T04:51:57.773762+0000","last_peered":"2024-05-10T04:51:57.773762+0000","last_clean":"2024-05-10T04:51:57.773762+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T04:51:57.773762+0000","last_undegraded":"2024-05-10T04:51:57.773762+0000","last_fullsized":"2024-05-10T04:51:57.773762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.214825+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T04:51:57.214825+0000","last_peered":"2024-05-10T04:51:57.214825+0000","last_clean":"2024-05-10T04:51:57.214825+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T04:51:57.214825+0000","last_undegraded":"2024-05-10T04:51:57.214825+0000","last_fullsized":"2024-05-10T04:51:57.214825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.144036+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T04:51:57.144036+0000","last_peered":"2024-05-10T04:51:57.144036+0000","last_clean":"2024-05-10T04:51:57.144036+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T04:51:57.144036+0000","last_undegraded":"2024-05-10T04:51:57.144036+0000","last_fullsized":"2024-05-10T04:51:57.144036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.139976+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T04:51:58.139976+0000","last_peered":"2024-05-10T04:51:58.139976+0000","last_clean":"2024-05-10T04:51:58.139976+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T04:51:58.139976+0000","last_undegraded":"2024-05-10T04:51:58.139976+0000","last_fullsized":"2024-05-10T04:51:58.139976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173379+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T04:51:57.173379+0000","last_peered":"2024-05-10T04:51:57.173379+0000","last_clean":"2024-05-10T04:51:57.173379+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T04:51:57.173379+0000","last_undegraded":"2024-05-10T04:51:57.173379+0000","last_fullsized":"2024-05-10T04:51:57.173379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.165406+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T04:51:57.165406+0000","last_peered":"2024-05-10T04:51:57.165406+0000","last_clean":"2024-05-10T04:51:57.165406+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T04:51:57.165406+0000","last_undegraded":"2024-05-10T04:51:57.165406+0000","last_fullsized":"2024-05-10T04:51:57.165406+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773193+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T04:51:57.773193+0000","last_peered":"2024-05-10T04:51:57.773193+0000","last_clean":"2024-05-10T04:51:57.773193+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T04:51:57.773193+0000","last_undegraded":"2024-05-10T04:51:57.773193+0000","last_fullsized":"2024-05-10T04:51:57.773193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.173739+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T04:51:57.173739+0000","last_peered":"2024-05-10T04:51:57.173739+0000","last_clean":"2024-05-10T04:51:57.173739+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T04:51:57.173739+0000","last_undegraded":"2024-05-10T04:51:57.173739+0000","last_fullsized":"2024-05-10T04:51:57.173739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169440+0000","last_change":"2024-05-10T04:51:52.747037+0000","last_active":"2024-05-10T04:51:57.169440+0000","last_peered":"2024-05-10T04:51:57.169440+0000","last_clean":"2024-05-10T04:51:57.169440+0000","last_became_active":"2024-05-10T04:51:52.746784+0000","last_became_peered":"2024-05-10T04:51:52.746784+0000","last_unstale":"2024-05-10T04:51:57.169440+0000","last_undegraded":"2024-05-10T04:51:57.169440+0000","last_fullsized":"2024-05-10T04:51:57.169440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:35:49.520262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.773616+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T04:51:57.773616+0000","last_peered":"2024-05-10T04:51:57.773616+0000","last_clean":"2024-05-10T04:51:57.773616+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T04:51:57.773616+0000","last_undegraded":"2024-05-10T04:51:57.773616+0000","last_fullsized":"2024-05-10T04:51:57.773616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.215454+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T04:51:57.215454+0000","last_peered":"2024-05-10T04:51:57.215454+0000","last_clean":"2024-05-10T04:51:57.215454+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T04:51:57.215454+0000","last_undegraded":"2024-05-10T04:51:57.215454+0000","last_fullsized":"2024-05-10T04:51:57.215454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146811+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T04:51:57.146811+0000","last_peered":"2024-05-10T04:51:57.146811+0000","last_clean":"2024-05-10T04:51:57.146811+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T04:51:57.146811+0000","last_undegraded":"2024-05-10T04:51:57.146811+0000","last_fullsized":"2024-05-10T04:51:57.146811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.772398+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T04:51:57.772398+0000","last_peered":"2024-05-10T04:51:57.772398+0000","last_clean":"2024-05-10T04:51:57.772398+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T04:51:57.772398+0000","last_undegraded":"2024-05-10T04:51:57.772398+0000","last_fullsized":"2024-05-10T04:51:57.772398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138613+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T04:51:57.138613+0000","last_peered":"2024-05-10T04:51:57.138613+0000","last_clean":"2024-05-10T04:51:57.138613+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T04:51:57.138613+0000","last_undegraded":"2024-05-10T04:51:57.138613+0000","last_fullsized":"2024-05-10T04:51:57.138613+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.218593+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T04:51:57.218593+0000","last_peered":"2024-05-10T04:51:57.218593+0000","last_clean":"2024-05-10T04:51:57.218593+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T04:51:57.218593+0000","last_undegraded":"2024-05-10T04:51:57.218593+0000","last_fullsized":"2024-05-10T04:51:57.218593+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.787056+0000","last_change":"2024-05-10T04:51:57.160643+0000","last_active":"2024-05-10T04:51:57.787056+0000","last_peered":"2024-05-10T04:51:57.787056+0000","last_clean":"2024-05-10T04:51:57.787056+0000","last_became_active":"2024-05-10T04:51:57.160203+0000","last_became_peered":"2024-05-10T04:51:57.160203+0000","last_unstale":"2024-05-10T04:51:57.787056+0000","last_undegraded":"2024-05-10T04:51:57.787056+0000","last_fullsized":"2024-05-10T04:51:57.787056+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174457+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T04:51:57.174457+0000","last_peered":"2024-05-10T04:51:57.174457+0000","last_clean":"2024-05-10T04:51:57.174457+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T04:51:57.174457+0000","last_undegraded":"2024-05-10T04:51:57.174457+0000","last_fullsized":"2024-05-10T04:51:57.174457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159470+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T04:51:57.159470+0000","last_peered":"2024-05-10T04:51:57.159470+0000","last_clean":"2024-05-10T04:51:57.159470+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T04:51:57.159470+0000","last_undegraded":"2024-05-10T04:51:57.159470+0000","last_fullsized":"2024-05-10T04:51:57.159470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-10T04:51:58.138927+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T04:51:58.138927+0000","last_peered":"2024-05-10T04:51:58.138927+0000","last_clean":"2024-05-10T04:51:58.138927+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T04:51:58.138927+0000","last_undegraded":"2024-05-10T04:51:58.138927+0000","last_fullsized":"2024-05-10T04:51:58.138927+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138575+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T04:51:57.138575+0000","last_peered":"2024-05-10T04:51:57.138575+0000","last_clean":"2024-05-10T04:51:57.138575+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T04:51:57.138575+0000","last_undegraded":"2024-05-10T04:51:57.138575+0000","last_fullsized":"2024-05-10T04:51:57.138575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.219349+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T04:51:57.219349+0000","last_peered":"2024-05-10T04:51:57.219349+0000","last_clean":"2024-05-10T04:51:57.219349+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T04:51:57.219349+0000","last_undegraded":"2024-05-10T04:51:57.219349+0000","last_fullsized":"2024-05-10T04:51:57.219349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.146339+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T04:51:57.146339+0000","last_peered":"2024-05-10T04:51:57.146339+0000","last_clean":"2024-05-10T04:51:57.146339+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T04:51:57.146339+0000","last_undegraded":"2024-05-10T04:51:57.146339+0000","last_fullsized":"2024-05-10T04:51:57.146339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.138542+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T04:51:57.138542+0000","last_peered":"2024-05-10T04:51:57.138542+0000","last_clean":"2024-05-10T04:51:57.138542+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T04:51:57.138542+0000","last_undegraded":"2024-05-10T04:51:57.138542+0000","last_fullsized":"2024-05-10T04:51:57.138542+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158869+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T04:51:57.158869+0000","last_peered":"2024-05-10T04:51:57.158869+0000","last_clean":"2024-05-10T04:51:57.158869+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T04:51:57.158869+0000","last_undegraded":"2024-05-10T04:51:57.158869+0000","last_fullsized":"2024-05-10T04:51:57.158869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142526+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T04:51:57.142526+0000","last_peered":"2024-05-10T04:51:57.142526+0000","last_clean":"2024-05-10T04:51:57.142526+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T04:51:57.142526+0000","last_undegraded":"2024-05-10T04:51:57.142526+0000","last_fullsized":"2024-05-10T04:51:57.142526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.169312+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T04:51:57.169312+0000","last_peered":"2024-05-10T04:51:57.169312+0000","last_clean":"2024-05-10T04:51:57.169312+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T04:51:57.169312+0000","last_undegraded":"2024-05-10T04:51:57.169312+0000","last_fullsized":"2024-05-10T04:51:57.169312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.174203+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T04:51:57.174203+0000","last_peered":"2024-05-10T04:51:57.174203+0000","last_clean":"2024-05-10T04:51:57.174203+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T04:51:57.174203+0000","last_undegraded":"2024-05-10T04:51:57.174203+0000","last_fullsized":"2024-05-10T04:51:57.174203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148326+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T04:51:57.148326+0000","last_peered":"2024-05-10T04:51:57.148326+0000","last_clean":"2024-05-10T04:51:57.148326+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T04:51:57.148326+0000","last_undegraded":"2024-05-10T04:51:57.148326+0000","last_fullsized":"2024-05-10T04:51:57.148326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.172553+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T04:51:57.172553+0000","last_peered":"2024-05-10T04:51:57.172553+0000","last_clean":"2024-05-10T04:51:57.172553+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T04:51:57.172553+0000","last_undegraded":"2024-05-10T04:51:57.172553+0000","last_fullsized":"2024-05-10T04:51:57.172553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.158805+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T04:51:57.158805+0000","last_peered":"2024-05-10T04:51:57.158805+0000","last_clean":"2024-05-10T04:51:57.158805+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T04:51:57.158805+0000","last_undegraded":"2024-05-10T04:51:57.158805+0000","last_fullsized":"2024-05-10T04:51:57.158805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.167615+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T04:51:57.167615+0000","last_peered":"2024-05-10T04:51:57.167615+0000","last_clean":"2024-05-10T04:51:57.167615+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T04:51:57.167615+0000","last_undegraded":"2024-05-10T04:51:57.167615+0000","last_fullsized":"2024-05-10T04:51:57.167615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.159086+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T04:51:57.159086+0000","last_peered":"2024-05-10T04:51:57.159086+0000","last_clean":"2024-05-10T04:51:57.159086+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T04:51:57.159086+0000","last_undegraded":"2024-05-10T04:51:57.159086+0000","last_fullsized":"2024-05-10T04:51:57.159086+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.142627+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T04:51:57.142627+0000","last_peered":"2024-05-10T04:51:57.142627+0000","last_clean":"2024-05-10T04:51:57.142627+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T04:51:57.142627+0000","last_undegraded":"2024-05-10T04:51:57.142627+0000","last_fullsized":"2024-05-10T04:51:57.142627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-10T04:51:57.148006+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T04:51:57.148006+0000","last_peered":"2024-05-10T04:51:57.148006+0000","last_clean":"2024-05-10T04:51:57.148006+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T04:51:57.148006+0000","last_undegraded":"2024-05-10T04:51:57.148006+0000","last_fullsized":"2024-05-10T04:51:57.148006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4594,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542155,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":698680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9380000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":111526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":880640,"data_stored":698736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":274432,"data_stored":107730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":282624,"data_stored":107890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]}]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":286720,"data_stored":111526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":107856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":107820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T04:52:26.255 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T04:52:26.255 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-10T04:52:26.255 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-10T04:52:26.255 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-10T04:52:26.557 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.557+0000 7fe5aee00700 1 Processor -- start 2024-05-10T04:52:26.558 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.557+0000 7fe5aee00700 1 -- start start 2024-05-10T04:52:26.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.558+0000 7fe5aee00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5a80c49e0 0x7fe5a8156160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.558+0000 7fe5aee00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a80c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.559 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5aee00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5a80c1940 con 0x7fe5a806cd90 2024-05-10T04:52:26.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5aee00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5a80c2e20 con 0x7fe5a80c49e0 2024-05-10T04:52:26.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5aee00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80c6cb0 con 0x7fe5a8152b50 2024-05-10T04:52:26.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5a7e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe5a80c49e0 0x7fe5a8156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5a7400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a80c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5ace00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fe5a806cd90 0x7fe5a8158b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46198/0 (socket says 172.21.15.47:46198) 2024-05-10T04:52:26.560 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5ace00700 1 -- 172.21.15.47:0/1222255926 learned_addr learned my addr 172.21.15.47:0/1222255926 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.559+0000 7fe5a6a00700 1 -- 172.21.15.47:0/1222255926 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427059318 0 0) 0x7fe5a80c1940 con 0x7fe5a806cd90 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a6a00700 1 -- 172.21.15.47:0/1222255926 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe58c0035b0 con 0x7fe5a806cd90 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a7e00700 1 -- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 msgr2=0x7fe5a80c53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a7e00700 1 --2- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a80c53d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a7e00700 1 -- 172.21.15.47:0/1222255926 >> v1:172.21.15.117:6789/0 conn(0x7fe5a806cd90 legacy=0x7fe5a8158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a7e00700 1 -- 172.21.15.47:0/1222255926 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8152f60 con 0x7fe5a80c49e0 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a7400700 1 --2- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a80c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a7e00700 1 --2- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a8156160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe598009840 tx=0x7fe598009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf96506b6c9da6ff server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a6a00700 1 -- 172.21.15.47:0/1222255926 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011830 con 0x7fe5a80c49e0 2024-05-10T04:52:26.562 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a6a00700 1 -- 172.21.15.47:0/1222255926 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe598011990 con 0x7fe5a80c49e0 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.560+0000 7fe5a6a00700 1 -- 172.21.15.47:0/1222255926 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598011d20 con 0x7fe5a80c49e0 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 -- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 msgr2=0x7fe5a8156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 --2- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a8156160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe598009840 tx=0x7fe598009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 -- 172.21.15.47:0/1222255926 shutdown_connections 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 --2- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a8156160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 --2- 172.21.15.47:0/1222255926 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a80c53d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 -- 172.21.15.47:0/1222255926 >> 172.21.15.47:0/1222255926 conn(0x7fe5a80cac30 msgr2=0x7fe5a80cb040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 -- 172.21.15.47:0/1222255926 shutdown_connections 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.561+0000 7fe5aee00700 1 -- 172.21.15.47:0/1222255926 wait complete. 2024-05-10T04:52:26.563 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.563+0000 7fe5aee00700 1 Processor -- start 2024-05-10T04:52:26.564 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.563+0000 7fe5aee00700 1 -- start start 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5aee00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 0x7fe5a814c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5aee00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a81ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5aee00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a814afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5aee00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a81ec0f0 con 0x7fe5a806cd90 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5aee00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a80c8ae0 con 0x7fe5a80c49e0 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5aee00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5a814b4e0 con 0x7fe5a8152b50 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5a7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 0x7fe5a814c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5a7e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 0x7fe5a814c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37006/0 (socket says 172.21.15.47:37006) 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5a7e00700 1 -- 172.21.15.47:0/3179953925 learned_addr learned my addr 172.21.15.47:0/3179953925 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5a7400700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a81ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.565+0000 7fe5ace00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a814afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.568 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5a7e00700 1 -- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 msgr2=0x7fe5a814afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5a7e00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a814afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5a7e00700 1 -- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 msgr2=0x7fe5a81ef8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5a7e00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a81ef8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5a7e00700 1 -- 172.21.15.47:0/3179953925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5900094a0 con 0x7fe5a806cd90 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5ace00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5a7e00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 0x7fe5a814c330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5980090b0 tx=0x7fe598004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5980036a0 con 0x7fe5a806cd90 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59801e070 con 0x7fe5a806cd90 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5980094a0 con 0x7fe5a806cd90 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe598003a60 con 0x7fe5a806cd90 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.566+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5a814b910 con 0x7fe5a806cd90 2024-05-10T04:52:26.569 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.567+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5a814c930 con 0x7fe5a806cd90 2024-05-10T04:52:26.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.568+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe598003bc0 con 0x7fe5a806cd90 2024-05-10T04:52:26.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.570+0000 7fe59fe00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe58406ac90 0x7fe58406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:26.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.570+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe59808a5d0 con 0x7fe5a806cd90 2024-05-10T04:52:26.570 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.570+0000 7fe5a7400700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe58406ac90 0x7fe58406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:26.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.571+0000 7fe5a7400700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe58406ac90 0x7fe58406d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5a81e3020 tx=0x7fe590009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:26.575 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.575+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe598055430 con 0x7fe5a806cd90 2024-05-10T04:52:26.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.833+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5a8074720 con 0x7fe5a806cd90 2024-05-10T04:52:26.834 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.834+0000 7fe59fe00700 1 -- 172.21.15.47:0/3179953925 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe598058a50 con 0x7fe5a806cd90 2024-05-10T04:52:26.835 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:26.835 INFO:teuthology.orchestra.run.smithi047.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe58406ac90 msgr2=0x7fe58406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe58406ac90 0x7fe58406d1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe5a81e3020 tx=0x7fe590009210 comp rx=0 tx=0).stop 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 msgr2=0x7fe5a814c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 0x7fe5a814c330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe5980090b0 tx=0x7fe598004750 comp rx=0 tx=0).stop 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 shutdown_connections 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe58406ac90 0x7fe58406d1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe5a8152b50 0x7fe5a814afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe5a806cd90 0x7fe5a814c330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.837 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 --2- 172.21.15.47:0/3179953925 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe5a80c49e0 0x7fe5a81ef8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 >> 172.21.15.47:0/3179953925 conn(0x7fe5a80cac30 msgr2=0x7fe5a814f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 shutdown_connections 2024-05-10T04:52:26.838 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:26.836+0000 7fe5aee00700 1 -- 172.21.15.47:0/3179953925 wait complete. 2024-05-10T04:52:26.865 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-10T04:52:26.865 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:27.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.134+0000 7f35e4000700 1 Processor -- start 2024-05-10T04:52:27.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.134+0000 7f35e4000700 1 -- start start 2024-05-10T04:52:27.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e4000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f35dc152be0 0x7f35dc155e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e4000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc0c62d0 con 0x7f35dc0ca900 2024-05-10T04:52:27.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e4000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35dc0cb120 con 0x7f35dc0cad10 2024-05-10T04:52:27.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e4000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35dc1563c0 con 0x7f35dc152be0 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e0c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f35dc0ca900 0x7f35dc0c37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43658/0 (socket says 172.21.15.47:43658) 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e0c00700 1 -- 172.21.15.47:0/1808853306 learned_addr learned my addr 172.21.15.47:0/1808853306 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.136+0000 7f35e1600700 1 --2- 172.21.15.47:0/1808853306 >> v2:172.21.15.117:3300/0 conn(0x7f35dc152be0 0x7f35dc155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564435002 0 0) 0x7f35dc0c62d0 con 0x7f35dc0ca900 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35c40035b0 con 0x7f35dc0ca900 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174423906 0 0) 0x7f35dc0cb120 con 0x7f35dc0cad10 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35dc0c62d0 con 0x7f35dc0cad10 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35e1600700 1 -- 172.21.15.47:0/1808853306 >> v1:172.21.15.117:6789/0 conn(0x7f35dc0cad10 legacy=0x7f35dc0c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35e1600700 1 -- 172.21.15.47:0/1808853306 >> v1:172.21.15.47:6789/0 conn(0x7f35dc0ca900 legacy=0x7f35dc0c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35e1600700 1 -- 172.21.15.47:0/1808853306 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35dc0c56c0 con 0x7f35dc152be0 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35e1600700 1 --2- 172.21.15.47:0/1808853306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc155e80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009840 tx=0x7f35d0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc14b67cf761853f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0011830 con 0x7f35dc152be0 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d0011990 con 0x7f35dc152be0 2024-05-10T04:52:27.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.137+0000 7f35dbe00700 1 -- 172.21.15.47:0/1808853306 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0011d00 con 0x7f35dc152be0 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 -- 172.21.15.47:0/1808853306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 msgr2=0x7f35dc155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 --2- 172.21.15.47:0/1808853306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc155e80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009840 tx=0x7f35d0009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 -- 172.21.15.47:0/1808853306 shutdown_connections 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 --2- 172.21.15.47:0/1808853306 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc155e80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 -- 172.21.15.47:0/1808853306 >> 172.21.15.47:0/1808853306 conn(0x7f35dc0c7630 msgr2=0x7f35dc0c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 -- 172.21.15.47:0/1808853306 shutdown_connections 2024-05-10T04:52:27.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.138+0000 7f35e4000700 1 -- 172.21.15.47:0/1808853306 wait complete. 2024-05-10T04:52:27.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.140+0000 7f35e4000700 1 Processor -- start 2024-05-10T04:52:27.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.141+0000 7f35e4000700 1 -- start start 2024-05-10T04:52:27.145 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e4000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 0x7f35dc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e4000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35dc0cad10 0x7f35dc1eefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e4000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e4000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc157000 con 0x7f35dc0ca900 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e4000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc158920 con 0x7f35dc152be0 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e4000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35dc1583d0 con 0x7f35dc0cad10 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e1600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 0x7f35dc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e1600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 0x7f35dc0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37018/0 (socket says 172.21.15.47:37018) 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e1600700 1 -- 172.21.15.47:0/3996573524 learned_addr learned my addr 172.21.15.47:0/3996573524 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e0c00700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35dc0cad10 0x7f35dc1eefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.142+0000 7f35e2000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e1600700 1 -- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35dc0cad10 msgr2=0x7f35dc1eefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e1600700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35dc0cad10 0x7f35dc1eefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e1600700 1 -- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 msgr2=0x7f35dc149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e1600700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e1600700 1 -- 172.21.15.47:0/3996573524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d00094a0 con 0x7f35dc0ca900 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e2000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e0c00700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35dc0cad10 0x7f35dc1eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e1600700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 0x7f35dc0c99d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009fd0 tx=0x7f35d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d00045c0 con 0x7f35dc0ca900 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d001e070 con 0x7f35dc0ca900 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d0003900 con 0x7f35dc0ca900 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35dc0c1890 con 0x7f35dc0ca900 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.143+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35dc1efa00 con 0x7f35dc0ca900 2024-05-10T04:52:27.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.144+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35dc074720 con 0x7f35dc0ca900 2024-05-10T04:52:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.146+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f35d0003a60 con 0x7f35dc0ca900 2024-05-10T04:52:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.147+0000 7f35d9600700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f35bc06ac90 0x7f35bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.147+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f35d008a9f0 con 0x7f35dc0ca900 2024-05-10T04:52:27.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.148+0000 7f35e0c00700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f35bc06ac90 0x7f35bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.148+0000 7f35e0c00700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f35bc06ac90 0x7f35bc06d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35dc1560e0 tx=0x7f35c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.150+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f35d0055950 con 0x7f35dc0ca900 2024-05-10T04:52:27.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.365+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35dc14db90 con 0x7f35dc0ca900 2024-05-10T04:52:27.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.366+0000 7f35d9600700 1 -- 172.21.15.47:0/3996573524 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f35d0058f70 con 0x7f35dc0ca900 2024-05-10T04:52:27.368 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:27.368 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:27.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f35bc06ac90 msgr2=0x7f35bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f35bc06ac90 0x7f35bc06d1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35dc1560e0 tx=0x7f35c8009040 comp rx=0 tx=0).stop 2024-05-10T04:52:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 msgr2=0x7f35dc0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 0x7f35dc0c99d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f35d0009fd0 tx=0x7f35d0004750 comp rx=0 tx=0).stop 2024-05-10T04:52:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 shutdown_connections 2024-05-10T04:52:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f35dc152be0 0x7f35dc149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f35dc0ca900 0x7f35dc0c99d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f35bc06ac90 0x7f35bc06d1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 --2- 172.21.15.47:0/3996573524 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f35dc0cad10 0x7f35dc1eefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 >> 172.21.15.47:0/3996573524 conn(0x7f35dc0c7630 msgr2=0x7f35dc14f2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:27.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 shutdown_connections 2024-05-10T04:52:27.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.369+0000 7f35e4000700 1 -- 172.21.15.47:0/3996573524 wait complete. 2024-05-10T04:52:27.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T04:52:27.396 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:52:27.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.668+0000 7f1713200700 1 Processor -- start 2024-05-10T04:52:27.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.668+0000 7f1713200700 1 -- start start 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1713200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140ca120 0x7f1714152980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1713200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f17141594a0 0x7f17140c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1713200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1714155da0 con 0x7f17140c59a0 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1713200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1714159080 con 0x7f17141594a0 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1713200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17141562d0 con 0x7f17140ca120 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1712800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f17141594a0 0x7f17140c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1712800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f17141594a0 0x7f17140c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37024/0 (socket says 172.21.15.47:37024) 2024-05-10T04:52:27.672 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.670+0000 7f1712800700 1 -- 172.21.15.47:0/2686854940 learned_addr learned my addr 172.21.15.47:0/2686854940 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1711400700 1 --2- 172.21.15.47:0/2686854940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140ca120 0x7f1714152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1712800700 1 -- 172.21.15.47:0/2686854940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140ca120 msgr2=0x7f1714152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1712800700 1 --2- 172.21.15.47:0/2686854940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140ca120 0x7f1714152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1712800700 1 -- 172.21.15.47:0/2686854940 >> v1:172.21.15.117:6789/0 conn(0x7f17140c59a0 legacy=0x7f17140c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1712800700 1 -- 172.21.15.47:0/2686854940 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17140c6cc0 con 0x7f17141594a0 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1712800700 1 --2- 172.21.15.47:0/2686854940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17141594a0 0x7f17140c70e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f170c009e50 tx=0x7f170c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b046a17c9910257e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1710a00700 1 -- 172.21.15.47:0/2686854940 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00e070 con 0x7f17141594a0 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1710a00700 1 -- 172.21.15.47:0/2686854940 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c00b9c0 con 0x7f17141594a0 2024-05-10T04:52:27.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.671+0000 7f1710a00700 1 -- 172.21.15.47:0/2686854940 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c00bd70 con 0x7f17141594a0 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 -- 172.21.15.47:0/2686854940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17141594a0 msgr2=0x7f17140c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 --2- 172.21.15.47:0/2686854940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17141594a0 0x7f17140c70e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f170c009e50 tx=0x7f170c00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 -- 172.21.15.47:0/2686854940 shutdown_connections 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 --2- 172.21.15.47:0/2686854940 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17141594a0 0x7f17140c70e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 --2- 172.21.15.47:0/2686854940 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17140ca120 0x7f1714152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 -- 172.21.15.47:0/2686854940 >> 172.21.15.47:0/2686854940 conn(0x7f17140ac320 msgr2=0x7f17140ac730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 -- 172.21.15.47:0/2686854940 shutdown_connections 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.672+0000 7f1713200700 1 -- 172.21.15.47:0/2686854940 wait complete. 2024-05-10T04:52:27.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.674+0000 7f1713200700 1 Processor -- start 2024-05-10T04:52:27.676 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.674+0000 7f1713200700 1 -- start start 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1713200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 0x7f17141576a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1713200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140ca120 0x7f17141eb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1713200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17141594a0 0x7f1714151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1713200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1714154140 con 0x7f17140c59a0 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1713200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17141eba60 con 0x7f17140ca120 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1713200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1714153c10 con 0x7f17141594a0 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 0x7f17141576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 0x7f17141576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37026/0 (socket says 172.21.15.47:37026) 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 -- 172.21.15.47:0/3404135448 learned_addr learned my addr 172.21.15.47:0/3404135448 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711400700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140ca120 0x7f17141eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 -- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17141594a0 msgr2=0x7f1714151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1712800700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17141594a0 0x7f1714151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17141594a0 0x7f1714151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 -- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140ca120 msgr2=0x7f17141eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140ca120 0x7f17141eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711e00700 1 -- 172.21.15.47:0/3404135448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f170c009b30 con 0x7f17140c59a0 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1711400700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140ca120 0x7f17141eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.676+0000 7f1712800700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17141594a0 0x7f1714151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.677+0000 7f1711e00700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 0x7f17141576a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f170400c420 tx=0x7f170400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.677+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17040052d0 con 0x7f17140c59a0 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.677+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1704005430 con 0x7f17140c59a0 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.677+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17141eeea0 con 0x7f17140c59a0 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.677+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17040038c0 con 0x7f17140c59a0 2024-05-10T04:52:27.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.677+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1714153e60 con 0x7f17140c59a0 2024-05-10T04:52:27.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.678+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17141ee6f0 con 0x7f17140c59a0 2024-05-10T04:52:27.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.679+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1704003a20 con 0x7f17140c59a0 2024-05-10T04:52:27.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.680+0000 7f170a000700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f16f406acc0 0x7f16f406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:27.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.680+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1704088b00 con 0x7f17140c59a0 2024-05-10T04:52:27.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.681+0000 7f1711400700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f16f406acc0 0x7f16f406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:27.682 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.681+0000 7f1711400700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f16f406acc0 0x7f16f406d1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1714067f40 tx=0x7f1700008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:27.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.685+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f17141ee6f0 con 0x7f17140c59a0 2024-05-10T04:52:27.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.901+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17141ee6f0 con 0x7f17140c59a0 2024-05-10T04:52:27.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.902+0000 7f170a000700 1 -- 172.21.15.47:0/3404135448 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17141ee6f0 con 0x7f17140c59a0 2024-05-10T04:52:27.903 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:52:27.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f16f406acc0 msgr2=0x7f16f406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f16f406acc0 0x7f16f406d1d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1714067f40 tx=0x7f1700008040 comp rx=0 tx=0).stop 2024-05-10T04:52:27.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 msgr2=0x7f17141576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:27.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 0x7f17141576a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f170400c420 tx=0x7f170400c7e0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 shutdown_connections 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f16f406acc0 0x7f16f406d1d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f17141594a0 0x7f1714151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f17140c59a0 0x7f17141576a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 --2- 172.21.15.47:0/3404135448 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f17140ca120 0x7f17141eb180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 >> 172.21.15.47:0/3404135448 conn(0x7f17140ac320 msgr2=0x7f17140c8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 shutdown_connections 2024-05-10T04:52:27.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:27.904+0000 7f1713200700 1 -- 172.21.15.47:0/3404135448 wait complete. 2024-05-10T04:52:27.931 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:52:28.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.202+0000 7f1b5f400700 1 Processor -- start 2024-05-10T04:52:28.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.203+0000 7f1b5f400700 1 -- start start 2024-05-10T04:52:28.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.204+0000 7f1b5f400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1b58152bb0 0x7f1b580c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.204+0000 7f1b5f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 0x7f1b5806c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.204+0000 7f1b5f400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b5806d640 con 0x7f1b580c6cc0 2024-05-10T04:52:28.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.204+0000 7f1b5f400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b58152fc0 con 0x7f1b58152bb0 2024-05-10T04:52:28.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.204+0000 7f1b5f400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580c9800 con 0x7f1b5806bdb0 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b5ca00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1b580c6cc0 0x7f1b580c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43672/0 (socket says 172.21.15.47:43672) 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b5ca00700 1 -- 172.21.15.47:0/3683466357 learned_addr learned my addr 172.21.15.47:0/3683466357 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57e00700 1 --2- 172.21.15.47:0/3683466357 >> v2:172.21.15.117:3300/0 conn(0x7f1b58152bb0 0x7f1b580c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b5d400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 0x7f1b5806c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035201452 0 0) 0x7f1b5806d640 con 0x7f1b580c6cc0 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b400035b0 con 0x7f1b580c6cc0 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1760422683 0 0) 0x7f1b400035b0 con 0x7f1b580c6cc0 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 msgr2=0x7f1b5806c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 0x7f1b5806c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 >> v2:172.21.15.117:3300/0 conn(0x7f1b58152bb0 msgr2=0x7f1b580c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 --2- 172.21.15.47:0/3683466357 >> v2:172.21.15.117:3300/0 conn(0x7f1b58152bb0 0x7f1b580c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5806c700 con 0x7f1b580c6cc0 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f1b4c001670 con 0x7f1b580c6cc0 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.205+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 >> v1:172.21.15.47:6789/0 conn(0x7f1b580c6cc0 legacy=0x7f1b580c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b40003a00 0x7f1b40003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b40004850 0x7f1b40004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 0x7f1b40005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b58152fc0 con 0x7f1b40004850 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580c9800 con 0x7f1b40003a00 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4000bbd0 con 0x7f1b5806bdb0 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 --2- 172.21.15.47:0/3683466357 >> v2:172.21.15.117:3300/0 conn(0x7f1b58152bb0 0x7f1b580c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b40004850 0x7f1b40004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b5ca00700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b40003a00 0x7f1b40003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b5d400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 0x7f1b40005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 -- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 msgr2=0x7f1b40005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:28.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b5806bdb0 0x7f1b40005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 -- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b40003a00 msgr2=0x7f1b40003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b40003a00 0x7f1b40003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.206+0000 7f1b57e00700 1 -- 172.21.15.47:0/3683466357 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b400035b0 con 0x7f1b40004850 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.207+0000 7f1b57e00700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b40004850 0x7f1b40004c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009ce0 tx=0x7f1b40005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa688e34e3020d50 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.207+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004030 con 0x7f1b40004850 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.207+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b44004190 con 0x7f1b40004850 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.207+0000 7f1b57400700 1 -- 172.21.15.47:0/3683466357 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004500 con 0x7f1b40004850 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5f400700 1 -- 172.21.15.47:0/3683466357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b40004850 msgr2=0x7f1b40004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5f400700 1 --2- 172.21.15.47:0/3683466357 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b40004850 0x7f1b40004c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1b44009ce0 tx=0x7f1b40005880 comp rx=0 tx=0).stop 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5d400700 1 -- 172.21.15.47:0/3683466357 reap_dead start 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5f400700 1 -- 172.21.15.47:0/3683466357 shutdown_connections 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5f400700 1 -- 172.21.15.47:0/3683466357 >> 172.21.15.47:0/3683466357 conn(0x7f1b580ca960 msgr2=0x7f1b580cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5f400700 1 -- 172.21.15.47:0/3683466357 shutdown_connections 2024-05-10T04:52:28.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.208+0000 7f1b5f400700 1 -- 172.21.15.47:0/3683466357 wait complete. 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.210+0000 7f1b5f400700 1 Processor -- start 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.210+0000 7f1b5f400700 1 -- start start 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5f400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b40004850 0x7f1b581eb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 0x7f1b580c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5f400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b58156130 0x7f1b580bec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5f400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580be5f0 con 0x7f1b58155d20 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5f400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b580c1ff0 con 0x7f1b58156130 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5f400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b581ebac0 con 0x7f1b40004850 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 0x7f1b580c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 0x7f1b580c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37036/0 (socket says 172.21.15.47:37036) 2024-05-10T04:52:28.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 -- 172.21.15.47:0/973087112 learned_addr learned my addr 172.21.15.47:0/973087112 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5ca00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b40004850 0x7f1b581eb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5d400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b58156130 0x7f1b580bec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 -- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b40004850 msgr2=0x7f1b581eb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b40004850 0x7f1b581eb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 -- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b58156130 msgr2=0x7f1b580bec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b58156130 0x7f1b580bec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b57e00700 1 -- 172.21.15.47:0/973087112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b580ab600 con 0x7f1b58155d20 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.212+0000 7f1b5ca00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b40004850 0x7f1b581eb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:28.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.213+0000 7f1b57e00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 0x7f1b580c4780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e4b0 tx=0x7f1b440047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.213+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44020070 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.213+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4400ee10 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.213+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b580c1d40 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.213+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b44004030 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.213+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b580c2240 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.214+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b58074720 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.215+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b44003af0 con 0x7f1b58155d20 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.216+0000 7f1b54c00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1b3806acc0 0x7f1b3806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.216+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b4408ac50 con 0x7f1b58155d20 2024-05-10T04:52:28.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.217+0000 7f1b5ca00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1b3806acc0 0x7f1b3806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.220 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.217+0000 7f1b5ca00700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1b3806acc0 0x7f1b3806d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001860 tx=0x7f1b4c001dd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:28.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.221+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1b44055b30 con 0x7f1b58155d20 2024-05-10T04:52:28.438 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.437+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b580be5f0 con 0x7f1b58155d20 2024-05-10T04:52:28.439 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.438+0000 7f1b54c00700 1 -- 172.21.15.47:0/973087112 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b4402a020 con 0x7f1b58155d20 2024-05-10T04:52:28.439 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.440+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1b3806acc0 msgr2=0x7f1b3806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.440+0000 7f1b5f400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1b3806acc0 0x7f1b3806d1d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c001860 tx=0x7f1b4c001dd0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.440+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 msgr2=0x7f1b580c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 0x7f1b580c4780 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b4400e4b0 tx=0x7f1b440047c0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 shutdown_connections 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1b58156130 0x7f1b580bec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1b3806acc0 0x7f1b3806d1d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1b40004850 0x7f1b581eb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 --2- 172.21.15.47:0/973087112 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1b58155d20 0x7f1b580c4780 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 >> 172.21.15.47:0/973087112 conn(0x7f1b580ca960 msgr2=0x7f1b580c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 shutdown_connections 2024-05-10T04:52:28.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.441+0000 7f1b5f400700 1 -- 172.21.15.47:0/973087112 wait complete. 2024-05-10T04:52:28.467 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:52:28.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.738+0000 7fcacd200700 1 Processor -- start 2024-05-10T04:52:28.739 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.738+0000 7fcacd200700 1 -- start start 2024-05-10T04:52:28.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcacd200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fcac80c6d90 0x7fcac8155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcacd200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcac80cad00 0x7fcac80c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcacd200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcac80c31e0 con 0x7fcac80ca8f0 2024-05-10T04:52:28.741 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcacd200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80c50e0 con 0x7fcac80cad00 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcacd200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcac80cb110 con 0x7fcac80c6d90 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcac6800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcac80cad00 0x7fcac80c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcac6800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fcac80cad00 0x7fcac80c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37046/0 (socket says 172.21.15.47:37046) 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcac6800700 1 -- 172.21.15.47:0/1797684624 learned_addr learned my addr 172.21.15.47:0/1797684624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.740+0000 7fcac5e00700 1 --2- 172.21.15.47:0/1797684624 >> v2:172.21.15.117:3300/0 conn(0x7fcac80c6d90 0x7fcac8155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac6800700 1 -- 172.21.15.47:0/1797684624 >> v2:172.21.15.117:3300/0 conn(0x7fcac80c6d90 msgr2=0x7fcac8155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac6800700 1 --2- 172.21.15.47:0/1797684624 >> v2:172.21.15.117:3300/0 conn(0x7fcac80c6d90 0x7fcac8155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac6800700 1 -- 172.21.15.47:0/1797684624 >> v1:172.21.15.117:6789/0 conn(0x7fcac80ca8f0 legacy=0x7fcac80c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac6800700 1 -- 172.21.15.47:0/1797684624 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac80c5340 con 0x7fcac80cad00 2024-05-10T04:52:28.742 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac6800700 1 --2- 172.21.15.47:0/1797684624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac80c3d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcac80cb430 tx=0x7fcac000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=394843c509922400 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac5400700 1 -- 172.21.15.47:0/1797684624 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000e070 con 0x7fcac80cad00 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac5400700 1 -- 172.21.15.47:0/1797684624 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000b910 con 0x7fcac80cad00 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.741+0000 7fcac5400700 1 -- 172.21.15.47:0/1797684624 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000bcc0 con 0x7fcac80cad00 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 -- 172.21.15.47:0/1797684624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 msgr2=0x7fcac80c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 --2- 172.21.15.47:0/1797684624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac80c3d10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcac80cb430 tx=0x7fcac000b330 comp rx=0 tx=0).stop 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 -- 172.21.15.47:0/1797684624 shutdown_connections 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 --2- 172.21.15.47:0/1797684624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac80c3d10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 --2- 172.21.15.47:0/1797684624 >> v2:172.21.15.117:3300/0 conn(0x7fcac80c6d90 0x7fcac8155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 -- 172.21.15.47:0/1797684624 >> 172.21.15.47:0/1797684624 conn(0x7fcac80c7620 msgr2=0x7fcac80c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 -- 172.21.15.47:0/1797684624 shutdown_connections 2024-05-10T04:52:28.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.742+0000 7fcacd200700 1 -- 172.21.15.47:0/1797684624 wait complete. 2024-05-10T04:52:28.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.745+0000 7fcacd200700 1 Processor -- start 2024-05-10T04:52:28.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.745+0000 7fcacd200700 1 -- start start 2024-05-10T04:52:28.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcacd200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80c6d90 0x7fcac80c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcacd200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80ca8f0 0x7fcac80c0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcacd200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac814a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcacd200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81eceb0 con 0x7fcac80cad00 2024-05-10T04:52:28.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcacd200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81ec470 con 0x7fcac80ca8f0 2024-05-10T04:52:28.748 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcacd200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcac81ec190 con 0x7fcac80c6d90 2024-05-10T04:52:28.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcac6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac814a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcac6800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac814a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37052/0 (socket says 172.21.15.47:37052) 2024-05-10T04:52:28.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcac6800700 1 -- 172.21.15.47:0/2171893071 learned_addr learned my addr 172.21.15.47:0/2171893071 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:28.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcabfe00700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80ca8f0 0x7fcac80c0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.747+0000 7fcac5e00700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80c6d90 0x7fcac80c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcac6800700 1 -- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80c6d90 msgr2=0x7fcac80c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcac6800700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80c6d90 0x7fcac80c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcac6800700 1 -- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80ca8f0 msgr2=0x7fcac80c0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcac6800700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80ca8f0 0x7fcac80c0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcac6800700 1 -- 172.21.15.47:0/2171893071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0009b30 con 0x7fcac80cad00 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcac6800700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac814a0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcac0012000 tx=0x7fcac0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac0004880 con 0x7fcac80cad00 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac00099b0 con 0x7fcac80cad00 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac001b670 con 0x7fcac80cad00 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.748+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac80bfcb0 con 0x7fcac80cad00 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.749+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac80c0270 con 0x7fcac80cad00 2024-05-10T04:52:28.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.750+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcac80c0430 con 0x7fcac80cad00 2024-05-10T04:52:28.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.750+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcac001b7d0 con 0x7fcac80cad00 2024-05-10T04:52:28.754 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.752+0000 7fcabe000700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaa406acc0 0x7fcaa406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:28.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.752+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcac008ada0 con 0x7fcac80cad00 2024-05-10T04:52:28.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.752+0000 7fcac5e00700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaa406acc0 0x7fcaa406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:28.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.753+0000 7fcac5e00700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaa406acc0 0x7fcaa406d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcac808cbb0 tx=0x7fcab8009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:28.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.757+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fcac0055c80 con 0x7fcac80cad00 2024-05-10T04:52:28.972 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.971+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcac80c05e0 con 0x7fcac80cad00 2024-05-10T04:52:28.973 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.972+0000 7fcabe000700 1 -- 172.21.15.47:0/2171893071 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcac001f020 con 0x7fcac80cad00 2024-05-10T04:52:28.973 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T04:52:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaa406acc0 msgr2=0x7fcaa406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaa406acc0 0x7fcaa406d1d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcac808cbb0 tx=0x7fcab8009210 comp rx=0 tx=0).stop 2024-05-10T04:52:28.975 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 msgr2=0x7fcac814a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac814a0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fcac0012000 tx=0x7fcac0004ad0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 shutdown_connections 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fcac80cad00 0x7fcac814a0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fcaa406acc0 0x7fcaa406d1d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fcac80c6d90 0x7fcac80c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 --2- 172.21.15.47:0/2171893071 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fcac80ca8f0 0x7fcac80c0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.974+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 >> 172.21.15.47:0/2171893071 conn(0x7fcac80c7620 msgr2=0x7fcac8154ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.975+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 shutdown_connections 2024-05-10T04:52:28.976 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:28.975+0000 7fcacd200700 1 -- 172.21.15.47:0/2171893071 wait complete. 2024-05-10T04:52:29.001 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T04:52:29.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.276+0000 7fac47c00700 1 Processor -- start 2024-05-10T04:52:29.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.276+0000 7fac47c00700 1 -- start start 2024-05-10T04:52:29.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.277+0000 7fac47c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fac40152bb0 0x7fac400c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.277+0000 7fac47c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fac4006bdb0 0x7fac4006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.277+0000 7fac47c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac4006d640 con 0x7fac400c6cc0 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.277+0000 7fac47c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac40152fc0 con 0x7fac4006bdb0 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.277+0000 7fac47c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac400c9800 con 0x7fac40152bb0 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45200700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fac400c6cc0 0x7fac400c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43682/0 (socket says 172.21.15.47:43682) 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45200700 1 -- 172.21.15.47:0/1078015266 learned_addr learned my addr 172.21.15.47:0/1078015266 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45c00700 1 --2- 172.21.15.47:0/1078015266 >> v2:172.21.15.47:3300/0 conn(0x7fac4006bdb0 0x7fac4006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac3fe00700 1 --2- 172.21.15.47:0/1078015266 >> v2:172.21.15.117:3300/0 conn(0x7fac40152bb0 0x7fac400c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45c00700 1 -- 172.21.15.47:0/1078015266 >> v2:172.21.15.117:3300/0 conn(0x7fac40152bb0 msgr2=0x7fac400c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45c00700 1 --2- 172.21.15.47:0/1078015266 >> v2:172.21.15.117:3300/0 conn(0x7fac40152bb0 0x7fac400c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45c00700 1 -- 172.21.15.47:0/1078015266 >> v1:172.21.15.47:6789/0 conn(0x7fac400c6cc0 legacy=0x7fac400c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.278+0000 7fac45c00700 1 -- 172.21.15.47:0/1078015266 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac4006c700 con 0x7fac4006bdb0 2024-05-10T04:52:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.279+0000 7fac45c00700 1 --2- 172.21.15.47:0/1078015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4006c1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fac400ca790 tx=0x7fac3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71862c00f94ef7fb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.279+0000 7fac3f400700 1 -- 172.21.15.47:0/1078015266 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3800e070 con 0x7fac4006bdb0 2024-05-10T04:52:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.279+0000 7fac3f400700 1 -- 172.21.15.47:0/1078015266 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3800bb20 con 0x7fac4006bdb0 2024-05-10T04:52:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.279+0000 7fac3f400700 1 -- 172.21.15.47:0/1078015266 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac38012430 con 0x7fac4006bdb0 2024-05-10T04:52:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.279+0000 7fac47c00700 1 -- 172.21.15.47:0/1078015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 msgr2=0x7fac4006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.281 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.279+0000 7fac47c00700 1 --2- 172.21.15.47:0/1078015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4006c1c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fac400ca790 tx=0x7fac3800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:29.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.280+0000 7fac47c00700 1 -- 172.21.15.47:0/1078015266 shutdown_connections 2024-05-10T04:52:29.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.280+0000 7fac47c00700 1 --2- 172.21.15.47:0/1078015266 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4006c1c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.280+0000 7fac47c00700 1 --2- 172.21.15.47:0/1078015266 >> v2:172.21.15.117:3300/0 conn(0x7fac40152bb0 0x7fac400c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.280+0000 7fac47c00700 1 -- 172.21.15.47:0/1078015266 >> 172.21.15.47:0/1078015266 conn(0x7fac400ca960 msgr2=0x7fac400cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:29.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.280+0000 7fac47c00700 1 -- 172.21.15.47:0/1078015266 shutdown_connections 2024-05-10T04:52:29.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.280+0000 7fac47c00700 1 -- 172.21.15.47:0/1078015266 wait complete. 2024-05-10T04:52:29.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.282+0000 7fac47c00700 1 Processor -- start 2024-05-10T04:52:29.284 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.282+0000 7fac47c00700 1 -- start start 2024-05-10T04:52:29.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac47c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4014a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac47c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac400c6cc0 0x7fac401476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac47c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac40152bb0 0x7fac400ab5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac47c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac401547e0 con 0x7fac4006bdb0 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac47c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac401ee8d0 con 0x7fac400c6cc0 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac47c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac401484e0 con 0x7fac40152bb0 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4014a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.289 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4014a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37064/0 (socket says 172.21.15.47:37064) 2024-05-10T04:52:29.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac3fe00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac400c6cc0 0x7fac401476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 -- 172.21.15.47:0/3905456578 learned_addr learned my addr 172.21.15.47:0/3905456578 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:29.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac40152bb0 0x7fac400ab5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 -- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac40152bb0 msgr2=0x7fac400ab5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac40152bb0 0x7fac400ab5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.290 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 -- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac400c6cc0 msgr2=0x7fac401476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac400c6cc0 0x7fac401476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.284+0000 7fac45200700 1 -- 172.21.15.47:0/3905456578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac38009a70 con 0x7fac4006bdb0 2024-05-10T04:52:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.285+0000 7fac45200700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4014a760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac3400c480 tx=0x7fac3400c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.286+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac34005d70 con 0x7fac4006bdb0 2024-05-10T04:52:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.286+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac40148720 con 0x7fac4006bdb0 2024-05-10T04:52:29.291 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.287+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3400ce90 con 0x7fac4006bdb0 2024-05-10T04:52:29.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.287+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac340072d0 con 0x7fac4006bdb0 2024-05-10T04:52:29.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.287+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac40148310 con 0x7fac4006bdb0 2024-05-10T04:52:29.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.288+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac40154a80 con 0x7fac4006bdb0 2024-05-10T04:52:29.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.289+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac34007430 con 0x7fac4006bdb0 2024-05-10T04:52:29.293 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.290+0000 7fac3cc00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fac2006ac90 0x7fac2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.290+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac34088980 con 0x7fac4006bdb0 2024-05-10T04:52:29.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.290+0000 7fac3fe00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fac2006ac90 0x7fac2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.291+0000 7fac3fe00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fac2006ac90 0x7fac2006d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac400ca640 tx=0x7fac2c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:29.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.294+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fac34053810 con 0x7fac4006bdb0 2024-05-10T04:52:29.508 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.508+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fac400c5830 con 0x7fac4006bdb0 2024-05-10T04:52:29.509 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.508+0000 7fac3cc00700 1 -- 172.21.15.47:0/3905456578 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fac34056e30 con 0x7fac4006bdb0 2024-05-10T04:52:29.509 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.510+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fac2006ac90 msgr2=0x7fac2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.510+0000 7fac47c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fac2006ac90 0x7fac2006d1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac400ca640 tx=0x7fac2c009210 comp rx=0 tx=0).stop 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.510+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 msgr2=0x7fac4014a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.510+0000 7fac47c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4014a760 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fac3400c480 tx=0x7fac3400c790 comp rx=0 tx=0).stop 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 shutdown_connections 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fac2006ac90 0x7fac2006d1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fac40152bb0 0x7fac400ab5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fac4006bdb0 0x7fac4014a760 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 --2- 172.21.15.47:0/3905456578 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fac400c6cc0 0x7fac401476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 >> 172.21.15.47:0/3905456578 conn(0x7fac400ca960 msgr2=0x7fac401521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:29.512 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 shutdown_connections 2024-05-10T04:52:29.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.511+0000 7fac47c00700 1 -- 172.21.15.47:0/3905456578 wait complete. 2024-05-10T04:52:29.539 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:29.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.807+0000 7f468b200700 1 Processor -- start 2024-05-10T04:52:29.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.807+0000 7f468b200700 1 -- start start 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468b200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46840c5a00 0x7f46841529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468b200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46841588d0 0x7f4684158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468b200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468406cbd0 con 0x7f4684155360 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468b200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4684159660 con 0x7f46841588d0 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468b200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468406ce20 con 0x7f46840c5a00 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f4689400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46841588d0 0x7f4684158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f4689e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46840c5a00 0x7f46841529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468a800700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f4684155360 0x7f4684155770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:46220/0 (socket says 172.21.15.47:46220) 2024-05-10T04:52:29.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.809+0000 7f468a800700 1 -- 172.21.15.47:0/2290408373 learned_addr learned my addr 172.21.15.47:0/2290408373 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4689400700 1 -- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46840c5a00 msgr2=0x7f46841529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4689400700 1 --2- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46840c5a00 0x7f46841529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4689400700 1 -- 172.21.15.47:0/2290408373 >> v1:172.21.15.117:6789/0 conn(0x7f4684155360 legacy=0x7f4684155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4689400700 1 -- 172.21.15.47:0/2290408373 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468406d100 con 0x7f46841588d0 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4689400700 1 --2- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46841588d0 0x7f4684158ce0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4674009840 tx=0x7f4674009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a0d49ab54a2857 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4688a00700 1 -- 172.21.15.47:0/2290408373 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674011830 con 0x7f46841588d0 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4688a00700 1 -- 172.21.15.47:0/2290408373 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4674011990 con 0x7f46841588d0 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.810+0000 7f4688a00700 1 -- 172.21.15.47:0/2290408373 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4674011d20 con 0x7f46841588d0 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 -- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46841588d0 msgr2=0x7f4684158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 --2- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46841588d0 0x7f4684158ce0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4674009840 tx=0x7f4674009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 -- 172.21.15.47:0/2290408373 shutdown_connections 2024-05-10T04:52:29.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 --2- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46840c5a00 0x7f46841529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 --2- 172.21.15.47:0/2290408373 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46841588d0 0x7f4684158ce0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 -- 172.21.15.47:0/2290408373 >> 172.21.15.47:0/2290408373 conn(0x7f46840ca700 msgr2=0x7f46840cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:29.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 -- 172.21.15.47:0/2290408373 shutdown_connections 2024-05-10T04:52:29.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.811+0000 7f468b200700 1 -- 172.21.15.47:0/2290408373 wait complete. 2024-05-10T04:52:29.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.813+0000 7f468b200700 1 Processor -- start 2024-05-10T04:52:29.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.813+0000 7f468b200700 1 -- start start 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468b200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 0x7f46840ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468b200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4684155360 0x7f46841ebce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468b200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46841588d0 0x7f46840c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468b200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46840c4a30 con 0x7f46840c5a00 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468b200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4684151c10 con 0x7f4684155360 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468b200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46841eb2d0 con 0x7f46841588d0 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 0x7f46840ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 0x7f46840ae140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37074/0 (socket says 172.21.15.47:37074) 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 -- 172.21.15.47:0/2325324553 learned_addr learned my addr 172.21.15.47:0/2325324553 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689400700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4684155360 0x7f46841ebce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f468a800700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46841588d0 0x7f46840c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 -- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46841588d0 msgr2=0x7f46840c1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46841588d0 0x7f46840c1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 -- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4684155360 msgr2=0x7f46841ebce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.815+0000 7f4689e00700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4684155360 0x7f46841ebce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f4689e00700 1 -- 172.21.15.47:0/2325324553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740094a0 con 0x7f46840c5a00 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f468a800700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46841588d0 0x7f46840c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f4689e00700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 0x7f46840ae140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f467800e8a0 tx=0x7f467800ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678009590 con 0x7f46840c5a00 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800eea0 con 0x7f46840c5a00 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800ca50 con 0x7f46840c5a00 2024-05-10T04:52:29.818 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46840ae710 con 0x7f46840c5a00 2024-05-10T04:52:29.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.816+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4684151d80 con 0x7f46840c5a00 2024-05-10T04:52:29.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.817+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4684074720 con 0x7f46840c5a00 2024-05-10T04:52:29.819 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.818+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f467800cbb0 con 0x7f46840c5a00 2024-05-10T04:52:29.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.820+0000 7f467e000700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f466806ac90 0x7f466806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:29.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.820+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4678089610 con 0x7f46840c5a00 2024-05-10T04:52:29.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.820+0000 7f4689400700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f466806ac90 0x7f466806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:29.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.821+0000 7f4689400700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f466806ac90 0x7f466806d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46840aa1d0 tx=0x7f4674008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:29.825 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:29.825+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f46780544f0 con 0x7f46840c5a00 2024-05-10T04:52:30.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.084+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46840ac070 con 0x7f46840c5a00 2024-05-10T04:52:30.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.084+0000 7f467e000700 1 -- 172.21.15.47:0/2325324553 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f4678057b10 con 0x7f46840c5a00 2024-05-10T04:52:30.086 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:30.086 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:52:17.211312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f466806ac90 msgr2=0x7f466806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f466806ac90 0x7f466806d1a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46840aa1d0 tx=0x7f4674008030 comp rx=0 tx=0).stop 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 msgr2=0x7f46840ae140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 0x7f46840ae140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f467800e8a0 tx=0x7f467800ec60 comp rx=0 tx=0).stop 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 shutdown_connections 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f466806ac90 0x7f466806d1a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46841588d0 0x7f46840c1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46840c5a00 0x7f46840ae140 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 --2- 172.21.15.47:0/2325324553 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f4684155360 0x7f46841ebce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 >> 172.21.15.47:0/2325324553 conn(0x7f46840ca700 msgr2=0x7f4684154ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 shutdown_connections 2024-05-10T04:52:30.088 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.087+0000 7f468b200700 1 -- 172.21.15.47:0/2325324553 wait complete. 2024-05-10T04:52:30.089 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-10T04:52:30.113 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:30.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.382+0000 7f0ff7800700 1 Processor -- start 2024-05-10T04:52:30.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.382+0000 7f0ff7800700 1 -- start start 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff7800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c9440 0x7f0ff0158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff7800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0ff0159050 0x7f0ff015fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff7800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff006c7c0 con 0x7f0ff00c5c40 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff7800700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff006d060 con 0x7f0ff0159050 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff7800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff0159890 con 0x7f0ff00c9440 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff4e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0ff00c5c40 0x7f0ff00c8d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43688/0 (socket says 172.21.15.47:43688) 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff4e00700 1 -- 172.21.15.47:0/1365665842 learned_addr learned my addr 172.21.15.47:0/1365665842 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0ff5800700 1 --2- 172.21.15.47:0/1365665842 >> v2:172.21.15.47:3300/0 conn(0x7f0ff0159050 0x7f0ff015fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.385 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.384+0000 7f0fefe00700 1 --2- 172.21.15.47:0/1365665842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c9440 0x7f0ff0158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0ff5800700 1 -- 172.21.15.47:0/1365665842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c9440 msgr2=0x7f0ff0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0ff5800700 1 --2- 172.21.15.47:0/1365665842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c9440 0x7f0ff0158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0ff5800700 1 -- 172.21.15.47:0/1365665842 >> v1:172.21.15.47:6789/0 conn(0x7f0ff00c5c40 legacy=0x7f0ff00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0ff5800700 1 -- 172.21.15.47:0/1365665842 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff006ca10 con 0x7f0ff0159050 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0fef400700 1 -- 172.21.15.47:0/1365665842 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3650747580 0 0) 0x7f0ff006c7c0 con 0x7f0ff00c5c40 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0ff5800700 1 --2- 172.21.15.47:0/1365665842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff0159050 0x7f0ff015fe40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009d90 tx=0x7f0fe800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bc9b971423ecc2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:30.387 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0fef400700 1 -- 172.21.15.47:0/1365665842 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe800e070 con 0x7f0ff0159050 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0fef400700 1 -- 172.21.15.47:0/1365665842 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe800bb20 con 0x7f0ff0159050 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.385+0000 7f0fef400700 1 -- 172.21.15.47:0/1365665842 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe8012430 con 0x7f0ff0159050 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 -- 172.21.15.47:0/1365665842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff0159050 msgr2=0x7f0ff015fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 --2- 172.21.15.47:0/1365665842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff0159050 0x7f0ff015fe40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009d90 tx=0x7f0fe800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 -- 172.21.15.47:0/1365665842 shutdown_connections 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 --2- 172.21.15.47:0/1365665842 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff0159050 0x7f0ff015fe40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 --2- 172.21.15.47:0/1365665842 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c9440 0x7f0ff0158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 -- 172.21.15.47:0/1365665842 >> 172.21.15.47:0/1365665842 conn(0x7f0ff00ca940 msgr2=0x7f0ff00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 -- 172.21.15.47:0/1365665842 shutdown_connections 2024-05-10T04:52:30.388 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.386+0000 7f0ff7800700 1 -- 172.21.15.47:0/1365665842 wait complete. 2024-05-10T04:52:30.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.389+0000 7f0ff7800700 1 Processor -- start 2024-05-10T04:52:30.390 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.389+0000 7f0ff7800700 1 -- start start 2024-05-10T04:52:30.391 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff7800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c5c40 0x7f0ff0155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff7800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 0x7f0ff0144c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff7800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff0159050 0x7f0ff00c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff7800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00c36d0 con 0x7f0ff00c9440 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff7800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff014efd0 con 0x7f0ff0159050 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff7800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff00c2520 con 0x7f0ff00c5c40 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 0x7f0ff0144c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff4e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c5c40 0x7f0ff0155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 0x7f0ff0144c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:37094/0 (socket says 172.21.15.47:37094) 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 -- 172.21.15.47:0/2193717700 learned_addr learned my addr 172.21.15.47:0/2193717700 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:30.392 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0ff5800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff0159050 0x7f0ff00c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.393 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 -- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c5c40 msgr2=0x7f0ff0155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c5c40 0x7f0ff0155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 -- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff0159050 msgr2=0x7f0ff00c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff0159050 0x7f0ff00c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.391+0000 7f0fefe00700 1 -- 172.21.15.47:0/2193717700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8009a70 con 0x7f0ff00c9440 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.392+0000 7f0fefe00700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 0x7f0ff0144c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00e870 tx=0x7f0fdc00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.392+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc009590 con 0x7f0ff00c9440 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.392+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc013680 con 0x7f0ff00c9440 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.392+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0139f0 con 0x7f0ff00c9440 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.392+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff014f220 con 0x7f0ff00c9440 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.392+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff01ebcd0 con 0x7f0ff00c9440 2024-05-10T04:52:30.394 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.393+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff00b0080 con 0x7f0ff00c9440 2024-05-10T04:52:30.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.394+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0fdc013b50 con 0x7f0ff00c9440 2024-05-10T04:52:30.395 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.395+0000 7f0fecc00700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fd006ac90 0x7f0fd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.395+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0fdc0898b0 con 0x7f0ff00c9440 2024-05-10T04:52:30.396 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.396+0000 7f0ff4e00700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fd006ac90 0x7f0fd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.397 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.396+0000 7f0ff4e00700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fd006ac90 0x7f0fd006d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4000f60 tx=0x7f0fe4007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:30.400 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.400+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0fdc054670 con 0x7f0ff00c9440 2024-05-10T04:52:30.617 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.617+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ff0074720 con 0x7f0ff00c9440 2024-05-10T04:52:30.618 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.618+0000 7f0fecc00700 1 -- 172.21.15.47:0/2193717700 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f0fdc017090 con 0x7f0ff00c9440 2024-05-10T04:52:30.619 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:30.619 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:30.621 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.620+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fd006ac90 msgr2=0x7f0fd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.620+0000 7f0ff7800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fd006ac90 0x7f0fd006d1a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4000f60 tx=0x7f0fe4007e70 comp rx=0 tx=0).stop 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 msgr2=0x7f0ff0144c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 0x7f0ff0144c90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc00e870 tx=0x7f0fdc00eb80 comp rx=0 tx=0).stop 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 shutdown_connections 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0ff0159050 0x7f0ff00c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0fd006ac90 0x7f0fd006d1a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0ff00c5c40 0x7f0ff0155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 --2- 172.21.15.47:0/2193717700 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0ff00c9440 0x7f0ff0144c90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 >> 172.21.15.47:0/2193717700 conn(0x7f0ff00ca940 msgr2=0x7f0ff006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 shutdown_connections 2024-05-10T04:52:30.622 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.621+0000 7f0ff7800700 1 -- 172.21.15.47:0/2193717700 wait complete. 2024-05-10T04:52:30.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T04:52:30.650 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:52:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.920+0000 7f90e3000700 1 Processor -- start 2024-05-10T04:52:30.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.920+0000 7f90e3000700 1 -- start start 2024-05-10T04:52:30.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90e3000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90e3000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90dc06d640 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90e3000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90dc0c9800 con 0x7f90dc06bdb0 2024-05-10T04:52:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90e3000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc152fc0 con 0x7f90dc152bb0 2024-05-10T04:52:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90dbe00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f90dc0c6cc0 0x7f90dc0c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57538/0 (socket says 172.21.15.47:57538) 2024-05-10T04:52:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90dbe00700 1 -- 172.21.15.47:0/3432174806 learned_addr learned my addr 172.21.15.47:0/3432174806 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:30.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90db400700 1 --2- 172.21.15.47:0/3432174806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.924 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90daa00700 1 -- 172.21.15.47:0/3432174806 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492483817 0 0) 0x7f90dc06d640 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.922+0000 7f90daa00700 1 -- 172.21.15.47:0/3432174806 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90c00035b0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90daa00700 1 -- 172.21.15.47:0/3432174806 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3117119213 0 0) 0x7f90dc0c9800 con 0x7f90dc06bdb0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90db400700 1 -- 172.21.15.47:0/3432174806 >> v1:172.21.15.117:6789/0 conn(0x7f90dc06bdb0 legacy=0x7f90dc06c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90db400700 1 -- 172.21.15.47:0/3432174806 >> v1:172.21.15.47:6789/0 conn(0x7f90dc0c6cc0 legacy=0x7f90dc0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90db400700 1 -- 172.21.15.47:0/3432174806 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc0c8910 con 0x7f90dc152bb0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90db400700 1 --2- 172.21.15.47:0/3432174806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc0c5cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009870 tx=0x7f90c8009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99e4192bb4d3341e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90daa00700 1 -- 172.21.15.47:0/3432174806 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8011830 con 0x7f90dc152bb0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90daa00700 1 -- 172.21.15.47:0/3432174806 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c8011990 con 0x7f90dc152bb0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.923+0000 7f90daa00700 1 -- 172.21.15.47:0/3432174806 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8011d20 con 0x7f90dc152bb0 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 -- 172.21.15.47:0/3432174806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 msgr2=0x7f90dc0c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 --2- 172.21.15.47:0/3432174806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc0c5cf0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009870 tx=0x7f90c8009b80 comp rx=0 tx=0).stop 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 -- 172.21.15.47:0/3432174806 shutdown_connections 2024-05-10T04:52:30.925 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 --2- 172.21.15.47:0/3432174806 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc0c5cf0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.926 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 -- 172.21.15.47:0/3432174806 >> 172.21.15.47:0/3432174806 conn(0x7f90dc0ca960 msgr2=0x7f90dc0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 -- 172.21.15.47:0/3432174806 shutdown_connections 2024-05-10T04:52:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.924+0000 7f90e3000700 1 -- 172.21.15.47:0/3432174806 wait complete. 2024-05-10T04:52:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.926+0000 7f90e3000700 1 Processor -- start 2024-05-10T04:52:30.927 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.926+0000 7f90e3000700 1 -- start start 2024-05-10T04:52:30.928 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e3000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90dc06bdb0 0x7f90dc0c4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e3000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 0x7f90dc1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e3000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc1eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e3000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc0c32b0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e3000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc1eae90 con 0x7f90dc06bdb0 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e3000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc0c4970 con 0x7f90dc152bb0 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 0x7f90dc1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 0x7f90dc1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44934/0 (socket says 172.21.15.47:44934) 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 -- 172.21.15.47:0/1205280441 learned_addr learned my addr 172.21.15.47:0/1205280441 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90dbe00700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90dc06bdb0 0x7f90dc0c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.929 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90e1000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc1eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 -- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 msgr2=0x7f90dc1eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc1eb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 -- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90dc06bdb0 msgr2=0x7f90dc0c4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:30.930 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90dc06bdb0 0x7f90dc0c4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90db400700 1 -- 172.21.15.47:0/1205280441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c80094a0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.928+0000 7f90dbe00700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90dc06bdb0 0x7f90dc0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.929+0000 7f90db400700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 0x7f90dc1559a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f90c80097c0 tx=0x7f90c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.929+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c801aa70 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.929+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c801abd0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.929+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80243f0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.929+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc0c0220 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.929+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90dc0c07e0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.931 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.930+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90dc1eb110 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.931+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90c802d450 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.932+0000 7f90d3e00700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90bc06acc0 0x7f90bc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:30.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.932+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90c808a9e0 con 0x7f90dc0c6cc0 2024-05-10T04:52:30.933 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.933+0000 7f90dbe00700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90bc06acc0 0x7f90bc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:30.934 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.933+0000 7f90dbe00700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90bc06acc0 0x7f90bc06d1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005910 tx=0x7f90cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:30.937 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:30.937+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f90c80558c0 con 0x7f90dc0c6cc0 2024-05-10T04:52:31.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.149+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90dc074720 con 0x7f90dc0c6cc0 2024-05-10T04:52:31.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.149+0000 7f90d3e00700 1 -- 172.21.15.47:0/1205280441 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90c80150a0 con 0x7f90dc0c6cc0 2024-05-10T04:52:31.150 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90bc06acc0 msgr2=0x7f90bc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90bc06acc0 0x7f90bc06d1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005910 tx=0x7f90cc009040 comp rx=0 tx=0).stop 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 msgr2=0x7f90dc1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 0x7f90dc1559a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f90c80097c0 tx=0x7f90c8004750 comp rx=0 tx=0).stop 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 shutdown_connections 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f90bc06acc0 0x7f90bc06d1d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f90dc152bb0 0x7f90dc1eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f90dc06bdb0 0x7f90dc0c4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 --2- 172.21.15.47:0/1205280441 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f90dc0c6cc0 0x7f90dc1559a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 >> 172.21.15.47:0/1205280441 conn(0x7f90dc0ca960 msgr2=0x7f90dc151f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 shutdown_connections 2024-05-10T04:52:31.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.152+0000 7f90e3000700 1 -- 172.21.15.47:0/1205280441 wait complete. 2024-05-10T04:52:31.178 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:52:31.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.451+0000 7f1247a00700 1 Processor -- start 2024-05-10T04:52:31.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.451+0000 7f1247a00700 1 -- start start 2024-05-10T04:52:31.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1247a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f12400c5c40 0x7f1240155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1247a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1240152b90 0x7f12400c7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1247a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12400c7eb0 0x7f12400c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1247a00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12401564f0 con 0x7f1240152b90 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1247a00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12401597e0 con 0x7f12400c5c40 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1247a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240158bd0 con 0x7f12400c7eb0 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1240152b90 0x7f12400c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f1240152b90 0x7f12400c7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44944/0 (socket says 172.21.15.47:44944) 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 -- 172.21.15.47:0/2233953637 learned_addr learned my addr 172.21.15.47:0/2233953637 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1245000700 1 --2- 172.21.15.47:0/2233953637 >> v2:172.21.15.117:3300/0 conn(0x7f12400c5c40 0x7f1240155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f1245a00700 1 --2- 172.21.15.47:0/2233953637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12400c7eb0 0x7f12400c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 -- 172.21.15.47:0/2233953637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12400c7eb0 msgr2=0x7f12400c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:31.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 --2- 172.21.15.47:0/2233953637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12400c7eb0 0x7f12400c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 -- 172.21.15.47:0/2233953637 >> v2:172.21.15.117:3300/0 conn(0x7f12400c5c40 msgr2=0x7f1240155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:31.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 --2- 172.21.15.47:0/2233953637 >> v2:172.21.15.117:3300/0 conn(0x7f12400c5c40 0x7f1240155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.453+0000 7f123fe00700 1 -- 172.21.15.47:0/2233953637 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1240158eb0 con 0x7f1240152b90 2024-05-10T04:52:31.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.454+0000 7f123fe00700 1 --2- 172.21.15.47:0/2233953637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1240152b90 0x7f12400c7970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12400aa2a0 tx=0x7f122c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267ca6ff697daf22 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.454+0000 7f123f400700 1 -- 172.21.15.47:0/2233953637 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c011830 con 0x7f1240152b90 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.454+0000 7f123f400700 1 -- 172.21.15.47:0/2233953637 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c011990 con 0x7f1240152b90 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.454+0000 7f123f400700 1 -- 172.21.15.47:0/2233953637 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c011d20 con 0x7f1240152b90 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 -- 172.21.15.47:0/2233953637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1240152b90 msgr2=0x7f12400c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 --2- 172.21.15.47:0/2233953637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1240152b90 0x7f12400c7970 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f12400aa2a0 tx=0x7f122c009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 -- 172.21.15.47:0/2233953637 shutdown_connections 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 --2- 172.21.15.47:0/2233953637 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f12400c7eb0 0x7f12400c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 --2- 172.21.15.47:0/2233953637 >> v2:172.21.15.117:3300/0 conn(0x7f12400c5c40 0x7f1240155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.459 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 --2- 172.21.15.47:0/2233953637 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1240152b90 0x7f12400c7970 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 -- 172.21.15.47:0/2233953637 >> 172.21.15.47:0/2233953637 conn(0x7f12400ac8b0 msgr2=0x7f12400accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:31.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 -- 172.21.15.47:0/2233953637 shutdown_connections 2024-05-10T04:52:31.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.455+0000 7f1247a00700 1 -- 172.21.15.47:0/2233953637 wait complete. 2024-05-10T04:52:31.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.457+0000 7f1247a00700 1 Processor -- start 2024-05-10T04:52:31.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.457+0000 7f1247a00700 1 -- start start 2024-05-10T04:52:31.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1247a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 0x7f124014d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1247a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c7eb0 0x7f12401e1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1247a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240152b90 0x7f124014b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1247a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12401e25a0 con 0x7f12400c5c40 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1247a00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12401555d0 con 0x7f12400c7eb0 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1247a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1240154fc0 con 0x7f1240152b90 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1245000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 0x7f124014d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1245000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 0x7f124014d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44950/0 (socket says 172.21.15.47:44950) 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1245000700 1 -- 172.21.15.47:0/2979279956 learned_addr learned my addr 172.21.15.47:0/2979279956 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f123fe00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c7eb0 0x7f12401e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1245a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240152b90 0x7f124014b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1245000700 1 -- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240152b90 msgr2=0x7f124014b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.459+0000 7f1245000700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240152b90 0x7f124014b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f1245000700 1 -- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c7eb0 msgr2=0x7f12401e1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f1245000700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c7eb0 0x7f12401e1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.463 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f1245000700 1 -- 172.21.15.47:0/2979279956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122c009550 con 0x7f12400c5c40 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f123fe00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c7eb0 0x7f12401e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f1245000700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 0x7f124014d3b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f123400e870 tx=0x7f123400ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400c640 con 0x7f12400c5c40 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400c7a0 con 0x7f12400c5c40 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400cb30 con 0x7f12400c5c40 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12401ebcc0 con 0x7f12400c5c40 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.460+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12401ebfa0 con 0x7f12400c5c40 2024-05-10T04:52:31.464 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.461+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1240074720 con 0x7f12400c5c40 2024-05-10T04:52:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.462+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f123400cc90 con 0x7f12400c5c40 2024-05-10T04:52:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.463+0000 7f123cc00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f122006ac90 0x7f122006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.463+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1234089920 con 0x7f12400c5c40 2024-05-10T04:52:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.464+0000 7f123fe00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f122006ac90 0x7f122006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.465+0000 7f123fe00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f122006ac90 0x7f122006d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f12400ac440 tx=0x7f122c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:31.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.468+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1234054770 con 0x7f12400c5c40 2024-05-10T04:52:31.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.684+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f12400ca190 con 0x7f12400c5c40 2024-05-10T04:52:31.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.685+0000 7f123cc00700 1 -- 172.21.15.47:0/2979279956 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1234057d90 con 0x7f12400c5c40 2024-05-10T04:52:31.685 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f122006ac90 msgr2=0x7f122006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f122006ac90 0x7f122006d1a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f12400ac440 tx=0x7f122c008030 comp rx=0 tx=0).stop 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 msgr2=0x7f124014d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 0x7f124014d3b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f123400e870 tx=0x7f123400ec30 comp rx=0 tx=0).stop 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 shutdown_connections 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f122006ac90 0x7f122006d1a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.688 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1240152b90 0x7f124014b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f12400c5c40 0x7f124014d3b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 --2- 172.21.15.47:0/2979279956 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f12400c7eb0 0x7f12401e1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 >> 172.21.15.47:0/2979279956 conn(0x7f12400ac8b0 msgr2=0x7f12400aa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:31.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 shutdown_connections 2024-05-10T04:52:31.689 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.687+0000 7f1247a00700 1 -- 172.21.15.47:0/2979279956 wait complete. 2024-05-10T04:52:31.716 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:52:31.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.989+0000 7f77e9400700 1 Processor -- start 2024-05-10T04:52:31.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.990+0000 7f77e9400700 1 -- start start 2024-05-10T04:52:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.991+0000 7f77e9400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.991+0000 7f77e9400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f77e4151fc0 0x7f77e41523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.991+0000 7f77e9400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77e40ab330 con 0x7f77e40ab850 2024-05-10T04:52:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.991+0000 7f77e9400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77e40c1c50 con 0x7f77e4151fc0 2024-05-10T04:52:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.991+0000 7f77e9400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e406eff0 con 0x7f77e414f200 2024-05-10T04:52:31.995 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f77e4151fc0 0x7f77e41523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f77e4151fc0 0x7f77e41523d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44960/0 (socket says 172.21.15.47:44960) 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 -- 172.21.15.47:0/3474706972 learned_addr learned my addr 172.21.15.47:0/3474706972 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e1e00700 1 --2- 172.21.15.47:0/3474706972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 -- 172.21.15.47:0/3474706972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 msgr2=0x7f77e4151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 --2- 172.21.15.47:0/3474706972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 -- 172.21.15.47:0/3474706972 >> v1:172.21.15.117:6789/0 conn(0x7f77e40ab850 legacy=0x7f77e40c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 -- 172.21.15.47:0/3474706972 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e40ab000 con 0x7f77e4151fc0 2024-05-10T04:52:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.992+0000 7f77e3200700 1 --2- 172.21.15.47:0/3474706972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e4151fc0 0x7f77e41523d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009e50 tx=0x7f77dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33e9c96fa3de169 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.993+0000 7f77e1400700 1 -- 172.21.15.47:0/3474706972 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00e070 con 0x7f77e4151fc0 2024-05-10T04:52:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.993+0000 7f77e1400700 1 -- 172.21.15.47:0/3474706972 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77dc00b910 con 0x7f77e4151fc0 2024-05-10T04:52:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.993+0000 7f77e1400700 1 -- 172.21.15.47:0/3474706972 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77dc00bcc0 con 0x7f77e4151fc0 2024-05-10T04:52:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.993+0000 7f77e9400700 1 -- 172.21.15.47:0/3474706972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e4151fc0 msgr2=0x7f77e41523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.993+0000 7f77e9400700 1 --2- 172.21.15.47:0/3474706972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e4151fc0 0x7f77e41523d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009e50 tx=0x7f77dc00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.994+0000 7f77e9400700 1 -- 172.21.15.47:0/3474706972 shutdown_connections 2024-05-10T04:52:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.994+0000 7f77e9400700 1 --2- 172.21.15.47:0/3474706972 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e4151fc0 0x7f77e41523d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.994+0000 7f77e9400700 1 --2- 172.21.15.47:0/3474706972 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.994+0000 7f77e9400700 1 -- 172.21.15.47:0/3474706972 >> 172.21.15.47:0/3474706972 conn(0x7f77e40a8ae0 msgr2=0x7f77e40a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.994+0000 7f77e9400700 1 -- 172.21.15.47:0/3474706972 shutdown_connections 2024-05-10T04:52:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.994+0000 7f77e9400700 1 -- 172.21.15.47:0/3474706972 wait complete. 2024-05-10T04:52:32.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.996+0000 7f77e9400700 1 Processor -- start 2024-05-10T04:52:32.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.996+0000 7f77e9400700 1 -- start start 2024-05-10T04:52:32.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.997+0000 7f77e9400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 0x7f77e40bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.997+0000 7f77e9400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.997+0000 7f77e9400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e4151fc0 0x7f77e415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.997+0000 7f77e9400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4151780 con 0x7f77e40ab850 2024-05-10T04:52:32.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.997+0000 7f77e9400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77e4073250 con 0x7f77e4151fc0 2024-05-10T04:52:32.004 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.997+0000 7f77e9400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77e414f960 con 0x7f77e414f200 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 0x7f77e40bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 0x7f77e40bfc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44976/0 (socket says 172.21.15.47:44976) 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 -- 172.21.15.47:0/1717406583 learned_addr learned my addr 172.21.15.47:0/1717406583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e3200700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e4151fc0 0x7f77e415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e1e00700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 -- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 msgr2=0x7f77e4150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.005 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 -- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e4151fc0 msgr2=0x7f77e415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e4151fc0 0x7f77e415d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 -- 172.21.15.47:0/1717406583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77dc009b30 con 0x7f77e40ab850 2024-05-10T04:52:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.998+0000 7f77e2800700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 0x7f77e40bfc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c450 tx=0x7f77d400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.999+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40052d0 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.999+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d4005430 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.999+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77e41502a0 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.999+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d40038c0 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:31.999+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77e4072f70 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.000+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e4074720 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.001+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f77d4003a20 con 0x7f77e40ab850 2024-05-10T04:52:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.002+0000 7f77daa00700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f77c406ac90 0x7f77c406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.002+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77d4088970 con 0x7f77e40ab850 2024-05-10T04:52:32.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.002+0000 7f77e1e00700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f77c406ac90 0x7f77c406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.003+0000 7f77e1e00700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f77c406ac90 0x7f77c406d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f77e4151f90 tx=0x7f77d0009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.006+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f77d40537c0 con 0x7f77e40ab850 2024-05-10T04:52:32.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.225+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f77e41526f0 con 0x7f77e40ab850 2024-05-10T04:52:32.226 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.225+0000 7f77daa00700 1 -- 172.21.15.47:0/1717406583 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77d4017020 con 0x7f77e40ab850 2024-05-10T04:52:32.226 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.227+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f77c406ac90 msgr2=0x7f77c406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.227+0000 7f77e9400700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f77c406ac90 0x7f77c406d1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f77e4151f90 tx=0x7f77d0009210 comp rx=0 tx=0).stop 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.227+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 msgr2=0x7f77e40bfc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.227+0000 7f77e9400700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 0x7f77e40bfc90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f77d400c450 tx=0x7f77d400c760 comp rx=0 tx=0).stop 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 shutdown_connections 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f77e4151fc0 0x7f77e415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f77e40ab850 0x7f77e40bfc90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f77c406ac90 0x7f77c406d1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 --2- 172.21.15.47:0/1717406583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f77e414f200 0x7f77e4150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.229 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 >> 172.21.15.47:0/1717406583 conn(0x7f77e40a8ae0 msgr2=0x7f77e414b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 shutdown_connections 2024-05-10T04:52:32.230 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.228+0000 7f77e9400700 1 -- 172.21.15.47:0/1717406583 wait complete. 2024-05-10T04:52:32.254 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T04:52:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.526+0000 7f9787000700 1 Processor -- start 2024-05-10T04:52:32.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.526+0000 7f9787000700 1 -- start start 2024-05-10T04:52:32.528 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9787000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97801553f0 0x7f97800c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9787000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f97800c8af0 0x7f97800c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9787000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f978006c7c0 con 0x7f97800c8f00 2024-05-10T04:52:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9787000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f978006dac0 con 0x7f97800c8af0 2024-05-10T04:52:32.529 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9787000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97800c5340 con 0x7f97801553f0 2024-05-10T04:52:32.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9785200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f97800c8af0 0x7f97800c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.528+0000 7f9785c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97801553f0 0x7f97800c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.530 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9786600700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f97800c8f00 0x7f97800c5d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:58934/0 (socket says 172.21.15.47:58934) 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9786600700 1 -- 172.21.15.47:0/3846891166 learned_addr learned my addr 172.21.15.47:0/3846891166 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f977fe00700 1 -- 172.21.15.47:0/3846891166 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2557447715 0 0) 0x7f978006c7c0 con 0x7f97800c8f00 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f977fe00700 1 -- 172.21.15.47:0/3846891166 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97680035b0 con 0x7f97800c8f00 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9785c00700 1 -- 172.21.15.47:0/3846891166 >> v2:172.21.15.117:3300/0 conn(0x7f97800c8af0 msgr2=0x7f97800c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9785c00700 1 --2- 172.21.15.47:0/3846891166 >> v2:172.21.15.117:3300/0 conn(0x7f97800c8af0 0x7f97800c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9785c00700 1 -- 172.21.15.47:0/3846891166 >> v1:172.21.15.117:6789/0 conn(0x7f97800c8f00 legacy=0x7f97800c5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9785c00700 1 -- 172.21.15.47:0/3846891166 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f978006bbb0 con 0x7f97801553f0 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.529+0000 7f9785200700 1 --2- 172.21.15.47:0/3846891166 >> v2:172.21.15.117:3300/0 conn(0x7f97800c8af0 0x7f97800c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.530+0000 7f9785c00700 1 --2- 172.21.15.47:0/3846891166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97801553f0 0x7f97800c85b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9774009840 tx=0x7f9774009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e2ff19122be95 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.530+0000 7f977fe00700 1 -- 172.21.15.47:0/3846891166 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774011830 con 0x7f97801553f0 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.530+0000 7f977fe00700 1 -- 172.21.15.47:0/3846891166 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9774011990 con 0x7f97801553f0 2024-05-10T04:52:32.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.530+0000 7f977fe00700 1 -- 172.21.15.47:0/3846891166 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774011d20 con 0x7f97801553f0 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.530+0000 7f9787000700 1 -- 172.21.15.47:0/3846891166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97801553f0 msgr2=0x7f97800c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.530+0000 7f9787000700 1 --2- 172.21.15.47:0/3846891166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97801553f0 0x7f97800c85b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9774009840 tx=0x7f9774009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.531+0000 7f9787000700 1 -- 172.21.15.47:0/3846891166 shutdown_connections 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.531+0000 7f9787000700 1 --2- 172.21.15.47:0/3846891166 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97801553f0 0x7f97800c85b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.531+0000 7f9787000700 1 --2- 172.21.15.47:0/3846891166 >> v2:172.21.15.117:3300/0 conn(0x7f97800c8af0 0x7f97800c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.531+0000 7f9787000700 1 -- 172.21.15.47:0/3846891166 >> 172.21.15.47:0/3846891166 conn(0x7f97800caf60 msgr2=0x7f97800c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:32.532 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.531+0000 7f9787000700 1 -- 172.21.15.47:0/3846891166 shutdown_connections 2024-05-10T04:52:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.531+0000 7f9787000700 1 -- 172.21.15.47:0/3846891166 wait complete. 2024-05-10T04:52:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.533+0000 7f9787000700 1 Processor -- start 2024-05-10T04:52:32.533 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.533+0000 7f9787000700 1 -- start start 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.534+0000 7f9787000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 0x7f97800acba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.534+0000 7f9787000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97800c8f00 0x7f97801ef1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.534+0000 7f9787000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97801553f0 0x7f97801eb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.534+0000 7f9787000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9780148c70 con 0x7f97800c8af0 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.534+0000 7f9787000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97801eb9d0 con 0x7f97801553f0 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.534+0000 7f9787000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9780147ab0 con 0x7f97800c8f00 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 0x7f97800acba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 0x7f97800acba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:44986/0 (socket says 172.21.15.47:44986) 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 -- 172.21.15.47:0/416729356 learned_addr learned my addr 172.21.15.47:0/416729356 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9786600700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97801553f0 0x7f97801eb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785200700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97800c8f00 0x7f97801ef1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.537 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 -- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97800c8f00 msgr2=0x7f97801ef1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97800c8f00 0x7f97801ef1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 -- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97801553f0 msgr2=0x7f97801eb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97801553f0 0x7f97801eb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 -- 172.21.15.47:0/416729356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c0094a0 con 0x7f97800c8af0 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785200700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97800c8f00 0x7f97801ef1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.535+0000 7f9785c00700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 0x7f97800acba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9774009fd0 tx=0x7f9774004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.536+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97740036a0 con 0x7f97800c8af0 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.536+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977401e070 con 0x7f97800c8af0 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.536+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97740094a0 con 0x7f97800c8af0 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.536+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9774003a60 con 0x7f97800c8af0 2024-05-10T04:52:32.538 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.536+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9780148090 con 0x7f97800c8af0 2024-05-10T04:52:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.537+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97801eb7c0 con 0x7f97800c8af0 2024-05-10T04:52:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.538+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9774003bc0 con 0x7f97800c8af0 2024-05-10T04:52:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.539+0000 7f977d600700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f976006ac90 0x7f976006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:32.539 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.539+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f977408a4a0 con 0x7f97800c8af0 2024-05-10T04:52:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.539+0000 7f9785200700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f976006ac90 0x7f976006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:32.540 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.540+0000 7f9785200700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f976006ac90 0x7f976006d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f978014e370 tx=0x7f976c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.543+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9774055380 con 0x7f97800c8af0 2024-05-10T04:52:32.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.760+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f97800ac7e0 con 0x7f97800c8af0 2024-05-10T04:52:32.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.760+0000 7f977d600700 1 -- 172.21.15.47:0/416729356 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97740589a0 con 0x7f97800c8af0 2024-05-10T04:52:32.761 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f976006ac90 msgr2=0x7f976006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f976006ac90 0x7f976006d1a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f978014e370 tx=0x7f976c008040 comp rx=0 tx=0).stop 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 msgr2=0x7f97800acba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 0x7f97800acba0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9774009fd0 tx=0x7f9774004750 comp rx=0 tx=0).stop 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 shutdown_connections 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f97801553f0 0x7f97801eb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f97800c8af0 0x7f97800acba0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f976006ac90 0x7f976006d1a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 --2- 172.21.15.47:0/416729356 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f97800c8f00 0x7f97801ef1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 >> 172.21.15.47:0/416729356 conn(0x7f97800caf60 msgr2=0x7f97800ad8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 shutdown_connections 2024-05-10T04:52:32.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:32.763+0000 7f9787000700 1 -- 172.21.15.47:0/416729356 wait complete. 2024-05-10T04:52:32.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:33.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.058+0000 7f042bc00700 1 Processor -- start 2024-05-10T04:52:33.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.058+0000 7f042bc00700 1 -- start start 2024-05-10T04:52:33.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f042bc00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f04240ca900 0x7f04240cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f042bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 0x7f04240c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f042bc00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04240c62d0 con 0x7f0424152be0 2024-05-10T04:52:33.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f042bc00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04240c56c0 con 0x7f04240ca900 2024-05-10T04:52:33.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f042bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c59a0 con 0x7f04240c37a0 2024-05-10T04:52:33.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f0429200700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0424152be0 0x7f0424155e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57548/0 (socket says 172.21.15.47:57548) 2024-05-10T04:52:33.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.060+0000 7f0429200700 1 -- 172.21.15.47:0/1611840368 learned_addr learned my addr 172.21.15.47:0/1611840368 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:33.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423e00700 1 --2- 172.21.15.47:0/1611840368 >> v2:172.21.15.117:3300/0 conn(0x7f04240ca900 0x7f04240cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0429c00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 0x7f04240c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2159148622 0 0) 0x7f04240c62d0 con 0x7f0424152be0 2024-05-10T04:52:33.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f040c0035b0 con 0x7f0424152be0 2024-05-10T04:52:33.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2832374643 0 0) 0x7f040c0035b0 con 0x7f0424152be0 2024-05-10T04:52:33.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 msgr2=0x7f04240c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:33.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 0x7f04240c3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 >> v2:172.21.15.117:3300/0 conn(0x7f04240ca900 msgr2=0x7f04240cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:33.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 --2- 172.21.15.47:0/1611840368 >> v2:172.21.15.117:3300/0 conn(0x7f04240ca900 0x7f04240cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04240c5c80 con 0x7f0424152be0 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f0418001670 con 0x7f0424152be0 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 >> v1:172.21.15.47:6789/0 conn(0x7f0424152be0 legacy=0x7f0424155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c003a00 0x7f040c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 0x7f040c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f040c004d90 0x7f040c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c56c0 con 0x7f040c004d90 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c59a0 con 0x7f040c003a00 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.061+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f040c00bac0 con 0x7f04240c37a0 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f040c004d90 0x7f040c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429200700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c003a00 0x7f040c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0423e00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 0x7f040c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 -- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 msgr2=0x7f040c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c37a0 0x7f040c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 -- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c003a00 msgr2=0x7f040c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c003a00 0x7f040c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 -- 172.21.15.47:0/1611840368 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c0035b0 con 0x7f040c004d90 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.062+0000 7f0429c00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f040c004d90 0x7f040c0051a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f041c009fc0 tx=0x7f040c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ebd8172bc0659f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c00ec30 con 0x7f040c004d90 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c00f040 con 0x7f040c004d90 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f0423400700 1 -- 172.21.15.47:0/1611840368 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c014480 con 0x7f040c004d90 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f042bc00700 1 -- 172.21.15.47:0/1611840368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f040c004d90 msgr2=0x7f040c0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.067 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f042bc00700 1 --2- 172.21.15.47:0/1611840368 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f040c004d90 0x7f040c0051a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f041c009fc0 tx=0x7f040c005880 comp rx=0 tx=0).stop 2024-05-10T04:52:33.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f0429c00700 1 -- 172.21.15.47:0/1611840368 reap_dead start 2024-05-10T04:52:33.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f042bc00700 1 -- 172.21.15.47:0/1611840368 shutdown_connections 2024-05-10T04:52:33.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f042bc00700 1 -- 172.21.15.47:0/1611840368 >> 172.21.15.47:0/1611840368 conn(0x7f04240c7630 msgr2=0x7f04240c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:33.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.063+0000 7f042bc00700 1 -- 172.21.15.47:0/1611840368 shutdown_connections 2024-05-10T04:52:33.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.064+0000 7f042bc00700 1 -- 172.21.15.47:0/1611840368 wait complete. 2024-05-10T04:52:33.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.066+0000 7f042bc00700 1 Processor -- start 2024-05-10T04:52:33.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.066+0000 7f042bc00700 1 -- start start 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f042bc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c004d90 0x7f04240c0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f042bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c0740 0x7f0424155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f042bc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 0x7f042414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f042bc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0424154730 con 0x7f0424155cd0 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f042bc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c0e80 con 0x7f040c004d90 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f042bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04240c2030 con 0x7f04240c0740 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.067+0000 7f0429c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 0x7f042414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 0x7f042414a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45014/0 (socket says 172.21.15.47:45014) 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 -- 172.21.15.47:0/37077691 learned_addr learned my addr 172.21.15.47:0/37077691 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429200700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c004d90 0x7f04240c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0423e00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c0740 0x7f0424155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 -- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c0740 msgr2=0x7f0424155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c0740 0x7f0424155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 -- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c004d90 msgr2=0x7f04240c0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c004d90 0x7f04240c0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 -- 172.21.15.47:0/37077691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04241ef700 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0423e00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c0740 0x7f0424155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0429c00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 0x7f042414a290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f041c017040 tx=0x7f041c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.068+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c007000 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.069+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041c004470 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.069+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041c004820 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.069+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0424153f30 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.069+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0424153640 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.070+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0424074720 con 0x7f0424155cd0 2024-05-10T04:52:33.073 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.071+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f041c023070 con 0x7f0424155cd0 2024-05-10T04:52:33.074 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.072+0000 7f0420c00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f040406acc0 0x7f040406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.072+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f041c08a710 con 0x7f0424155cd0 2024-05-10T04:52:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.072+0000 7f0429200700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f040406acc0 0x7f040406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.073+0000 7f0429200700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f040406acc0 0x7f040406d1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0418000c00 tx=0x7f0418007980 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:33.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.076+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f041c0555f0 con 0x7f0424155cd0 2024-05-10T04:52:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.337+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04240b0700 con 0x7f0424155cd0 2024-05-10T04:52:33.338 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.338+0000 7f0420c00700 1 -- 172.21.15.47:0/37077691 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f041c058c10 con 0x7f0424155cd0 2024-05-10T04:52:33.339 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:33.339 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:52:17.211312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:52:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f040406acc0 msgr2=0x7f040406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f040406acc0 0x7f040406d1d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0418000c00 tx=0x7f0418007980 comp rx=0 tx=0).stop 2024-05-10T04:52:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 msgr2=0x7f042414a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 0x7f042414a290 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f041c017040 tx=0x7f041c009750 comp rx=0 tx=0).stop 2024-05-10T04:52:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 shutdown_connections 2024-05-10T04:52:33.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0424155cd0 0x7f042414a290 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f040c004d90 0x7f04240c0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f040406acc0 0x7f040406d1d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 --2- 172.21.15.47:0/37077691 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f04240c0740 0x7f0424155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.340+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 >> 172.21.15.47:0/37077691 conn(0x7f04240c7630 msgr2=0x7f04240c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.341+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 shutdown_connections 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.341+0000 7f042bc00700 1 -- 172.21.15.47:0/37077691 wait complete. 2024-05-10T04:52:33.342 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-10T04:52:33.367 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:52:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.635+0000 7f5c45000700 1 Processor -- start 2024-05-10T04:52:33.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.635+0000 7f5c45000700 1 -- start start 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c45000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c40152d40 0x7f5c4006abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c45000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f5c400c23b0 0x7f5c40155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c45000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c400c17d0 con 0x7f5c4006b130 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c45000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400c30c0 con 0x7f5c400c23b0 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c45000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400726d0 con 0x7f5c40152d40 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c37e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f5c4006b130 0x7f5c40155670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57558/0 (socket says 172.21.15.47:57558) 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c37e00700 1 -- 172.21.15.47:0/892528182 learned_addr learned my addr 172.21.15.47:0/892528182 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c3e800700 1 --2- 172.21.15.47:0/892528182 >> v2:172.21.15.117:3300/0 conn(0x7f5c400c23b0 0x7f5c40155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.637+0000 7f5c3de00700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c40152d40 0x7f5c4006abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.639 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3d400700 1 -- 172.21.15.47:0/892528182 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214066632 0 0) 0x7f5c400c17d0 con 0x7f5c4006b130 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3d400700 1 -- 172.21.15.47:0/892528182 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c240035b0 con 0x7f5c4006b130 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3e800700 1 -- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c40152d40 msgr2=0x7f5c4006abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3e800700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c40152d40 0x7f5c4006abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3e800700 1 -- 172.21.15.47:0/892528182 >> v1:172.21.15.47:6789/0 conn(0x7f5c4006b130 legacy=0x7f5c40155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3e800700 1 -- 172.21.15.47:0/892528182 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400c1ab0 con 0x7f5c400c23b0 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3de00700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c40152d40 0x7f5c4006abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:33.640 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.638+0000 7f5c3e800700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c400c23b0 0x7f5c40155d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009d90 tx=0x7f5c3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc10c1e2901254c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:33.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c3d400700 1 -- 172.21.15.47:0/892528182 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3800e070 con 0x7f5c400c23b0 2024-05-10T04:52:33.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c3d400700 1 -- 172.21.15.47:0/892528182 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3800bb20 con 0x7f5c400c23b0 2024-05-10T04:52:33.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c3d400700 1 -- 172.21.15.47:0/892528182 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38012430 con 0x7f5c400c23b0 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c45000700 1 -- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c400c23b0 msgr2=0x7f5c40155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c45000700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c400c23b0 0x7f5c40155d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009d90 tx=0x7f5c3800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c45000700 1 -- 172.21.15.47:0/892528182 shutdown_connections 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c45000700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c400c23b0 0x7f5c40155d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.639+0000 7f5c45000700 1 --2- 172.21.15.47:0/892528182 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c40152d40 0x7f5c4006abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.640+0000 7f5c45000700 1 -- 172.21.15.47:0/892528182 >> 172.21.15.47:0/892528182 conn(0x7f5c400c4220 msgr2=0x7f5c400c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.640+0000 7f5c45000700 1 -- 172.21.15.47:0/892528182 shutdown_connections 2024-05-10T04:52:33.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.640+0000 7f5c45000700 1 -- 172.21.15.47:0/892528182 wait complete. 2024-05-10T04:52:33.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.642+0000 7f5c45000700 1 Processor -- start 2024-05-10T04:52:33.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.642+0000 7f5c45000700 1 -- start start 2024-05-10T04:52:33.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.643+0000 7f5c45000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c4006b130 0x7f5c400c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.643+0000 7f5c45000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 0x7f5c401eeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.643+0000 7f5c45000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c40152d40 0x7f5c401eeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.643+0000 7f5c45000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4014e2b0 con 0x7f5c400c23b0 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.643+0000 7f5c45000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401492b0 con 0x7f5c40152d40 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.643+0000 7f5c45000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400c5720 con 0x7f5c4006b130 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 0x7f5c401eeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 0x7f5c401eeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45018/0 (socket says 172.21.15.47:45018) 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 -- 172.21.15.47:0/2135941630 learned_addr learned my addr 172.21.15.47:0/2135941630 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c3e800700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c40152d40 0x7f5c401eeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c3de00700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c4006b130 0x7f5c400c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 -- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c4006b130 msgr2=0x7f5c400c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c4006b130 0x7f5c400c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.646 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 -- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c40152d40 msgr2=0x7f5c401eeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c40152d40 0x7f5c401eeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 -- 172.21.15.47:0/2135941630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c30009430 con 0x7f5c400c23b0 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.644+0000 7f5c37e00700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 0x7f5c401eeab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c28005910 tx=0x7f5c2800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.645+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c28005d70 con 0x7f5c400c23b0 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.645+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800ce80 con 0x7f5c400c23b0 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.645+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c38009a70 con 0x7f5c400c23b0 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.645+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c280072f0 con 0x7f5c400c23b0 2024-05-10T04:52:33.647 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.645+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c40149500 con 0x7f5c400c23b0 2024-05-10T04:52:33.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.646+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40074720 con 0x7f5c400c23b0 2024-05-10T04:52:33.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.647+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c28007450 con 0x7f5c400c23b0 2024-05-10T04:52:33.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.648+0000 7f5c36000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5c1c06acc0 0x7f5c1c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:33.648 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.648+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c28088ad0 con 0x7f5c400c23b0 2024-05-10T04:52:33.649 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.648+0000 7f5c3de00700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5c1c06acc0 0x7f5c1c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:33.650 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.649+0000 7f5c3de00700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5c1c06acc0 0x7f5c1c06d1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c400c3320 tx=0x7f5c300091c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:33.653 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.653+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5c280538a0 con 0x7f5c400c23b0 2024-05-10T04:52:33.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.867+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c40067e90 con 0x7f5c400c23b0 2024-05-10T04:52:33.869 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.868+0000 7f5c36000700 1 -- 172.21.15.47:0/2135941630 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+17878 (secure 0 0 0) 0x7f5c280745f0 con 0x7f5c400c23b0 2024-05-10T04:52:33.870 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:33.870 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":26,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:51:57.766235+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:52:33.872 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5c1c06acc0 msgr2=0x7f5c1c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5c1c06acc0 0x7f5c1c06d1d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5c400c3320 tx=0x7f5c300091c0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 msgr2=0x7f5c401eeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 0x7f5c401eeab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5c28005910 tx=0x7f5c2800c7b0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 shutdown_connections 2024-05-10T04:52:33.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f5c40152d40 0x7f5c401eeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f5c1c06acc0 0x7f5c1c06d1d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f5c4006b130 0x7f5c400c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 --2- 172.21.15.47:0/2135941630 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f5c400c23b0 0x7f5c401eeab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 >> 172.21.15.47:0/2135941630 conn(0x7f5c400c4220 msgr2=0x7f5c40150ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 shutdown_connections 2024-05-10T04:52:33.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:33.871+0000 7f5c45000700 1 -- 172.21.15.47:0/2135941630 wait complete. 2024-05-10T04:52:33.898 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T04:52:34.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.167+0000 7fd559e00700 1 Processor -- start 2024-05-10T04:52:34.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.167+0000 7fd559e00700 1 -- start start 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.168+0000 7fd559e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5540c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.168+0000 7fd559e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd5540c9270 0x7fd554158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.168+0000 7fd559e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd554159050 0x7fd5541555a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.168+0000 7fd559e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55406c7c0 con 0x7fd554159050 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.168+0000 7fd559e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55406d060 con 0x7fd5540c9270 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.168+0000 7fd559e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd554159890 con 0x7fd5540c5c40 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd554159050 0x7fd5541555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd554159050 0x7fd5541555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45024/0 (socket says 172.21.15.47:45024) 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 -- 172.21.15.47:0/1669497650 learned_addr learned my addr 172.21.15.47:0/1669497650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd552a00700 1 --2- 172.21.15.47:0/1669497650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5540c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd54be00700 1 --2- 172.21.15.47:0/1669497650 >> v2:172.21.15.117:3300/0 conn(0x7fd5540c9270 0x7fd554158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 -- 172.21.15.47:0/1669497650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 msgr2=0x7fd5540c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:34.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 --2- 172.21.15.47:0/1669497650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5540c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 -- 172.21.15.47:0/1669497650 >> v2:172.21.15.117:3300/0 conn(0x7fd5540c9270 msgr2=0x7fd554158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:34.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 --2- 172.21.15.47:0/1669497650 >> v2:172.21.15.117:3300/0 conn(0x7fd5540c9270 0x7fd554158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.169+0000 7fd553400700 1 -- 172.21.15.47:0/1669497650 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55406ca10 con 0x7fd554159050 2024-05-10T04:52:34.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.170+0000 7fd553400700 1 --2- 172.21.15.47:0/1669497650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd554159050 0x7fd5541555a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5540731e0 tx=0x7fd54c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0dc3587af0f8874 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.170+0000 7fd552000700 1 -- 172.21.15.47:0/1669497650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00e070 con 0x7fd554159050 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.170+0000 7fd552000700 1 -- 172.21.15.47:0/1669497650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54c00b910 con 0x7fd554159050 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.170+0000 7fd552000700 1 -- 172.21.15.47:0/1669497650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54c00bcc0 con 0x7fd554159050 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 -- 172.21.15.47:0/1669497650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd554159050 msgr2=0x7fd5541555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 --2- 172.21.15.47:0/1669497650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd554159050 0x7fd5541555a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5540731e0 tx=0x7fd54c00b330 comp rx=0 tx=0).stop 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 -- 172.21.15.47:0/1669497650 shutdown_connections 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 --2- 172.21.15.47:0/1669497650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5540c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 --2- 172.21.15.47:0/1669497650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd554159050 0x7fd5541555a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 --2- 172.21.15.47:0/1669497650 >> v2:172.21.15.117:3300/0 conn(0x7fd5540c9270 0x7fd554158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 -- 172.21.15.47:0/1669497650 >> 172.21.15.47:0/1669497650 conn(0x7fd5540ca940 msgr2=0x7fd5540cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 -- 172.21.15.47:0/1669497650 shutdown_connections 2024-05-10T04:52:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.171+0000 7fd559e00700 1 -- 172.21.15.47:0/1669497650 wait complete. 2024-05-10T04:52:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.173+0000 7fd559e00700 1 Processor -- start 2024-05-10T04:52:34.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.173+0000 7fd559e00700 1 -- start start 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.174+0000 7fd559e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5541ec940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.174+0000 7fd559e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 0x7fd5541535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.174+0000 7fd559e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd554159050 0x7fd5540af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.174+0000 7fd559e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5541eb4d0 con 0x7fd5540c9270 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.174+0000 7fd559e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5541ed1d0 con 0x7fd554159050 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.174+0000 7fd559e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5541ebd10 con 0x7fd5540c5c40 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 0x7fd5541535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 0x7fd5541535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45030/0 (socket says 172.21.15.47:45030) 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 -- 172.21.15.47:0/2573692327 learned_addr learned my addr 172.21.15.47:0/2573692327 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd553400700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd554159050 0x7fd5540af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd552a00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5541ec940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 -- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 msgr2=0x7fd5541ec940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5541ec940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 -- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd554159050 msgr2=0x7fd5540af3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:34.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd554159050 0x7fd5540af3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 -- 172.21.15.47:0/2573692327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54c009b30 con 0x7fd5540c9270 2024-05-10T04:52:34.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.175+0000 7fd54be00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 0x7fd5541535a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e870 tx=0x7fd53c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:34.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.176+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c013680 con 0x7fd5540c9270 2024-05-10T04:52:34.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.176+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c0137e0 con 0x7fd5540c9270 2024-05-10T04:52:34.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.176+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c013b90 con 0x7fd5540c9270 2024-05-10T04:52:34.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.176+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd554153ae0 con 0x7fd5540c9270 2024-05-10T04:52:34.180 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.176+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5541eb6c0 con 0x7fd5540c9270 2024-05-10T04:52:34.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.177+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5541586c0 con 0x7fd5540c9270 2024-05-10T04:52:34.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.178+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd53c013cf0 con 0x7fd5540c9270 2024-05-10T04:52:34.181 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.179+0000 7fd54b400700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd53006ac90 0x7fd53006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:34.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.179+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd53c089650 con 0x7fd5540c9270 2024-05-10T04:52:34.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.179+0000 7fd552a00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd53006ac90 0x7fd53006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:34.182 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.180+0000 7fd552a00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd53006ac90 0x7fd53006d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd55406b850 tx=0x7fd544009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:34.185 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.183+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd53c054530 con 0x7fd5540c9270 2024-05-10T04:52:34.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.447+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5541ebec0 con 0x7fd5540c9270 2024-05-10T04:52:34.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.447+0000 7fd54b400700 1 -- 172.21.15.47:0/2573692327 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7fd5541ebec0 con 0x7fd5540c9270 2024-05-10T04:52:34.449 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:52:34.449 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:52:17.211312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd53006ac90 msgr2=0x7fd53006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd53006ac90 0x7fd53006d1a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd55406b850 tx=0x7fd544009210 comp rx=0 tx=0).stop 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 msgr2=0x7fd5541535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 0x7fd5541535a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd53c00e870 tx=0x7fd53c00eb80 comp rx=0 tx=0).stop 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 shutdown_connections 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd554159050 0x7fd5540af3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd53006ac90 0x7fd53006d1a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd5540c5c40 0x7fd5541ec940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 --2- 172.21.15.47:0/2573692327 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd5540c9270 0x7fd5541535a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:34.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 >> 172.21.15.47:0/2573692327 conn(0x7fd5540ca940 msgr2=0x7fd5540cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:34.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 shutdown_connections 2024-05-10T04:52:34.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:34.450+0000 7fd559e00700 1 -- 172.21.15.47:0/2573692327 wait complete. 2024-05-10T04:52:34.453 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-10T04:52:34.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-10T04:51:52.718987+0000', 'modified': '2024-05-10T04:52:17.211312+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4272}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4272': {'gid': 4272, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.117:6837/2356260099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.117:6836', 'nonce': 2356260099}, {'type': 'v1', 'addr': '172.21.15.117:6837', 'nonce': 2356260099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-05-10T04:52:34.882 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-10T04:52:34.883 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-10T04:52:35.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.157+0000 7f8476600700 1 Processor -- start 2024-05-10T04:52:35.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.158+0000 7f8476600700 1 -- start start 2024-05-10T04:52:35.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.159+0000 7f8476600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f84700aab00 0x7f84700c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.159+0000 7f8476600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700ab7a0 0x7f84700c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.159+0000 7f8476600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8470152e60 con 0x7f84700c2040 2024-05-10T04:52:35.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.159+0000 7f8476600700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84700c2870 con 0x7f84700ab7a0 2024-05-10T04:52:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.159+0000 7f8476600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f847014fec0 con 0x7f84700aab00 2024-05-10T04:52:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846fe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f84700ab7a0 0x7f84700c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f8467e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f84700c2040 0x7f84700c1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57572/0 (socket says 172.21.15.47:57572) 2024-05-10T04:52:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f8467e00700 1 -- 172.21.15.47:0/3422025098 learned_addr learned my addr 172.21.15.47:0/3422025098 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846f400700 1 --2- 172.21.15.47:0/3422025098 >> v2:172.21.15.117:3300/0 conn(0x7f84700aab00 0x7f84700c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846fe00700 1 -- 172.21.15.47:0/3422025098 >> v2:172.21.15.117:3300/0 conn(0x7f84700aab00 msgr2=0x7f84700c3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846fe00700 1 --2- 172.21.15.47:0/3422025098 >> v2:172.21.15.117:3300/0 conn(0x7f84700aab00 0x7f84700c3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846ea00700 1 -- 172.21.15.47:0/3422025098 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835298741 0 0) 0x7f8470152e60 con 0x7f84700c2040 2024-05-10T04:52:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846fe00700 1 -- 172.21.15.47:0/3422025098 >> v1:172.21.15.47:6789/0 conn(0x7f84700c2040 legacy=0x7f84700c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.160+0000 7f846fe00700 1 -- 172.21.15.47:0/3422025098 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470153390 con 0x7f84700ab7a0 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.161+0000 7f846fe00700 1 --2- 172.21.15.47:0/3422025098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ab7a0 0x7f84700c6610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8470070940 tx=0x7f846800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7688e3c052ad05 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.161+0000 7f846ea00700 1 -- 172.21.15.47:0/3422025098 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800e070 con 0x7f84700ab7a0 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.161+0000 7f846ea00700 1 -- 172.21.15.47:0/3422025098 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846800bae0 con 0x7f84700ab7a0 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.161+0000 7f846ea00700 1 -- 172.21.15.47:0/3422025098 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846800be90 con 0x7f84700ab7a0 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 -- 172.21.15.47:0/3422025098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ab7a0 msgr2=0x7f84700c6610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 --2- 172.21.15.47:0/3422025098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ab7a0 0x7f84700c6610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8470070940 tx=0x7f846800b330 comp rx=0 tx=0).stop 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 -- 172.21.15.47:0/3422025098 shutdown_connections 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 --2- 172.21.15.47:0/3422025098 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700ab7a0 0x7f84700c6610 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 --2- 172.21.15.47:0/3422025098 >> v2:172.21.15.117:3300/0 conn(0x7f84700aab00 0x7f84700c3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 -- 172.21.15.47:0/3422025098 >> 172.21.15.47:0/3422025098 conn(0x7f84700a8ae0 msgr2=0x7f84700a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 -- 172.21.15.47:0/3422025098 shutdown_connections 2024-05-10T04:52:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.162+0000 7f8476600700 1 -- 172.21.15.47:0/3422025098 wait complete. 2024-05-10T04:52:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.164+0000 7f8476600700 1 Processor -- start 2024-05-10T04:52:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.164+0000 7f8476600700 1 -- start start 2024-05-10T04:52:35.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.165+0000 7f8476600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 0x7f84701ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.165+0000 7f8476600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84700ab7a0 0x7f8470155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.165+0000 7f8476600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700c2040 0x7f84701ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.169 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.165+0000 7f8476600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84701ec5d0 con 0x7f84700aab00 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.165+0000 7f8476600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470120f00 con 0x7f84700c2040 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.165+0000 7f8476600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847011f990 con 0x7f84700ab7a0 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 0x7f84701ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 0x7f84701ef580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45046/0 (socket says 172.21.15.47:45046) 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 -- 172.21.15.47:0/1002797968 learned_addr learned my addr 172.21.15.47:0/1002797968 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846fe00700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700c2040 0x7f84701ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f8467e00700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84700ab7a0 0x7f8470155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 -- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84700ab7a0 msgr2=0x7f8470155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84700ab7a0 0x7f8470155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 -- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700c2040 msgr2=0x7f84701ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700c2040 0x7f84701ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.166+0000 7f846f400700 1 -- 172.21.15.47:0/1002797968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8468009a70 con 0x7f84700aab00 2024-05-10T04:52:35.170 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.167+0000 7f846f400700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 0x7f84701ef580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f846000e8a0 tx=0x7f846000ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.167+0000 7f8467400700 1 -- 172.21.15.47:0/1002797968 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460009590 con 0x7f84700aab00 2024-05-10T04:52:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.167+0000 7f8467400700 1 -- 172.21.15.47:0/1002797968 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460013680 con 0x7f84700aab00 2024-05-10T04:52:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.167+0000 7f8467400700 1 -- 172.21.15.47:0/1002797968 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84600139f0 con 0x7f84700aab00 2024-05-10T04:52:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.167+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f847011fc50 con 0x7f84700aab00 2024-05-10T04:52:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.167+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470120210 con 0x7f84700aab00 2024-05-10T04:52:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.169+0000 7f8467400700 1 -- 172.21.15.47:0/1002797968 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8460013b50 con 0x7f84700aab00 2024-05-10T04:52:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.170+0000 7f8467400700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f844c06acc0 0x7f844c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.170+0000 7f8467400700 1 -- 172.21.15.47:0/1002797968 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8460089490 con 0x7f84700aab00 2024-05-10T04:52:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.170+0000 7f8467e00700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f844c06acc0 0x7f844c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.171+0000 7f8467e00700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f844c06acc0 0x7f844c06d1d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84701512f0 tx=0x7f8458007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.172+0000 7f848e4d4b80 1 Processor -- start 2024-05-10T04:52:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.173+0000 7f848e4d4b80 1 -- start start 2024-05-10T04:52:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e1ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e52310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871d47250 con 0x560871e52850 2024-05-10T04:52:35.177 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871d44a50 con 0x560871ce65f0 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x560871d40340 con 0x560871e21170 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f846fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f846fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45048/0 (socket says 172.21.15.47:45048) 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f846fe00700 1 -- 172.21.15.47:0/788481929 learned_addr learned my addr 172.21.15.47:0/788481929 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f846f400700 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e1ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.174+0000 7f8467e00700 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e52310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846fe00700 1 -- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 msgr2=0x560871e52310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846fe00700 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e52310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846fe00700 1 -- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 msgr2=0x560871e1ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846fe00700 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e1ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846fe00700 1 -- 172.21.15.47:0/788481929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560871b33790 con 0x560871e52850 2024-05-10T04:52:35.178 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846f400700 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e1ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:35.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f846fe00700 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3d800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f846800b370 tx=0x7f8468010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260ec2340da5695e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f845fe00700 1 -- 172.21.15.47:0/788481929 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468003ba0 con 0x560871e52850 2024-05-10T04:52:35.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f845fe00700 1 -- 172.21.15.47:0/788481929 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468003d00 con 0x560871e52850 2024-05-10T04:52:35.179 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.175+0000 7f845fe00700 1 -- 172.21.15.47:0/788481929 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468004240 con 0x560871e52850 2024-05-10T04:52:35.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 -- 172.21.15.47:0/788481929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 msgr2=0x560871e3d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3d800 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f846800b370 tx=0x7f8468010000 comp rx=0 tx=0).stop 2024-05-10T04:52:35.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 -- 172.21.15.47:0/788481929 shutdown_connections 2024-05-10T04:52:35.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3d800 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e1ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/788481929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e52310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 -- 172.21.15.47:0/788481929 >> 172.21.15.47:0/788481929 conn(0x560871d8acf0 msgr2=0x560871e1dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 -- 172.21.15.47:0/788481929 shutdown_connections 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.176+0000 7f848e4d4b80 1 -- 172.21.15.47:0/788481929 wait complete. 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.177+0000 7f848e4d4b80 1 -- start start 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.177+0000 7f848e4d4b80 1 Processor -- start 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 0x560871e647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.187 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e5a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e52850 0x560871e39db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871cdc490 con 0x560871ce65f0 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871cdc130 con 0x560871e52850 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x560871b34390 con 0x560871e21170 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f848e4d4b80 10 client.0 _ll_register_callbacks cb 0x560871b475a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f846f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 0x560871e647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f846f400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 0x560871e647f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45052/0 (socket says 172.21.15.47:45052) 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.179+0000 7f846f400700 1 -- 172.21.15.47:0/1064713104 learned_addr learned my addr 172.21.15.47:0/1064713104 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.188 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846f400700 1 -- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 msgr2=0x560871e5a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f8467e00700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e5a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846fe00700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e52850 0x560871e39db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846f400700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e5a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846f400700 1 -- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e52850 msgr2=0x560871e39db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846f400700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e52850 0x560871e39db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846f400700 1 -- 172.21.15.47:0/1064713104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8470120210 con 0x560871ce65f0 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f8467e00700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e5a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:35.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846fe00700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e52850 0x560871e39db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f846f400700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 0x560871e647f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8460057ca0 tx=0x7f8460058120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd22f40e2f0118f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f845cc00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f845cc00700 1 -- 172.21.15.47:0/1064713104 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84600561a0 con 0x560871ce65f0 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f845cc00700 1 -- 172.21.15.47:0/1064713104 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f84600890b0 con 0x560871ce65f0 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560871e12630 con 0x560871ce65f0 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f845cc00700 1 -- 172.21.15.47:0/1064713104 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8460089270 con 0x560871ce65f0 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f848e4d4b80 10 client.4815 fetch_fsmap learned FSMap version 9 2024-05-10T04:52:35.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x7f8470153390 con 0x560871ce65f0 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.180+0000 7f845cc00700 1 -- 172.21.15.47:0/1064713104 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460073020 con 0x560871ce65f0 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f845cc00700 1 -- 172.21.15.47:0/1064713104 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f8460058200 con 0x560871ce65f0 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f848e4d4b80 10 client.4815 fetch_fsmap finished waiting for FSMap version 9 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f848e4d4b80 10 client.4815 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f848e4d4b80 20 client.4815 populate_metadata read hostname 'smithi047' 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871e3a550 0x560871e6ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f848e4d4b80 4 client.4815 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-10T04:52:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 --> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560871b79040 con 0x560871e3a550 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.181+0000 7f8467e00700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871e3a550 0x560871e6ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.182+0000 7f8467e00700 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871e3a550 0x560871e6ec50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46b56898c4f794b5 server_cookie=cd6d216239a42f88 in_seq=0 out_seq=0 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.182+0000 7f845cc00700 10 client.4815 ms_handle_connect on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f845cc00700 1 -- 172.21.15.47:0/1064713104 <== mds.0 v2:172.21.15.117:6836/2356260099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560871b79040 con 0x560871e3a550 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f845cc00700 10 client.4815 handle_command_reply: tid=0 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 client.4815 shutdown 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 msgr2=0x560871e647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 0x560871e647f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8460057ca0 tx=0x7f8460058120 comp rx=0 tx=0).stop 2024-05-10T04:52:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 shutdown_connections 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871e3a550 0x560871e6ec50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e52850 0x560871e39db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871ce65f0 0x560871e647f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f845cc00700 0 client.4815 ms_handle_reset on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/1064713104 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e5a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 >> 172.21.15.47:0/1064713104 conn(0x560871d8acf0 msgr2=0x560871e1c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 shutdown_connections 2024-05-10T04:52:35.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.183+0000 7f848e4d4b80 1 -- 172.21.15.47:0/1064713104 wait complete. 2024-05-10T04:52:35.194 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.184+0000 7f848e4d4b80 20 client.4815 trim_cache size 0 max 16384 2024-05-10T04:52:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.203+0000 7f848e4d4b80 1 Processor -- start 2024-05-10T04:52:35.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.203+0000 7f848e4d4b80 1 -- start start 2024-05-10T04:52:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871ce65f0 0x560871e19e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e21170 0x560871e3c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871e5a800 con 0x560871e52850 2024-05-10T04:52:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871e14ac0 con 0x560871e21170 2024-05-10T04:52:35.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x560871e3a170 con 0x560871ce65f0 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f846fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f846fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45058/0 (socket says 172.21.15.47:45058) 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.204+0000 7f846fe00700 1 -- 172.21.15.47:0/365769583 learned_addr learned my addr 172.21.15.47:0/365769583 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f846fe00700 1 -- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871ce65f0 msgr2=0x560871e19e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f846fe00700 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871ce65f0 0x560871e19e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f846fe00700 1 -- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e21170 msgr2=0x560871e3c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f8467e00700 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e21170 0x560871e3c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f846fe00700 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e21170 0x560871e3c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f846fe00700 1 -- 172.21.15.47:0/365769583 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560871c200a0 con 0x560871e52850 2024-05-10T04:52:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f8467e00700 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e21170 0x560871e3c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f846fe00700 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3ceb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8468009670 tx=0x7f8468009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7916eb47d4919 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f8464c00700 1 -- 172.21.15.47:0/365769583 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468003ba0 con 0x560871e52850 2024-05-10T04:52:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f8464c00700 1 -- 172.21.15.47:0/365769583 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846802f440 con 0x560871e52850 2024-05-10T04:52:35.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.205+0000 7f8464c00700 1 -- 172.21.15.47:0/365769583 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846802f5d0 con 0x560871e52850 2024-05-10T04:52:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 -- 172.21.15.47:0/365769583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 msgr2=0x560871e3ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3ceb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8468009670 tx=0x7f8468009750 comp rx=0 tx=0).stop 2024-05-10T04:52:35.214 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 -- 172.21.15.47:0/365769583 shutdown_connections 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871e3ceb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871ce65f0 0x560871e19e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/365769583 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871e21170 0x560871e3c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 -- 172.21.15.47:0/365769583 >> 172.21.15.47:0/365769583 conn(0x560871d8acf0 msgr2=0x560871e399c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 -- 172.21.15.47:0/365769583 shutdown_connections 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.206+0000 7f848e4d4b80 1 -- 172.21.15.47:0/365769583 wait complete. 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.207+0000 7f848e4d4b80 1 -- start start 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.207+0000 7f848e4d4b80 1 Processor -- start 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.208+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e5bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e58430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f848e4d4b80 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871ec8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871ec5620 con 0x560871e52850 2024-05-10T04:52:35.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x560871e5b0e0 con 0x560871ce65f0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f848e4d4b80 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x560871e64770 con 0x560871e21170 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f848e4d4b80 10 client.0 _ll_register_callbacks cb 0x7f84600586a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871ec8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846f400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e5bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f8467e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e58430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871ec8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45074/0 (socket says 172.21.15.47:45074) 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 -- 172.21.15.47:0/167989094 learned_addr learned my addr 172.21.15.47:0/167989094 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 -- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 msgr2=0x560871e58430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e58430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 -- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 msgr2=0x560871e5bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e5bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.209+0000 7f846fe00700 1 -- 172.21.15.47:0/167989094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560871b33790 con 0x560871e52850 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f846fe00700 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871ec8b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f846800d010 tx=0x7f8468004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16afd66089c3b41 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f845cc00700 10 client.0 ms_handle_connect on v2:172.21.15.47:3300/0 2024-05-10T04:52:35.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f845cc00700 1 -- 172.21.15.47:0/167989094 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8468003b20 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f845cc00700 1 -- 172.21.15.47:0/167989094 <== mon.0 v2:172.21.15.47:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f846803be20 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8468003d00 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f845cc00700 1 -- 172.21.15.47:0/167989094 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8468012430 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 10 client.4821 fetch_fsmap learned FSMap version 9 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x560871d06690 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f845cc00700 1 -- 172.21.15.47:0/167989094 <== mon.0 v2:172.21.15.47:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8468003d00 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f845cc00700 1 -- 172.21.15.47:0/167989094 <== mon.0 v2:172.21.15.47:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f8468012590 con 0x560871e52850 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 10 client.4821 fetch_fsmap finished waiting for FSMap version 9 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 10 client.4821 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 20 client.4821 populate_metadata read hostname 'smithi047' 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871ec22d0 0x560871ec26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 4 client.4821 mds_command: new command op to 4272 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.210+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 --> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560871bb50c0 con 0x560871ec22d0 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.211+0000 7f846f400700 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871ec22d0 0x560871ec26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.211+0000 7f846f400700 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871ec22d0 0x560871ec26e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40837e7defbe118c server_cookie=4fcc24c787d6109e in_seq=0 out_seq=0 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.211+0000 7f845cc00700 10 client.4821 ms_handle_connect on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f845cc00700 1 -- 172.21.15.47:0/167989094 <== mds.0 v2:172.21.15.117:6836/2356260099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x560871bb50c0 con 0x560871ec22d0 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f845cc00700 10 client.4821 handle_command_reply: tid=0 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 client.4821 shutdown 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 msgr2=0x560871ec8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871ec8b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f846800d010 tx=0x7f8468004b40 comp rx=0 tx=0).stop 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 shutdown_connections 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:6836/2356260099,v1:172.21.15.117:6837/2356260099] conn(0x560871ec22d0 0x560871ec26e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x560871e52850 0x560871ec8b10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x560871ce65f0 0x560871e5bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f845cc00700 0 client.4821 ms_handle_reset on v2:172.21.15.117:6836/2356260099 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 --2- 172.21.15.47:0/167989094 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x560871e21170 0x560871e58430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 >> 172.21.15.47:0/167989094 conn(0x560871d8acf0 msgr2=0x560871e399c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 shutdown_connections 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 1 -- 172.21.15.47:0/167989094 wait complete. 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.212+0000 7f848e4d4b80 20 client.4821 trim_cache size 0 max 16384 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "cluster_fsid": "63debaa4-fa23-4f28-8f14-9786e692137f", 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "whoami": 0, 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4272, 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "want_state": "up:active", 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "state": "up:active", 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs", 2024-05-10T04:52:35.219 INFO:teuthology.orchestra.run.smithi047.stdout: "rank_uptime": 42.491143673000003, 2024-05-10T04:52:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "mdsmap_epoch": 9, 2024-05-10T04:52:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch": 26, 2024-05-10T04:52:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "osdmap_epoch_barrier": 26, 2024-05-10T04:52:35.220 INFO:teuthology.orchestra.run.smithi047.stdout: "uptime": 50.172159661000002 2024-05-10T04:52:35.220 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f844c06acc0 msgr2=0x7f844c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f844c06acc0 0x7f844c06d1d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f84701512f0 tx=0x7f8458007e70 comp rx=0 tx=0).stop 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 msgr2=0x7f84701ef580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 0x7f84701ef580 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f846000e8a0 tx=0x7f846000ebb0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 shutdown_connections 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f84700c2040 0x7f84701ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f84700aab00 0x7f84701ef580 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f844c06acc0 0x7f844c06d1d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 --2- 172.21.15.47:0/1002797968 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f84700ab7a0 0x7f8470155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 >> 172.21.15.47:0/1002797968 conn(0x7f84700a8ae0 msgr2=0x7f84700717c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 shutdown_connections 2024-05-10T04:52:35.221 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.213+0000 7f8476600700 1 -- 172.21.15.47:0/1002797968 wait complete. 2024-05-10T04:52:35.240 INFO:teuthology.run_tasks:Running task sequential... 2024-05-10T04:52:35.253 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-10T04:52:35.253 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-10T04:52:35.253 INFO:teuthology.task.print:Enabling mgr modules 2024-05-10T04:52:35.253 INFO:teuthology.run_tasks:Running task parallel... 2024-05-10T04:52:35.268 INFO:teuthology.task.parallel:starting parallel... 2024-05-10T04:52:35.268 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-10T04:52:35.268 INFO:teuthology.task.sequential:In sequential, running task ceph-fuse... 2024-05-10T04:52:35.270 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-10T04:52:35.270 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-10T04:52:35.270 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-10T04:52:35.270 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:52:35.270 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:35.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:35.270 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-10T04:52:35.271 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-05-10T04:52:35.271 INFO:teuthology.task.sequential:In sequential, running task kclient... 2024-05-10T04:52:35.275 INFO:tasks.kclient:Mounting kernel clients... 2024-05-10T04:52:35.275 INFO:tasks.kclient:config is {'client.1': {}} 2024-05-10T04:52:35.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:35.275 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-05-10T04:52:35.321 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-10T04:52:35.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:35.322 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-10T04:52:35.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:35.327 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-05-10T04:52:35.400 INFO:teuthology.orchestra.run.smithi117.stderr:Cannot find device "ceph-brx" 2024-05-10T04:52:35.403 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T04:52:35.403 INFO:tasks.kclient:client.1 config is {} 2024-05-10T04:52:35.403 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-10T04:52:35.403 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:35.404 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:52:35.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:35.431 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-10T04:52:35.591 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-10T04:52:35.591 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-10T04:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.683+0000 7feba2e00700 1 Processor -- start 2024-05-10T04:52:35.685 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.683+0000 7feba2e00700 1 -- start start 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feba2e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb9c0c23b0 0x7feb9c155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feba2e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7feb9c155bb0 0x7feb9c155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feba2e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9c0c17d0 con 0x7feb9c152d40 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feba2e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0c30c0 con 0x7feb9c0c23b0 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feba2e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb9c0726d0 con 0x7feb9c155bb0 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feb9b400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb9c0c23b0 0x7feb9c155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feb9b400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7feb9c0c23b0 0x7feb9c155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45076/0 (socket says 172.21.15.47:45076) 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feb9b400700 1 -- 172.21.15.47:0/1287854417 learned_addr learned my addr 172.21.15.47:0/1287854417 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.685+0000 7feba0e00700 1 --2- 172.21.15.47:0/1287854417 >> v2:172.21.15.117:3300/0 conn(0x7feb9c155bb0 0x7feb9c155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9b400700 1 -- 172.21.15.47:0/1287854417 >> v2:172.21.15.117:3300/0 conn(0x7feb9c155bb0 msgr2=0x7feb9c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:52:35.690 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9b400700 1 --2- 172.21.15.47:0/1287854417 >> v2:172.21.15.117:3300/0 conn(0x7feb9c155bb0 0x7feb9c155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9b400700 1 -- 172.21.15.47:0/1287854417 >> v1:172.21.15.117:6789/0 conn(0x7feb9c152d40 legacy=0x7feb9c06abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9b400700 1 -- 172.21.15.47:0/1287854417 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0c1ab0 con 0x7feb9c0c23b0 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9aa00700 1 -- 172.21.15.47:0/1287854417 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2196698794 0 0) 0x7feb9c0c17d0 con 0x7feb9c152d40 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9b400700 1 --2- 172.21.15.47:0/1287854417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c155670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0c1210 tx=0x7feb88009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7bf7a11790a9c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9aa00700 1 -- 172.21.15.47:0/1287854417 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011830 con 0x7feb9c0c23b0 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9aa00700 1 -- 172.21.15.47:0/1287854417 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88011990 con 0x7feb9c0c23b0 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.686+0000 7feb9aa00700 1 -- 172.21.15.47:0/1287854417 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88011d20 con 0x7feb9c0c23b0 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 -- 172.21.15.47:0/1287854417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 msgr2=0x7feb9c155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 --2- 172.21.15.47:0/1287854417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c155670 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb9c0c1210 tx=0x7feb88009bd0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 -- 172.21.15.47:0/1287854417 shutdown_connections 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 --2- 172.21.15.47:0/1287854417 >> v2:172.21.15.117:3300/0 conn(0x7feb9c155bb0 0x7feb9c155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 --2- 172.21.15.47:0/1287854417 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c155670 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 -- 172.21.15.47:0/1287854417 >> 172.21.15.47:0/1287854417 conn(0x7feb9c0c4220 msgr2=0x7feb9c0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.687+0000 7feba2e00700 1 -- 172.21.15.47:0/1287854417 shutdown_connections 2024-05-10T04:52:35.691 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.688+0000 7feba2e00700 1 -- 172.21.15.47:0/1287854417 wait complete. 2024-05-10T04:52:35.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.690+0000 7feba2e00700 1 Processor -- start 2024-05-10T04:52:35.692 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.690+0000 7feba2e00700 1 -- start start 2024-05-10T04:52:35.695 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.692+0000 7feba2e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c0c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.692+0000 7feba2e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb9c152d40 0x7feb9c0ab080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.692+0000 7feba2e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb9c155bb0 0x7feb9c1487b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.692+0000 7feba2e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c149a30 con 0x7feb9c0c23b0 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.692+0000 7feba2e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c0abda0 con 0x7feb9c152d40 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.692+0000 7feba2e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9c14d520 con 0x7feb9c155bb0 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c0c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c0c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45088/0 (socket says 172.21.15.47:45088) 2024-05-10T04:52:35.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 -- 172.21.15.47:0/352079404 learned_addr learned my addr 172.21.15.47:0/352079404 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9b400700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb9c152d40 0x7feb9c0ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feba0e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb9c155bb0 0x7feb9c1487b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 -- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb9c155bb0 msgr2=0x7feb9c1487b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb9c155bb0 0x7feb9c1487b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 -- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb9c152d40 msgr2=0x7feb9c0ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb9c152d40 0x7feb9c0ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 -- 172.21.15.47:0/352079404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb88009550 con 0x7feb9c0c23b0 2024-05-10T04:52:35.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9b400700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb9c152d40 0x7feb9c0ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:52:35.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.693+0000 7feb9be00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c0c67c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.694+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0052e0 con 0x7feb9c0c23b0 2024-05-10T04:52:35.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.694+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c005460 con 0x7feb9c0c23b0 2024-05-10T04:52:35.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.694+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c003910 con 0x7feb9c0c23b0 2024-05-10T04:52:35.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.694+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9c0aabf0 con 0x7feb9c0c23b0 2024-05-10T04:52:35.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.694+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9c14da50 con 0x7feb9c0c23b0 2024-05-10T04:52:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.695+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9c074720 con 0x7feb9c0c23b0 2024-05-10T04:52:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.696+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb8c003a70 con 0x7feb9c0c23b0 2024-05-10T04:52:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.697+0000 7feb93e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb7c06ac90 0x7feb7c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.697+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb8c088940 con 0x7feb9c0c23b0 2024-05-10T04:52:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.698+0000 7feb9b400700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb7c06ac90 0x7feb7c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.698+0000 7feb9b400700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb7c06ac90 0x7feb7c06d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb88000c00 tx=0x7feb88008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.703 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.702+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7feb8c053820 con 0x7feb9c0c23b0 2024-05-10T04:52:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.869+0000 7f1782400700 1 Processor -- start 2024-05-10T04:52:35.871 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.869+0000 7f1782400700 1 -- start start 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f1782400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f177c158fe0 0x7f177c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f1782400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c06cbd0 con 0x7f177c0c8ba0 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f1782400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177c1593f0 con 0x7f177c0c5a00 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f1782400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177c159660 con 0x7f177c158fe0 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f177be00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f177c158fe0 0x7f177c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f1781a00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f177c0c8ba0 0x7f177c0c8fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:57578/0 (socket says 172.21.15.47:57578) 2024-05-10T04:52:35.873 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.871+0000 7f1781a00700 1 -- 172.21.15.47:0/99718283 learned_addr learned my addr 172.21.15.47:0/99718283 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:52:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.872+0000 7f177b400700 1 -- 172.21.15.47:0/99718283 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636178193 0 0) 0x7f177c1593f0 con 0x7f177c0c5a00 2024-05-10T04:52:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.872+0000 7f177be00700 1 -- 172.21.15.47:0/99718283 >> v1:172.21.15.117:6789/0 conn(0x7f177c0c5a00 legacy=0x7f177c1588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.872+0000 7f177be00700 1 -- 172.21.15.47:0/99718283 >> v1:172.21.15.47:6789/0 conn(0x7f177c0c8ba0 legacy=0x7f177c0c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.872+0000 7f177be00700 1 -- 172.21.15.47:0/99718283 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f177c06ce20 con 0x7f177c158fe0 2024-05-10T04:52:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.872+0000 7f177be00700 1 --2- 172.21.15.47:0/99718283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c158fe0 0x7f177c1529e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1768009840 tx=0x7f1768009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca9e4bb192b317a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.872+0000 7f177b400700 1 -- 172.21.15.47:0/99718283 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1768004230 con 0x7f177c158fe0 2024-05-10T04:52:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f177b400700 1 -- 172.21.15.47:0/99718283 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768004390 con 0x7f177c158fe0 2024-05-10T04:52:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f177b400700 1 -- 172.21.15.47:0/99718283 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680036a0 con 0x7f177c158fe0 2024-05-10T04:52:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 -- 172.21.15.47:0/99718283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c158fe0 msgr2=0x7f177c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 --2- 172.21.15.47:0/99718283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c158fe0 0x7f177c1529e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1768009840 tx=0x7f1768009b50 comp rx=0 tx=0).stop 2024-05-10T04:52:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 -- 172.21.15.47:0/99718283 shutdown_connections 2024-05-10T04:52:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 --2- 172.21.15.47:0/99718283 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c158fe0 0x7f177c1529e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 -- 172.21.15.47:0/99718283 >> 172.21.15.47:0/99718283 conn(0x7f177c0ca700 msgr2=0x7f177c0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 -- 172.21.15.47:0/99718283 shutdown_connections 2024-05-10T04:52:35.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.873+0000 7f1782400700 1 -- 172.21.15.47:0/99718283 wait complete. 2024-05-10T04:52:35.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.876+0000 7f1782400700 1 Processor -- start 2024-05-10T04:52:35.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.876+0000 7f1782400700 1 -- start start 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1782400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 0x7f177c1eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1782400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f177c0c8ba0 0x7f177c1eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1782400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f177c158fe0 0x7f177c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1782400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c0c2440 con 0x7f177c0c5a00 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1782400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1ee8f0 con 0x7f177c0c8ba0 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1782400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177c1ee320 con 0x7f177c158fe0 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1781000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 0x7f177c1eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1781000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 0x7f177c1eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:45110/0 (socket says 172.21.15.47:45110) 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.878+0000 7f1781000700 1 -- 172.21.15.47:0/3814953152 learned_addr learned my addr 172.21.15.47:0/3814953152 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:52:35.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f177be00700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f177c0c8ba0 0x7f177c1eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781a00700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f177c158fe0 0x7f177c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781000700 1 -- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f177c158fe0 msgr2=0x7f177c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781000700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f177c158fe0 0x7f177c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781000700 1 -- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f177c0c8ba0 msgr2=0x7f177c1eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781000700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f177c0c8ba0 0x7f177c1eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781000700 1 -- 172.21.15.47:0/3814953152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17680094a0 con 0x7f177c0c5a00 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781a00700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f177c158fe0 0x7f177c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1781000700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 0x7f177c1eae00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f177000c450 tx=0x7f177000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17700054e0 con 0x7f177c0c5a00 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1770003680 con 0x7f177c0c5a00 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770003a30 con 0x7f177c0c5a00 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177c1eb440 con 0x7f177c0c5a00 2024-05-10T04:52:35.882 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.879+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177c1e1210 con 0x7f177c0c5a00 2024-05-10T04:52:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.881+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177c1eeb60 con 0x7f177c0c5a00 2024-05-10T04:52:35.883 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.882+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1770003b90 con 0x7f177c0c5a00 2024-05-10T04:52:35.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.882+0000 7f1778c00700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f175c06ac90 0x7f175c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:52:35.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.883+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1770088aa0 con 0x7f177c0c5a00 2024-05-10T04:52:35.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.883+0000 7f177be00700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f175c06ac90 0x7f175c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:52:35.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.884+0000 7f177be00700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f175c06ac90 0x7f175c06d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1768009840 tx=0x7f1768008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:52:35.889 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:35.887+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1770053980 con 0x7f177c0c5a00 2024-05-10T04:52:36.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.016+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb9c0aad80 con 0x7feb9c0c23b0 2024-05-10T04:52:36.018 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.017+0000 7feb93e00700 1 -- 172.21.15.47:0/352079404 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7feb8c017070 con 0x7feb9c0c23b0 2024-05-10T04:52:36.019 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T04:52:36.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb7c06ac90 msgr2=0x7feb7c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:36.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb7c06ac90 0x7feb7c06d1a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7feb88000c00 tx=0x7feb88008030 comp rx=0 tx=0).stop 2024-05-10T04:52:36.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 msgr2=0x7feb9c0c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:36.021 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c0c67c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00c430 tx=0x7feb8c00c740 comp rx=0 tx=0).stop 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 shutdown_connections 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7feb7c06ac90 0x7feb7c06d1a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7feb9c155bb0 0x7feb9c1487b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7feb9c0c23b0 0x7feb9c0c67c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 --2- 172.21.15.47:0/352079404 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7feb9c152d40 0x7feb9c0ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.019+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 >> 172.21.15.47:0/352079404 conn(0x7feb9c0c4220 msgr2=0x7feb9c072990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.020+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 shutdown_connections 2024-05-10T04:52:36.022 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.020+0000 7feba2e00700 1 -- 172.21.15.47:0/352079404 wait complete. 2024-05-10T04:52:36.049 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:52:36.049 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:52:36.049 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi117.front.sepia.ceph.com 2024-05-10T04:52:36.049 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-05-10T04:52:36.049 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:36.049 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:52:36.050 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:52:36.050 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:52:36.050 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-05-10T04:52:36.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.050 DEBUG:teuthology.orchestra.run.smithi117:> ip addr 2024-05-10T04:52:36.096 INFO:teuthology.orchestra.run.smithi117.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:52:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:52:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:52:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 ::1/128 scope host 2024-05-10T04:52:36.096 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8a brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f0 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:d8:a8:8b brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: altname enp7s0f1 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:62 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: link/ether 0c:c4:7a:8f:44:63 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: inet 172.21.15.117/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft 42470sec preferred_lft 42470sec 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: inet6 fe80::ec4:7aff:fe8f:4463/64 scope link 2024-05-10T04:52:36.097 INFO:teuthology.orchestra.run.smithi117.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:36.098 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:52:36.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr flush dev ceph-brx 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set ceph-brx up 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:52:36.099 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-10T04:52:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.199+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f177c074720 con 0x7f177c0c5a00 2024-05-10T04:52:36.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.199+0000 7f1778c00700 1 -- 172.21.15.47:0/3814953152 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1770017020 con 0x7f177c0c5a00 2024-05-10T04:52:36.201 INFO:teuthology.orchestra.run.smithi047.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f175c06ac90 msgr2=0x7f175c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f175c06ac90 0x7f175c06d1a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1768009840 tx=0x7f1768008030 comp rx=0 tx=0).stop 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 msgr2=0x7f177c1eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 0x7f177c1eae00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f177000c450 tx=0x7f177000c810 comp rx=0 tx=0).stop 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 shutdown_connections 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f175c06ac90 0x7f175c06d1a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f177c158fe0 0x7f177c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f177c0c5a00 0x7f177c1eae00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 --2- 172.21.15.47:0/3814953152 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f177c0c8ba0 0x7f177c1eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 >> 172.21.15.47:0/3814953152 conn(0x7f177c0ca700 msgr2=0x7f177c0ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:52:36.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 shutdown_connections 2024-05-10T04:52:36.205 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:52:36.202+0000 7f1782400700 1 -- 172.21.15.47:0/3814953152 wait complete. 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi047.front.sepia.ceph.com 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-10T04:52:36.229 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:52:36.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.230 DEBUG:teuthology.orchestra.run.smithi047:> ip addr 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: inet 127.0.0.1/8 scope host lo 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 ::1/128 scope host 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:78 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.275 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f0 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:6b:ff:79 brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp7s0f1 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8e brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f0 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: inet 172.21.15.47/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft 42461sec preferred_lft 42461sec 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: inet6 fe80::ec4:7aff:febd:148e/64 scope link 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: valid_lft forever preferred_lft forever 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: link/ether 0c:c4:7a:bd:14:8f brd ff:ff:ff:ff:ff:ff 2024-05-10T04:52:36.276 INFO:teuthology.orchestra.run.smithi047.stdout: altname enp1s0f1 2024-05-10T04:52:36.278 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-10T04:52:36.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add name ceph-brx type bridge 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr flush dev ceph-brx 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set ceph-brx up 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-10T04:52:36.278 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:36.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.510 DEBUG:teuthology.orchestra.run.smithi047:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:52:36.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.565 DEBUG:teuthology.orchestra.run.smithi117:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-10T04:52:36.577 INFO:teuthology.orchestra.run.smithi047.stdout:1 2024-05-10T04:52:36.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.580 DEBUG:teuthology.orchestra.run.smithi047:> route 2024-05-10T04:52:36.627 INFO:teuthology.orchestra.run.smithi047.stdout:Kernel IP routing table 2024-05-10T04:52:36.628 INFO:teuthology.orchestra.run.smithi047.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:52:36.628 INFO:teuthology.orchestra.run.smithi047.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-05-10T04:52:36.628 INFO:teuthology.orchestra.run.smithi047.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-05-10T04:52:36.628 INFO:teuthology.orchestra.run.smithi047.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:52:36.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.629 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:36.630 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:36.630 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-10T04:52:36.630 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-10T04:52:36.630 DEBUG:teuthology.orchestra.run.smithi047:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-10T04:52:36.630 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:36.669 INFO:teuthology.orchestra.run.smithi117.stdout:1 2024-05-10T04:52:36.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.672 DEBUG:teuthology.orchestra.run.smithi117:> route 2024-05-10T04:52:36.742 INFO:teuthology.orchestra.run.smithi117.stdout:Kernel IP routing table 2024-05-10T04:52:36.742 INFO:teuthology.orchestra.run.smithi117.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-10T04:52:36.743 INFO:teuthology.orchestra.run.smithi117.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-10T04:52:36.743 INFO:teuthology.orchestra.run.smithi117.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-10T04:52:36.743 INFO:teuthology.orchestra.run.smithi117.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-10T04:52:36.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.744 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-10T04:52:36.744 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-10T04:52:36.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-10T04:52:36.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-10T04:52:36.744 DEBUG:teuthology.orchestra.run.smithi117:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-10T04:52:36.744 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-10T04:52:36.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.794 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-10T04:52:36.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.839 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list-id 2024-05-10T04:52:36.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:36.924 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:36.924 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:36.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:52:36.924 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-10T04:52:36.924 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:37.102 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-10T04:52:37.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-10T04:52:37.103 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:37.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.340 DEBUG:teuthology.orchestra.run.smithi047:> (cd / && exec bash -c ' 2024-05-10T04:52:37.340 DEBUG:teuthology.orchestra.run.smithi047:> set -e 2024-05-10T04:52:37.340 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set brx.0 up 2024-05-10T04:52:37.341 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:52:37.341 DEBUG:teuthology.orchestra.run.smithi047:> ') 2024-05-10T04:52:37.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.461 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-05-10T04:52:37.508 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-10T04:52:37.508 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:52:37.508 DEBUG:teuthology.orchestra.run.smithi047:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:37.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.509 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list-id 2024-05-10T04:52:37.553 INFO:teuthology.orchestra.run.smithi047.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-10T04:52:37.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:52:37.554 DEBUG:teuthology.orchestra.run.smithi047:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:37.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.594 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-10T04:52:37.594 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-10T04:52:37.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T04:52:37.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-05-10T04:52:37.594 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-10T04:52:37.637 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-10T04:52:37.745 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:52:37.745 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T04:52:37.769 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-05-10T04:52:37.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-05-10T04:52:37.770 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-10T04:52:37.811 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T04:52:37.813 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T04:52:37.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:37.814 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-10T04:52:37.857 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-10T04:52:37.858 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-10T04:52:37.902 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-10T04:52:37.970 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:52:37.970 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T04:52:38.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:38.024 DEBUG:teuthology.orchestra.run.smithi117:> (cd / && exec bash -c ' 2024-05-10T04:52:38.024 DEBUG:teuthology.orchestra.run.smithi117:> set -e 2024-05-10T04:52:38.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set brx.0 up 2024-05-10T04:52:38.024 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link set dev brx.0 master ceph-brx 2024-05-10T04:52:38.024 DEBUG:teuthology.orchestra.run.smithi117:> ') 2024-05-10T04:52:38.037 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T04:52:38.039 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T04:52:38.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:38.040 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-10T04:52:38.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:2024-05-10T04:52:38.137+0000 7f6ce1c685c0 -1 init, newargv = 0x7f6cc0001210 newargc=15 2024-05-10T04:52:38.139 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[53803]: starting ceph client 2024-05-10T04:52:38.146 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[53803]: starting fuse 2024-05-10T04:52:38.193 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:52:38.193 DEBUG:teuthology.orchestra.run.smithi117:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:38.238 INFO:teuthology.orchestra.run.smithi117.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-05-10T04:52:38.238 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-10T04:52:38.238 DEBUG:teuthology.orchestra.run.smithi117:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:38.322 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-05-10T04:52:38.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:38.323 DEBUG:teuthology.orchestra.run.smithi117:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:52:38.534 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:52:38.534 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:52:39.186 DEBUG:teuthology.orchestra.run.smithi047:> sudo modprobe fuse 2024-05-10T04:52:39.256 INFO:teuthology.orchestra.run.smithi117.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-05-10T04:52:39.256 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-05-10T04:52:39.256 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: resolved to: "172.21.15.47:3300,172.21.15.117:3300,172.21.15.117:3301" 2024-05-10T04:52:39.256 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: trying mount with new device syntax: 1@63debaa4-fa23-4f28-8f14-9786e692137f.cephfs=/ 2024-05-10T04:52:39.257 INFO:teuthology.orchestra.run.smithi117.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.47:3300/172.21.15.117:3300/172.21.15.117:3301" will pass to kernel 2024-05-10T04:52:39.262 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-10T04:52:39.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.262 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:39.263 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-05-10T04:52:39.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-05-10T04:52:39.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.472 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:52:39.473 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-05-10T04:52:39.474 INFO:teuthology.orchestra.run.smithi047.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-05-10T04:52:39.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.474 DEBUG:teuthology.orchestra.run.smithi047:> ls /sys/fs/fuse/connections 2024-05-10T04:52:39.520 INFO:teuthology.orchestra.run.smithi047.stdout:45 2024-05-10T04:52:39.521 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> import glob 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> import re 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> import os 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> import subprocess 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:39.521 DEBUG:teuthology.orchestra.run.smithi047:> def _find_admin_socket(client_name): 2024-05-10T04:52:39.522 DEBUG:teuthology.orchestra.run.smithi047:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-10T04:52:39.522 DEBUG:teuthology.orchestra.run.smithi047:> files = glob.glob(asok_path) 2024-05-10T04:52:39.522 DEBUG:teuthology.orchestra.run.smithi047:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-10T04:52:39.522 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:39.522 DEBUG:teuthology.orchestra.run.smithi047:> # Given a non-glob path, it better be there 2024-05-10T04:52:39.523 DEBUG:teuthology.orchestra.run.smithi047:> if "*" not in asok_path: 2024-05-10T04:52:39.525 DEBUG:teuthology.orchestra.run.smithi047:> assert(len(files) == 1) 2024-05-10T04:52:39.526 DEBUG:teuthology.orchestra.run.smithi047:> return files[0] 2024-05-10T04:52:39.526 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:39.526 DEBUG:teuthology.orchestra.run.smithi047:> for f in files: 2024-05-10T04:52:39.526 DEBUG:teuthology.orchestra.run.smithi047:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-10T04:52:39.526 DEBUG:teuthology.orchestra.run.smithi047:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-10T04:52:39.526 DEBUG:teuthology.orchestra.run.smithi047:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> contents = proc_f.read() 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> if mountpoint in contents: 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> return f 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> print(_find_admin_socket("client.0")) 2024-05-10T04:52:39.527 DEBUG:teuthology.orchestra.run.smithi047:> ' 2024-05-10T04:52:39.568 INFO:teuthology.orchestra.run.smithi117.stdout:client4813 2024-05-10T04:52:39.568 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:52:39.568 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:52:39.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.613 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:52:39.704 INFO:teuthology.orchestra.run.smithi047.stdout:/var/run/ceph/ceph-client.0.53803.asok 2024-05-10T04:52:39.739 INFO:teuthology.orchestra.run.smithi117.stdout:client4813 2024-05-10T04:52:39.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.740 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-10T04:52:39.826 INFO:teuthology.orchestra.run.smithi117.stdout:client4813 2024-05-10T04:52:39.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.826 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/63debaa4-fa23-4f28-8f14-9786e692137f.client4813/status') 2024-05-10T04:52:39.882 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53803.asok 2024-05-10T04:52:39.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:39.882 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53803.asok status 2024-05-10T04:52:39.930 INFO:teuthology.orchestra.run.smithi117.stdout:instance: client.4813 (3)192.168.0.1:0/3192756863 2024-05-10T04:52:39.930 INFO:teuthology.orchestra.run.smithi117.stdout:blocklisted: false 2024-05-10T04:52:39.930 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records in 2024-05-10T04:52:39.930 INFO:teuthology.orchestra.run.smithi117.stderr:0+1 records out 2024-05-10T04:52:39.931 INFO:teuthology.orchestra.run.smithi117.stderr:69 bytes copied, 5.1701e-05 s, 1.3 MB/s 2024-05-10T04:52:39.933 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-10T04:52:39.937 INFO:tasks.workunit:Pulling workunits from ref 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:52:39.938 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-10T04:52:39.938 DEBUG:teuthology.orchestra.run.smithi117:> stat -- /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout:Context: system_u:object_r:cephfs_t:s0 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout:Modify: 2024-05-10 04:51:52.723989214 +0000 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout:Change: 2024-05-10 04:52:06.907498250 +0000 2024-05-10T04:52:39.983 INFO:teuthology.orchestra.run.smithi117.stdout: Birth: 2024-05-10 04:51:52.723989214 +0000 2024-05-10T04:52:39.984 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-05-10T04:52:39.984 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-05-10T04:52:40.097 INFO:tasks.workunit:timeout=3h 2024-05-10T04:52:40.097 INFO:tasks.workunit:cleanup=True 2024-05-10T04:52:40.097 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:52:40.145 INFO:tasks.workunit.client.1.smithi117.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout: "metadata": { 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_sha1": "50174015a7e79f951b988949abe236791f52d4da", 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout: "ceph_version": "ceph version 18.2.2-1330-g50174015 (50174015a7e79f951b988949abe236791f52d4da) reef (stable)", 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout: "entity_id": "0", 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout: "hostname": "smithi047", 2024-05-10T04:52:40.184 INFO:teuthology.orchestra.run.smithi047.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "pid": "53803", 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "root": "/" 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_count": 0, 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "dentry_pinned_count": 0, 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "id": 4845, 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "inst": { 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "name": { 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "client", 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "num": 4845 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-10T04:52:40.185 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3876569020 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: } 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": { 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "type": "v1", 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "addr": "192.168.0.1:0", 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "nonce": 3876569020 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: }, 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "inst_str": "client.4845 192.168.0.1:0/3876569020", 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "addr_str": "192.168.0.1:0/3876569020", 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "inode_count": 1, 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "mds_epoch": 9, 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch": 26, 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "osd_epoch_barrier": 26, 2024-05-10T04:52:40.186 INFO:teuthology.orchestra.run.smithi047.stdout: "blocklisted": false, 2024-05-10T04:52:40.187 INFO:teuthology.orchestra.run.smithi047.stdout: "fs_name": "cephfs" 2024-05-10T04:52:40.187 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T04:52:40.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:40.206 DEBUG:teuthology.orchestra.run.smithi047:> stat --file-system '--printf=%T 2024-05-10T04:52:40.206 DEBUG:teuthology.orchestra.run.smithi047:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:40.250 INFO:teuthology.orchestra.run.smithi047.stdout:fuseblk 2024-05-10T04:52:40.250 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:40.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:52:40.251 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:40.366 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-05-10T04:52:40.367 INFO:tasks.workunit:Pulling workunits from ref 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:52:40.367 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-10T04:52:40.367 DEBUG:teuthology.orchestra.run.smithi047:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:40.415 INFO:teuthology.orchestra.run.smithi047.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-10T04:52:40.415 INFO:teuthology.orchestra.run.smithi047.stdout:Device: 2dh/45d Inode: 1 Links: 3 2024-05-10T04:52:40.415 INFO:teuthology.orchestra.run.smithi047.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-10T04:52:40.415 INFO:teuthology.orchestra.run.smithi047.stdout:Context: system_u:object_r:fusefs_t:s0 2024-05-10T04:52:40.415 INFO:teuthology.orchestra.run.smithi047.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-10T04:52:40.416 INFO:teuthology.orchestra.run.smithi047.stdout:Modify: 2024-05-10 04:52:40.087612835 +0000 2024-05-10T04:52:40.416 INFO:teuthology.orchestra.run.smithi047.stdout:Change: 2024-05-10 04:52:40.087612835 +0000 2024-05-10T04:52:40.416 INFO:teuthology.orchestra.run.smithi047.stdout: Birth: - 2024-05-10T04:52:40.416 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-10T04:52:40.416 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-10T04:52:40.531 INFO:tasks.workunit:timeout=3h 2024-05-10T04:52:40.531 INFO:tasks.workunit:cleanup=True 2024-05-10T04:52:40.533 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 50174015a7e79f951b988949abe236791f52d4da 2024-05-10T04:52:40.579 INFO:tasks.workunit.client.0.smithi047.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-10T04:52:51.062 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:52:51.068 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:53:21.373 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:53:21.379 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:53:51.481 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:53:51.488 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:54:09.860 INFO:tasks.workunit.client.1.smithi117.stderr:Updating files: 64% (7857/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-10T04:54:11.026 INFO:tasks.workunit.client.1.smithi117.stderr:Note: switching to '50174015a7e79f951b988949abe236791f52d4da'. 2024-05-10T04:54:11.026 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.026 INFO:tasks.workunit.client.1.smithi117.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr:state without impacting any branches by switching back to a branch. 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: git switch -c 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr:Or undo this operation with: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: git switch - 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-10T04:54:11.027 INFO:tasks.workunit.client.1.smithi117.stderr: 2024-05-10T04:54:11.028 INFO:tasks.workunit.client.1.smithi117.stderr:HEAD is now at 50174015a7e Merge PR #57343 into wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T04:54:11.041 DEBUG:teuthology.orchestra.run.smithi117:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-05-10T04:54:11.091 INFO:tasks.workunit.client.1.smithi117.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-10T04:54:11.096 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-10T04:54:11.096 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-10T04:54:11.931 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-10T04:54:12.016 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-10T04:54:12.079 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-05-10T04:54:12.084 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-10T04:54:12.084 INFO:tasks.workunit.client.1.smithi117.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-10T04:54:12.132 INFO:tasks.workunit.client.0.smithi047.stderr:Updating files: 61% (7495/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-10T04:54:12.145 INFO:tasks.workunit.client.1.smithi117.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-05-10T04:54:12.152 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T04:54:12.152 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-05-10T04:54:12.201 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.1... 2024-05-10T04:54:12.203 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2024-05-10T04:54:12.203 DEBUG:teuthology.orchestra.run.smithi117:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50174015a7e79f951b988949abe236791f52d4da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/dbench.sh 2024-05-10T04:54:12.314 INFO:tasks.workunit.client.1.smithi117.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-10T04:54:12.315 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-10T04:54:12.315 INFO:tasks.workunit.client.1.smithi117.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-10T04:54:12.319 INFO:tasks.workunit.client.1.smithi117.stdout:0 of 1 processes prepared for launch 0 sec 2024-05-10T04:54:12.420 INFO:tasks.workunit.client.1.smithi117.stdout:1 of 1 processes prepared for launch 0 sec 2024-05-10T04:54:12.420 INFO:tasks.workunit.client.1.smithi117.stdout:releasing clients 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr:Note: switching to '50174015a7e79f951b988949abe236791f52d4da'. 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr:state without impacting any branches by switching back to a branch. 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr: git switch -c 2024-05-10T04:54:12.978 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr:Or undo this operation with: 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr: git switch - 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr: 2024-05-10T04:54:12.979 INFO:tasks.workunit.client.0.smithi047.stderr:HEAD is now at 50174015a7e Merge PR #57343 into wip-pdonnell-testing-20240509.171335-reef-debug 2024-05-10T04:54:12.995 DEBUG:teuthology.orchestra.run.smithi047:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-10T04:54:13.051 INFO:tasks.workunit.client.0.smithi047.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-10T04:54:13.056 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T04:54:13.056 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-10T04:54:13.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 2880 32.19 MB/sec warmup 1 sec latency 7.738 ms 2024-05-10T04:54:13.838 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-10T04:54:13.931 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-10T04:54:14.000 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-10T04:54:14.006 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T04:54:14.006 INFO:tasks.workunit.client.0.smithi047.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-10T04:54:14.072 INFO:tasks.workunit.client.0.smithi047.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-10T04:54:14.082 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:54:14.082 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-10T04:54:14.134 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-10T04:54:14.135 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-10T04:54:14.136 DEBUG:teuthology.orchestra.run.smithi047:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=50174015a7e79f951b988949abe236791f52d4da TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-10T04:54:14.207 INFO:tasks.workunit.client.0.smithi047.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-10T04:54:14.276 INFO:tasks.workunit.client.0.smithi047.stdout: Iozone: Performance Test of File I/O 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Version $Revision: 3.489 $ 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Compiled for 64 bit mode. 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Build: linux-AMD64 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:54:14.277 INFO:tasks.workunit.client.0.smithi047.stdout: Run began: Fri May 10 04:54:14 2024 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Include close in write timing 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Include fsync in write timing 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: File size set to 1048576 kB 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Record Size 16 kB 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Output is in kBytes/sec 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Time Resolution = 0.000001 seconds. 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache size set to 1024 kBytes. 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache line size set to 32 bytes. 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: File stride size set to 17 * record size. 2024-05-10T04:54:14.278 INFO:tasks.workunit.client.0.smithi047.stdout: Throughput test with 1 process 2024-05-10T04:54:14.279 INFO:tasks.workunit.client.0.smithi047.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-10T04:54:14.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 5650 22.88 MB/sec warmup 2 sec latency 8.380 ms 2024-05-10T04:54:15.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 8025 20.00 MB/sec warmup 3 sec latency 11.251 ms 2024-05-10T04:54:16.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 11092 19.57 MB/sec warmup 4 sec latency 14.265 ms 2024-05-10T04:54:17.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 13862 18.33 MB/sec warmup 5 sec latency 35.168 ms 2024-05-10T04:54:18.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 16174 17.15 MB/sec warmup 6 sec latency 10.937 ms 2024-05-10T04:54:19.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 18646 16.75 MB/sec warmup 7 sec latency 10.619 ms 2024-05-10T04:54:20.420 INFO:tasks.workunit.client.1.smithi117.stdout: 1 21721 16.96 MB/sec warmup 8 sec latency 11.141 ms 2024-05-10T04:54:21.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 24305 16.48 MB/sec warmup 9 sec latency 56.714 ms 2024-05-10T04:54:21.596 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:54:21.601 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:54:22.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 26831 16.03 MB/sec warmup 10 sec latency 12.194 ms 2024-05-10T04:54:23.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 29217 15.86 MB/sec warmup 11 sec latency 29.283 ms 2024-05-10T04:54:24.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 32385 16.09 MB/sec warmup 12 sec latency 11.491 ms 2024-05-10T04:54:25.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 35326 15.97 MB/sec warmup 13 sec latency 10.813 ms 2024-05-10T04:54:26.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 37805 15.64 MB/sec warmup 14 sec latency 27.363 ms 2024-05-10T04:54:27.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 40159 15.55 MB/sec warmup 15 sec latency 8.075 ms 2024-05-10T04:54:28.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 43155 15.65 MB/sec warmup 16 sec latency 9.474 ms 2024-05-10T04:54:29.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 45960 15.58 MB/sec warmup 17 sec latency 30.264 ms 2024-05-10T04:54:30.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 48625 15.41 MB/sec warmup 18 sec latency 13.840 ms 2024-05-10T04:54:31.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 51196 15.46 MB/sec warmup 19 sec latency 10.671 ms 2024-05-10T04:54:32.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 53546 15.37 MB/sec warmup 20 sec latency 180.602 ms 2024-05-10T04:54:33.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 55004 14.91 MB/sec warmup 21 sec latency 120.019 ms 2024-05-10T04:54:34.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 57238 14.86 MB/sec warmup 22 sec latency 42.809 ms 2024-05-10T04:54:35.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 60334 14.97 MB/sec warmup 23 sec latency 10.735 ms 2024-05-10T04:54:35.615 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:54:35.616 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 initial writers = 49155.21 kB/sec 2024-05-10T04:54:35.616 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 initial writers = 49153.23 kB/sec 2024-05-10T04:54:35.616 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 49155.21 kB/sec 2024-05-10T04:54:35.616 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 49155.21 kB/sec 2024-05-10T04:54:35.616 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 49155.21 kB/sec 2024-05-10T04:54:35.616 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:54:36.421 INFO:tasks.workunit.client.1.smithi117.stdout: 1 62797 14.74 MB/sec warmup 24 sec latency 16.048 ms 2024-05-10T04:54:37.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 64586 14.62 MB/sec warmup 25 sec latency 266.308 ms 2024-05-10T04:54:38.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 66466 14.35 MB/sec warmup 26 sec latency 306.981 ms 2024-05-10T04:54:39.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 67788 14.23 MB/sec warmup 27 sec latency 442.267 ms 2024-05-10T04:54:40.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 70348 14.17 MB/sec warmup 28 sec latency 27.748 ms 2024-05-10T04:54:41.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 72078 13.98 MB/sec warmup 29 sec latency 162.278 ms 2024-05-10T04:54:42.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 74979 14.09 MB/sec warmup 30 sec latency 14.173 ms 2024-05-10T04:54:43.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 77870 14.10 MB/sec warmup 31 sec latency 9.332 ms 2024-05-10T04:54:44.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 80122 13.98 MB/sec warmup 32 sec latency 9.319 ms 2024-05-10T04:54:45.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 82368 13.97 MB/sec warmup 33 sec latency 34.994 ms 2024-05-10T04:54:46.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 85474 14.11 MB/sec warmup 34 sec latency 31.010 ms 2024-05-10T04:54:47.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 88344 14.09 MB/sec warmup 35 sec latency 9.460 ms 2024-05-10T04:54:48.422 INFO:tasks.workunit.client.1.smithi117.stdout: 1 90232 14.00 MB/sec warmup 36 sec latency 42.323 ms 2024-05-10T04:54:49.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 93002 14.01 MB/sec warmup 37 sec latency 7.631 ms 2024-05-10T04:54:50.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 96055 14.13 MB/sec warmup 38 sec latency 25.052 ms 2024-05-10T04:54:51.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 98398 13.98 MB/sec warmup 39 sec latency 19.372 ms 2024-05-10T04:54:51.713 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:54:51.718 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:54:52.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 100583 13.96 MB/sec warmup 40 sec latency 10.963 ms 2024-05-10T04:54:53.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 103387 14.04 MB/sec warmup 41 sec latency 28.519 ms 2024-05-10T04:54:54.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 106278 14.05 MB/sec warmup 42 sec latency 28.285 ms 2024-05-10T04:54:55.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 108779 13.99 MB/sec warmup 43 sec latency 9.238 ms 2024-05-10T04:54:56.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 110760 13.96 MB/sec warmup 44 sec latency 31.977 ms 2024-05-10T04:54:57.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 113868 14.06 MB/sec warmup 45 sec latency 10.476 ms 2024-05-10T04:54:58.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 116509 14.03 MB/sec warmup 46 sec latency 11.790 ms 2024-05-10T04:54:58.565 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:54:58.565 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 rewriters = 57032.97 kB/sec 2024-05-10T04:54:58.565 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 rewriters = 57030.13 kB/sec 2024-05-10T04:54:58.566 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 57032.97 kB/sec 2024-05-10T04:54:58.566 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 57032.97 kB/sec 2024-05-10T04:54:58.566 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 57032.97 kB/sec 2024-05-10T04:54:58.566 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:54:59.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 118740 13.98 MB/sec warmup 47 sec latency 30.251 ms 2024-05-10T04:55:00.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 121423 13.99 MB/sec warmup 48 sec latency 9.324 ms 2024-05-10T04:55:01.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 124569 14.09 MB/sec warmup 49 sec latency 7.866 ms 2024-05-10T04:55:02.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 127352 14.07 MB/sec warmup 50 sec latency 32.518 ms 2024-05-10T04:55:03.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 129818 14.02 MB/sec warmup 51 sec latency 7.627 ms 2024-05-10T04:55:04.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 132082 14.02 MB/sec warmup 52 sec latency 38.050 ms 2024-05-10T04:55:05.091 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:05.092 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 readers = 5037526.00 kB/sec 2024-05-10T04:55:05.092 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 readers = 5015552.25 kB/sec 2024-05-10T04:55:05.092 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 5037526.00 kB/sec 2024-05-10T04:55:05.092 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 5037526.00 kB/sec 2024-05-10T04:55:05.092 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 5037526.00 kB/sec 2024-05-10T04:55:05.092 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:55:05.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 135182 14.11 MB/sec warmup 53 sec latency 32.115 ms 2024-05-10T04:55:06.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 138183 14.11 MB/sec warmup 54 sec latency 6.539 ms 2024-05-10T04:55:07.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 139890 14.03 MB/sec warmup 55 sec latency 195.760 ms 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 re-readers = 3449681.50 kB/sec 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 re-readers = 3442377.72 kB/sec 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 3449681.50 kB/sec 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 3449681.50 kB/sec 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 3449681.50 kB/sec 2024-05-10T04:55:07.778 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:55:08.423 INFO:tasks.workunit.client.1.smithi117.stdout: 1 142589 14.04 MB/sec warmup 56 sec latency 32.555 ms 2024-05-10T04:55:09.426 INFO:tasks.workunit.client.1.smithi117.stdout: 1 145679 14.12 MB/sec warmup 57 sec latency 59.029 ms 2024-05-10T04:55:10.426 INFO:tasks.workunit.client.1.smithi117.stdout: 1 145873 13.88 MB/sec warmup 58 sec latency 423.569 ms 2024-05-10T04:55:11.426 INFO:tasks.workunit.client.1.smithi117.stdout: 1 148230 13.83 MB/sec warmup 59 sec latency 26.463 ms 2024-05-10T04:55:12.426 INFO:tasks.workunit.client.1.smithi117.stdout: 1 150530 13.82 MB/sec warmup 60 sec latency 33.634 ms 2024-05-10T04:55:13.426 INFO:tasks.workunit.client.1.smithi117.stdout: 1 153239 13.83 MB/sec warmup 61 sec latency 63.400 ms 2024-05-10T04:55:14.428 INFO:tasks.workunit.client.1.smithi117.stdout: 1 156386 13.90 MB/sec warmup 62 sec latency 17.084 ms 2024-05-10T04:55:15.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 156652 13.69 MB/sec warmup 63 sec latency 159.767 ms 2024-05-10T04:55:15.947 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:15.947 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:15.948 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:15.948 INFO:tasks.workunit.client.0.smithi047.stdout:iozone test complete. 2024-05-10T04:55:15.952 INFO:tasks.workunit.client.0.smithi047.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-10T04:55:16.035 INFO:tasks.workunit.client.0.smithi047.stdout: Iozone: Performance Test of File I/O 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Version $Revision: 3.489 $ 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Compiled for 64 bit mode. 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Build: linux-AMD64 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-10T04:55:16.036 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Run began: Fri May 10 04:55:15 2024 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Include close in write timing 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Include fsync in write timing 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: File size set to 1048576 kB 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Record Size 1024 kB 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Output is in kBytes/sec 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Time Resolution = 0.000001 seconds. 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache size set to 1024 kBytes. 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache line size set to 32 bytes. 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: File stride size set to 17 * record size. 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Throughput test with 1 process 2024-05-10T04:55:16.037 INFO:tasks.workunit.client.0.smithi047.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-10T04:55:16.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 157869 13.56 MB/sec warmup 64 sec latency 33.893 ms 2024-05-10T04:55:17.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 159361 13.49 MB/sec warmup 65 sec latency 338.535 ms 2024-05-10T04:55:18.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 160462 13.36 MB/sec warmup 66 sec latency 44.507 ms 2024-05-10T04:55:19.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 162663 13.34 MB/sec warmup 67 sec latency 15.667 ms 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 initial writers = 297197.91 kB/sec 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 initial writers = 297103.92 kB/sec 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 297197.91 kB/sec 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 297197.91 kB/sec 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 297197.91 kB/sec 2024-05-10T04:55:19.600 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:55:20.428 INFO:tasks.workunit.client.1.smithi117.stdout: 1 164800 13.32 MB/sec warmup 68 sec latency 26.439 ms 2024-05-10T04:55:21.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 167256 13.33 MB/sec warmup 69 sec latency 123.475 ms 2024-05-10T04:55:21.827 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:55:21.831 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:55:22.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 169491 13.30 MB/sec warmup 70 sec latency 266.068 ms 2024-05-10T04:55:23.427 INFO:tasks.workunit.client.1.smithi117.stdout: 1 170951 13.23 MB/sec warmup 71 sec latency 116.552 ms 2024-05-10T04:55:24.428 INFO:tasks.workunit.client.1.smithi117.stdout: 1 172570 13.13 MB/sec warmup 72 sec latency 53.470 ms 2024-05-10T04:55:25.428 INFO:tasks.workunit.client.1.smithi117.stdout: 1 174068 13.12 MB/sec warmup 73 sec latency 30.734 ms 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 rewriters = 385367.75 kB/sec 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 rewriters = 385234.09 kB/sec 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 385367.75 kB/sec 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 385367.75 kB/sec 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 385367.75 kB/sec 2024-05-10T04:55:25.629 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:55:26.428 INFO:tasks.workunit.client.1.smithi117.stdout: 1 176393 13.05 MB/sec warmup 74 sec latency 32.859 ms 2024-05-10T04:55:27.428 INFO:tasks.workunit.client.1.smithi117.stdout: 1 179015 13.10 MB/sec warmup 75 sec latency 7.321 ms 2024-05-10T04:55:28.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 181796 13.12 MB/sec warmup 76 sec latency 12.252 ms 2024-05-10T04:55:29.347 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:29.347 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 readers = 4914975.00 kB/sec 2024-05-10T04:55:29.347 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 readers = 4896436.11 kB/sec 2024-05-10T04:55:29.348 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 4914975.00 kB/sec 2024-05-10T04:55:29.348 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 4914975.00 kB/sec 2024-05-10T04:55:29.348 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 4914975.00 kB/sec 2024-05-10T04:55:29.348 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:55:29.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 184862 13.19 MB/sec warmup 77 sec latency 18.800 ms 2024-05-10T04:55:30.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 187969 13.24 MB/sec warmup 78 sec latency 22.461 ms 2024-05-10T04:55:31.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 190442 13.18 MB/sec warmup 79 sec latency 33.481 ms 2024-05-10T04:55:31.855 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:31.855 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 re-readers = 3982800.75 kB/sec 2024-05-10T04:55:31.855 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 re-readers = 3971546.84 kB/sec 2024-05-10T04:55:31.855 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 3982800.75 kB/sec 2024-05-10T04:55:31.855 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 3982800.75 kB/sec 2024-05-10T04:55:31.855 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 3982800.75 kB/sec 2024-05-10T04:55:31.856 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 1048576.00 kB 2024-05-10T04:55:32.430 INFO:tasks.workunit.client.1.smithi117.stdout: 1 192930 13.23 MB/sec warmup 80 sec latency 21.650 ms 2024-05-10T04:55:33.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 195795 13.25 MB/sec warmup 81 sec latency 13.572 ms 2024-05-10T04:55:34.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 198917 13.31 MB/sec warmup 82 sec latency 34.500 ms 2024-05-10T04:55:35.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 201648 13.31 MB/sec warmup 83 sec latency 24.704 ms 2024-05-10T04:55:36.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 204544 13.31 MB/sec warmup 84 sec latency 7.514 ms 2024-05-10T04:55:37.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 206673 13.30 MB/sec warmup 85 sec latency 20.068 ms 2024-05-10T04:55:38.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 209662 13.36 MB/sec warmup 86 sec latency 17.365 ms 2024-05-10T04:55:39.284 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:39.284 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:39.285 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:39.285 INFO:tasks.workunit.client.0.smithi047.stdout:iozone test complete. 2024-05-10T04:55:39.288 INFO:tasks.workunit.client.0.smithi047.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-10T04:55:39.342 INFO:tasks.workunit.client.0.smithi047.stdout: Iozone: Performance Test of File I/O 2024-05-10T04:55:39.342 INFO:tasks.workunit.client.0.smithi047.stdout: Version $Revision: 3.489 $ 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Compiled for 64 bit mode. 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Build: linux-AMD64 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:39.343 INFO:tasks.workunit.client.0.smithi047.stdout: Run began: Fri May 10 04:55:39 2024 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Include close in write timing 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Include fsync in write timing 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: File size set to 10485760 kB 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Record Size 1024 kB 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Output is in kBytes/sec 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Time Resolution = 0.000001 seconds. 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache size set to 1024 kBytes. 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Processor cache line size set to 32 bytes. 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: File stride size set to 17 * record size. 2024-05-10T04:55:39.344 INFO:tasks.workunit.client.0.smithi047.stdout: Throughput test with 1 process 2024-05-10T04:55:39.345 INFO:tasks.workunit.client.0.smithi047.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-10T04:55:39.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 211869 13.30 MB/sec warmup 87 sec latency 29.405 ms 2024-05-10T04:55:40.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 213383 13.28 MB/sec warmup 88 sec latency 17.718 ms 2024-05-10T04:55:41.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 215365 13.21 MB/sec warmup 89 sec latency 19.793 ms 2024-05-10T04:55:42.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 217016 13.19 MB/sec warmup 90 sec latency 18.757 ms 2024-05-10T04:55:43.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 218830 13.13 MB/sec warmup 91 sec latency 37.456 ms 2024-05-10T04:55:44.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 220469 13.11 MB/sec warmup 92 sec latency 21.305 ms 2024-05-10T04:55:45.429 INFO:tasks.workunit.client.1.smithi117.stdout: 1 221660 13.03 MB/sec warmup 93 sec latency 180.189 ms 2024-05-10T04:55:46.431 INFO:tasks.workunit.client.1.smithi117.stdout: 1 222343 12.91 MB/sec warmup 94 sec latency 505.082 ms 2024-05-10T04:55:47.431 INFO:tasks.workunit.client.1.smithi117.stdout: 1 223313 12.85 MB/sec warmup 95 sec latency 95.436 ms 2024-05-10T04:55:48.431 INFO:tasks.workunit.client.1.smithi117.stdout: 1 224192 12.77 MB/sec warmup 96 sec latency 247.043 ms 2024-05-10T04:55:49.431 INFO:tasks.workunit.client.1.smithi117.stdout: 1 226273 12.75 MB/sec warmup 97 sec latency 35.267 ms 2024-05-10T04:55:50.431 INFO:tasks.workunit.client.1.smithi117.stdout: 1 227788 12.70 MB/sec warmup 98 sec latency 18.167 ms 2024-05-10T04:55:51.431 INFO:tasks.workunit.client.1.smithi117.stdout: 1 228586 12.63 MB/sec warmup 99 sec latency 269.250 ms 2024-05-10T04:55:52.432 INFO:tasks.workunit.client.1.smithi117.stdout: 1 230324 12.59 MB/sec warmup 100 sec latency 35.190 ms 2024-05-10T04:55:52.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:55:52.655 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:55:53.432 INFO:tasks.workunit.client.1.smithi117.stdout: 1 231531 12.52 MB/sec warmup 101 sec latency 18.622 ms 2024-05-10T04:55:54.432 INFO:tasks.workunit.client.1.smithi117.stdout: 1 233955 12.53 MB/sec warmup 102 sec latency 24.034 ms 2024-05-10T04:55:55.433 INFO:tasks.workunit.client.1.smithi117.stdout: 1 234933 12.46 MB/sec warmup 103 sec latency 39.732 ms 2024-05-10T04:55:56.433 INFO:tasks.workunit.client.1.smithi117.stdout: 1 237169 12.46 MB/sec warmup 104 sec latency 20.469 ms 2024-05-10T04:55:57.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 238093 12.40 MB/sec warmup 105 sec latency 455.635 ms 2024-05-10T04:55:58.433 INFO:tasks.workunit.client.1.smithi117.stdout: 1 238585 12.29 MB/sec warmup 106 sec latency 512.452 ms 2024-05-10T04:55:59.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 241203 12.33 MB/sec warmup 107 sec latency 17.582 ms 2024-05-10T04:56:00.433 INFO:tasks.workunit.client.1.smithi117.stdout: 1 242218 12.24 MB/sec warmup 108 sec latency 46.888 ms 2024-05-10T04:56:01.433 INFO:tasks.workunit.client.1.smithi117.stdout: 1 244891 12.28 MB/sec warmup 109 sec latency 15.585 ms 2024-05-10T04:56:02.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 245941 12.20 MB/sec warmup 110 sec latency 25.066 ms 2024-05-10T04:56:03.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 248553 12.24 MB/sec warmup 111 sec latency 16.938 ms 2024-05-10T04:56:04.437 INFO:tasks.workunit.client.1.smithi117.stdout: 1 249817 12.18 MB/sec warmup 112 sec latency 35.244 ms 2024-05-10T04:56:05.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 252216 12.20 MB/sec warmup 113 sec latency 15.725 ms 2024-05-10T04:56:06.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 253726 12.14 MB/sec warmup 114 sec latency 32.214 ms 2024-05-10T04:56:07.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 255839 12.15 MB/sec warmup 115 sec latency 25.176 ms 2024-05-10T04:56:08.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 257863 12.11 MB/sec warmup 116 sec latency 31.260 ms 2024-05-10T04:56:09.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 259575 12.11 MB/sec warmup 117 sec latency 16.342 ms 2024-05-10T04:56:10.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 261570 12.08 MB/sec warmup 118 sec latency 30.690 ms 2024-05-10T04:56:11.434 INFO:tasks.workunit.client.1.smithi117.stdout: 1 263196 12.07 MB/sec warmup 119 sec latency 14.509 ms 2024-05-10T04:56:13.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 266793 6.94 MB/sec execute 1 sec latency 34.427 ms 2024-05-10T04:56:14.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 268539 7.18 MB/sec execute 2 sec latency 43.095 ms 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 initial writers = 294673.06 kB/sec 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 initial writers = 294666.13 kB/sec 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 294673.06 kB/sec 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 294673.06 kB/sec 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 294673.06 kB/sec 2024-05-10T04:56:14.961 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-10T04:56:15.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 270286 8.65 MB/sec execute 3 sec latency 77.903 ms 2024-05-10T04:56:16.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 273112 10.78 MB/sec execute 4 sec latency 169.594 ms 2024-05-10T04:56:17.437 INFO:tasks.workunit.client.1.smithi117.stdout: 1 275520 10.36 MB/sec execute 5 sec latency 34.460 ms 2024-05-10T04:56:18.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 277686 10.82 MB/sec execute 6 sec latency 14.276 ms 2024-05-10T04:56:19.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 280621 11.87 MB/sec execute 7 sec latency 40.367 ms 2024-05-10T04:56:20.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 281283 10.63 MB/sec execute 8 sec latency 38.846 ms 2024-05-10T04:56:21.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 283141 10.55 MB/sec execute 9 sec latency 35.707 ms 2024-05-10T04:56:22.435 INFO:tasks.workunit.client.1.smithi117.stdout: 1 283232 9.56 MB/sec execute 10 sec latency 785.139 ms 2024-05-10T04:56:22.783 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:56:22.788 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:56:23.436 INFO:tasks.workunit.client.1.smithi117.stdout: 1 283943 9.17 MB/sec execute 11 sec latency 336.402 ms 2024-05-10T04:56:24.436 INFO:tasks.workunit.client.1.smithi117.stdout: 1 284226 8.52 MB/sec execute 12 sec latency 394.856 ms 2024-05-10T04:56:25.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 285035 8.02 MB/sec execute 13 sec latency 53.443 ms 2024-05-10T04:56:26.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 286994 8.25 MB/sec execute 14 sec latency 27.402 ms 2024-05-10T04:56:27.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 287739 8.09 MB/sec execute 15 sec latency 125.500 ms 2024-05-10T04:56:28.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 288311 7.63 MB/sec execute 16 sec latency 83.876 ms 2024-05-10T04:56:29.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 290110 7.78 MB/sec execute 17 sec latency 26.982 ms 2024-05-10T04:56:30.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 291238 7.80 MB/sec execute 18 sec latency 52.571 ms 2024-05-10T04:56:31.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 292133 7.50 MB/sec execute 19 sec latency 27.060 ms 2024-05-10T04:56:32.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 293794 7.65 MB/sec execute 20 sec latency 62.450 ms 2024-05-10T04:56:33.438 INFO:tasks.workunit.client.1.smithi117.stdout: 1 295090 7.60 MB/sec execute 21 sec latency 42.646 ms 2024-05-10T04:56:34.439 INFO:tasks.workunit.client.1.smithi117.stdout: 1 295560 7.34 MB/sec execute 22 sec latency 378.044 ms 2024-05-10T04:56:35.439 INFO:tasks.workunit.client.1.smithi117.stdout: 1 297404 7.48 MB/sec execute 23 sec latency 62.178 ms 2024-05-10T04:56:36.439 INFO:tasks.workunit.client.1.smithi117.stdout: 1 298484 7.44 MB/sec execute 24 sec latency 26.360 ms 2024-05-10T04:56:37.439 INFO:tasks.workunit.client.1.smithi117.stdout: 1 300150 7.38 MB/sec execute 25 sec latency 24.248 ms 2024-05-10T04:56:38.439 INFO:tasks.workunit.client.1.smithi117.stdout: 1 301783 7.60 MB/sec execute 26 sec latency 27.638 ms 2024-05-10T04:56:39.442 INFO:tasks.workunit.client.1.smithi117.stdout: 1 302581 7.40 MB/sec execute 27 sec latency 34.243 ms 2024-05-10T04:56:40.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 304494 7.51 MB/sec execute 28 sec latency 30.238 ms 2024-05-10T04:56:41.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 305530 7.48 MB/sec execute 29 sec latency 36.701 ms 2024-05-10T04:56:42.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 306912 7.41 MB/sec execute 30 sec latency 29.264 ms 2024-05-10T04:56:43.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 308727 7.57 MB/sec execute 31 sec latency 169.388 ms 2024-05-10T04:56:44.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 309422 7.39 MB/sec execute 32 sec latency 31.268 ms 2024-05-10T04:56:45.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 311043 7.37 MB/sec execute 33 sec latency 85.398 ms 2024-05-10T04:56:46.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 312463 7.49 MB/sec execute 34 sec latency 33.823 ms 2024-05-10T04:56:47.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 313343 7.35 MB/sec execute 35 sec latency 41.483 ms 2024-05-10T04:56:48.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 315350 7.46 MB/sec execute 36 sec latency 27.630 ms 2024-05-10T04:56:49.017 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:56:49.017 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 rewriters = 352050.31 kB/sec 2024-05-10T04:56:49.017 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 rewriters = 352038.29 kB/sec 2024-05-10T04:56:49.017 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 352050.31 kB/sec 2024-05-10T04:56:49.017 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 352050.31 kB/sec 2024-05-10T04:56:49.017 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 352050.31 kB/sec 2024-05-10T04:56:49.018 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-10T04:56:49.443 INFO:tasks.workunit.client.1.smithi117.stdout: 1 316684 7.43 MB/sec execute 37 sec latency 40.967 ms 2024-05-10T04:56:50.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 319730 7.72 MB/sec execute 38 sec latency 8.812 ms 2024-05-10T04:56:51.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 322508 7.89 MB/sec execute 39 sec latency 32.737 ms 2024-05-10T04:56:52.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 325119 7.98 MB/sec execute 40 sec latency 20.545 ms 2024-05-10T04:56:53.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 327209 8.10 MB/sec execute 41 sec latency 25.447 ms 2024-05-10T04:56:53.789 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:56:53.796 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:56:54.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 330171 8.34 MB/sec execute 42 sec latency 55.712 ms 2024-05-10T04:56:55.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 332467 8.34 MB/sec execute 43 sec latency 43.316 ms 2024-05-10T04:56:55.498 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:56:55.498 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 readers = 5880819.00 kB/sec 2024-05-10T04:56:55.498 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 readers = 5877901.88 kB/sec 2024-05-10T04:56:55.498 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 5880819.00 kB/sec 2024-05-10T04:56:55.498 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 5880819.00 kB/sec 2024-05-10T04:56:55.498 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 5880819.00 kB/sec 2024-05-10T04:56:55.499 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-10T04:56:56.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 334838 8.52 MB/sec execute 44 sec latency 7.459 ms 2024-05-10T04:56:57.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 337430 8.64 MB/sec execute 45 sec latency 49.868 ms 2024-05-10T04:56:58.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 337799 8.47 MB/sec execute 46 sec latency 272.415 ms 2024-05-10T04:56:59.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 339367 8.42 MB/sec execute 47 sec latency 361.415 ms 2024-05-10T04:57:00.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 341117 8.50 MB/sec execute 48 sec latency 39.503 ms 2024-05-10T04:57:00.797 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:57:00.797 INFO:tasks.workunit.client.0.smithi047.stdout: Children see throughput for 1 re-readers = 3595651.00 kB/sec 2024-05-10T04:57:00.797 INFO:tasks.workunit.client.0.smithi047.stdout: Parent sees throughput for 1 re-readers = 3594594.65 kB/sec 2024-05-10T04:57:00.797 INFO:tasks.workunit.client.0.smithi047.stdout: Min throughput per process = 3595651.00 kB/sec 2024-05-10T04:57:00.798 INFO:tasks.workunit.client.0.smithi047.stdout: Max throughput per process = 3595651.00 kB/sec 2024-05-10T04:57:00.798 INFO:tasks.workunit.client.0.smithi047.stdout: Avg throughput per process = 3595651.00 kB/sec 2024-05-10T04:57:00.798 INFO:tasks.workunit.client.0.smithi047.stdout: Min xfer = 10485760.00 kB 2024-05-10T04:57:01.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 344313 8.71 MB/sec execute 49 sec latency 7.474 ms 2024-05-10T04:57:02.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 346785 8.76 MB/sec execute 50 sec latency 57.575 ms 2024-05-10T04:57:03.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 348647 8.79 MB/sec execute 51 sec latency 64.815 ms 2024-05-10T04:57:04.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 351712 8.95 MB/sec execute 52 sec latency 15.416 ms 2024-05-10T04:57:05.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 354834 9.12 MB/sec execute 53 sec latency 34.182 ms 2024-05-10T04:57:06.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 357578 9.18 MB/sec execute 54 sec latency 6.964 ms 2024-05-10T04:57:07.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 360165 9.26 MB/sec execute 55 sec latency 9.857 ms 2024-05-10T04:57:08.444 INFO:tasks.workunit.client.1.smithi117.stdout: 1 362572 9.34 MB/sec execute 56 sec latency 32.916 ms 2024-05-10T04:57:09.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 365415 9.48 MB/sec execute 57 sec latency 208.261 ms 2024-05-10T04:57:10.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 366079 9.35 MB/sec execute 58 sec latency 359.036 ms 2024-05-10T04:57:10.720 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:57:10.720 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:57:10.720 INFO:tasks.workunit.client.0.smithi047.stdout: 2024-05-10T04:57:10.721 INFO:tasks.workunit.client.0.smithi047.stdout:iozone test complete. 2024-05-10T04:57:10.726 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-10T04:57:10.726 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-10T04:57:10.909 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-10T04:57:10.909 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-10T04:57:11.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 366999 9.27 MB/sec execute 59 sec latency 45.541 ms 2024-05-10T04:57:12.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 368319 9.24 MB/sec execute 60 sec latency 33.776 ms 2024-05-10T04:57:12.773 DEBUG:teuthology.parallel:result is None 2024-05-10T04:57:12.773 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T04:57:13.132 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-10T04:57:13.132 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-10T04:57:13.133 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:57:13.133 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:57:13.229 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:57:13.229 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:57:13.327 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:57:13.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 368709 9.12 MB/sec execute 61 sec latency 269.633 ms 2024-05-10T04:57:13.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.796+0000 7fbdf6e00700 1 Processor -- start 2024-05-10T04:57:13.797 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.796+0000 7fbdf6e00700 1 -- start start 2024-05-10T04:57:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.799+0000 7fbdf6e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbdf00c5c40 0x7fbdf00c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.799+0000 7fbdf6e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf006c7c0 con 0x7fbdf0159220 2024-05-10T04:57:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.800+0000 7fbdf6e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf006d060 con 0x7fbdf00c9270 2024-05-10T04:57:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.800+0000 7fbdf6e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf0159630 con 0x7fbdf00c5c40 2024-05-10T04:57:13.800 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.800+0000 7fbdefe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbdf00c5c40 0x7fbdf00c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.800+0000 7fbdefe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fbdf00c5c40 0x7fbdf00c8d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35702/0 (socket says 172.21.15.47:35702) 2024-05-10T04:57:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.800+0000 7fbdefe00700 1 -- 172.21.15.47:0/2210291645 learned_addr learned my addr 172.21.15.47:0/2210291645 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.801+0000 7fbdefe00700 1 -- 172.21.15.47:0/2210291645 >> v1:172.21.15.117:6789/0 conn(0x7fbdf00c9270 legacy=0x7fbdf0158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.801+0000 7fbdefe00700 1 -- 172.21.15.47:0/2210291645 >> v1:172.21.15.47:6789/0 conn(0x7fbdf0159220 legacy=0x7fbdf015fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.801+0000 7fbdefe00700 1 -- 172.21.15.47:0/2210291645 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0159890 con 0x7fbdf00c5c40 2024-05-10T04:57:13.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.802+0000 7fbdefe00700 1 --2- 172.21.15.47:0/2210291645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf00c5c40 0x7fbdf00c8d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179851b3c3d713e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.803+0000 7fbdef400700 1 -- 172.21.15.47:0/2210291645 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde000e070 con 0x7fbdf00c5c40 2024-05-10T04:57:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.803+0000 7fbdef400700 1 -- 172.21.15.47:0/2210291645 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0003a20 con 0x7fbdf00c5c40 2024-05-10T04:57:13.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.803+0000 7fbdef400700 1 -- 172.21.15.47:0/2210291645 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0003dd0 con 0x7fbdf00c5c40 2024-05-10T04:57:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.805+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2210291645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf00c5c40 msgr2=0x7fbdf00c8d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:13.805 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.805+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2210291645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf00c5c40 0x7fbdf00c8d30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde000b330 comp rx=0 tx=0).stop 2024-05-10T04:57:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.806+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2210291645 shutdown_connections 2024-05-10T04:57:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.806+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2210291645 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf00c5c40 0x7fbdf00c8d30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:13.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.806+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2210291645 >> 172.21.15.47:0/2210291645 conn(0x7fbdf00ca940 msgr2=0x7fbdf00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:13.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.806+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2210291645 shutdown_connections 2024-05-10T04:57:13.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.808+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2210291645 wait complete. 2024-05-10T04:57:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.811+0000 7fbdf6e00700 1 Processor -- start 2024-05-10T04:57:13.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.812+0000 7fbdf6e00700 1 -- start start 2024-05-10T04:57:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.814+0000 7fbdf6e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdf00c5c40 0x7fbdf00af700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdf6e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 0x7fbdf00c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdf6e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf0159220 0x7fbdf00c2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdf6e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c1f20 con 0x7fbdf0159220 2024-05-10T04:57:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdf6e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf00c3370 con 0x7fbdf00c9270 2024-05-10T04:57:13.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdf6e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf0158c70 con 0x7fbdf00c5c40 2024-05-10T04:57:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdf4e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf0159220 0x7fbdf00c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbde7400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 0x7fbdf00c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbde7400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 0x7fbdf00c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:59240/0 (socket says 172.21.15.47:59240) 2024-05-10T04:57:13.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbde7400700 1 -- 172.21.15.47:0/2691992009 learned_addr learned my addr 172.21.15.47:0/2691992009 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:13.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.815+0000 7fbdefe00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdf00c5c40 0x7fbdf00af700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.816+0000 7fbde7400700 1 -- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdf00c5c40 msgr2=0x7fbdf00af700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:13.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.816+0000 7fbde7400700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdf00c5c40 0x7fbdf00af700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.816+0000 7fbde7400700 1 -- 172.21.15.47:0/2691992009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf0159220 msgr2=0x7fbdf00c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.816+0000 7fbde7400700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf0159220 0x7fbdf00c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.816+0000 7fbde7400700 1 -- 172.21.15.47:0/2691992009 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009b30 con 0x7fbdf00c9270 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.816+0000 7fbdf4e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf0159220 0x7fbdf00c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.818+0000 7fbde7400700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 0x7fbdf00c4450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800b4a0 tx=0x7fbdd800b7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.819+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8011830 con 0x7fbdf00c9270 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.820+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdd8011990 con 0x7fbdf00c9270 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.820+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd8011d40 con 0x7fbdf00c9270 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.820+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf00c21c0 con 0x7fbdf00c9270 2024-05-10T04:57:13.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.820+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf01574c0 con 0x7fbdf00c9270 2024-05-10T04:57:13.824 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.823+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc80052e0 con 0x7fbdf00c9270 2024-05-10T04:57:13.828 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.828+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdd8004020 con 0x7fbdf00c9270 2024-05-10T04:57:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.831+0000 7fbdecc00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbdcc06ad60 0x7fbdcc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.831+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbdd8089c00 con 0x7fbdf00c9270 2024-05-10T04:57:13.832 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.832+0000 7fbdefe00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbdcc06ad60 0x7fbdcc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:13.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.834+0000 7fbdefe00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbdcc06ad60 0x7fbdcc06d270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde0009000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:13.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:13.834+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbdd8054970 con 0x7fbdf00c9270 2024-05-10T04:57:14.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.196+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdc8005860 con 0x7fbdf00c9270 2024-05-10T04:57:14.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.199+0000 7fbdecc00700 1 -- 172.21.15.47:0/2691992009 <== mon.1 v2:172.21.15.117:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fbdd8015090 con 0x7fbdf00c9270 2024-05-10T04:57:14.201 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:57:14.201 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:52:40.317170+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:57:14.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.207+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbdcc06ad60 msgr2=0x7fbdcc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.207+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbdcc06ad60 0x7fbdcc06d270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbde0009e50 tx=0x7fbde0009000 comp rx=0 tx=0).stop 2024-05-10T04:57:14.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.207+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 msgr2=0x7fbdf00c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.207+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 0x7fbdf00c4450 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fbdd800b4a0 tx=0x7fbdd800b7b0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.208+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 shutdown_connections 2024-05-10T04:57:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.208+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbdf0159220 0x7fbdf00c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.208+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbdcc06ad60 0x7fbdcc06d270 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.208+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbdf00c5c40 0x7fbdf00af700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.208+0000 7fbdf6e00700 1 --2- 172.21.15.47:0/2691992009 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbdf00c9270 0x7fbdf00c4450 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.208+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 >> 172.21.15.47:0/2691992009 conn(0x7fbdf00ca940 msgr2=0x7fbdf0151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:14.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.211+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 shutdown_connections 2024-05-10T04:57:14.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.211+0000 7fbdf6e00700 1 -- 172.21.15.47:0/2691992009 wait complete. 2024-05-10T04:57:14.266 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T04:57:14.267 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:57:14.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 369332 9.05 MB/sec execute 62 sec latency 58.268 ms 2024-05-10T04:57:14.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.709+0000 7f547ba00700 1 Processor -- start 2024-05-10T04:57:14.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.710+0000 7f547ba00700 1 -- start start 2024-05-10T04:57:14.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.711+0000 7f547ba00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f5474152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:14.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.711+0000 7f547ba00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f547406d640 con 0x7f547406bdb0 2024-05-10T04:57:14.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.711+0000 7f547ba00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54740c6100 con 0x7f54740c5cf0 2024-05-10T04:57:14.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.711+0000 7f547ba00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54740c9800 con 0x7f54740c6cc0 2024-05-10T04:57:14.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5479a00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f547406bdb0 0x7f547406c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41678/0 (socket says 172.21.15.47:41678) 2024-05-10T04:57:14.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5479a00700 1 -- 172.21.15.47:0/58807246 learned_addr learned my addr 172.21.15.47:0/58807246 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:14.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5479000700 1 --2- 172.21.15.47:0/58807246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f5474152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542430189 0 0) 0x7f547406d640 con 0x7f547406bdb0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f545c0035b0 con 0x7f547406bdb0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002662990 0 0) 0x7f54740c6100 con 0x7f54740c5cf0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f547406d640 con 0x7f54740c5cf0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5479000700 1 -- 172.21.15.47:0/58807246 >> v1:172.21.15.117:6789/0 conn(0x7f54740c5cf0 legacy=0x7f54740c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5479000700 1 -- 172.21.15.47:0/58807246 >> v1:172.21.15.47:6789/0 conn(0x7f547406bdb0 legacy=0x7f547406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.712+0000 7f5479000700 1 -- 172.21.15.47:0/58807246 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54740c8910 con 0x7f54740c6cc0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.713+0000 7f5479000700 1 --2- 172.21.15.47:0/58807246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f5474152bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5468009870 tx=0x7f5468009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e349f1d48a2c9b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.713+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468011830 con 0x7f54740c6cc0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.713+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5468011990 con 0x7f54740c6cc0 2024-05-10T04:57:14.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.713+0000 7f5473400700 1 -- 172.21.15.47:0/58807246 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5468011d20 con 0x7f54740c6cc0 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.713+0000 7f547ba00700 1 -- 172.21.15.47:0/58807246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 msgr2=0x7f5474152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.713+0000 7f547ba00700 1 --2- 172.21.15.47:0/58807246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f5474152bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5468009870 tx=0x7f5468009b80 comp rx=0 tx=0).stop 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.714+0000 7f547ba00700 1 -- 172.21.15.47:0/58807246 shutdown_connections 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.714+0000 7f547ba00700 1 --2- 172.21.15.47:0/58807246 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f5474152bb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.714+0000 7f547ba00700 1 -- 172.21.15.47:0/58807246 >> 172.21.15.47:0/58807246 conn(0x7f54740ca960 msgr2=0x7f54740cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.714+0000 7f547ba00700 1 -- 172.21.15.47:0/58807246 shutdown_connections 2024-05-10T04:57:14.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.714+0000 7f547ba00700 1 -- 172.21.15.47:0/58807246 wait complete. 2024-05-10T04:57:14.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.716+0000 7f547ba00700 1 Processor -- start 2024-05-10T04:57:14.716 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.716+0000 7f547ba00700 1 -- start start 2024-05-10T04:57:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.717+0000 7f547ba00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 0x7f547414c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:14.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.717+0000 7f547ba00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54740c5cf0 0x7f54741eb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.717+0000 7f547ba00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f54740be3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f547ba00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54740c1550 con 0x7f547406bdb0 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f547ba00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54741ec280 con 0x7f54740c5cf0 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f547ba00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54740c3360 con 0x7f54740c6cc0 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 0x7f547414c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 0x7f547414c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35716/0 (socket says 172.21.15.47:35716) 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 -- 172.21.15.47:0/3280497414 learned_addr learned my addr 172.21.15.47:0/3280497414 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5473e00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54740c5cf0 0x7f54741eb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479a00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f54740be3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 -- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 msgr2=0x7f54740be3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f54740be3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 -- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54740c5cf0 msgr2=0x7f54741eb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54740c5cf0 0x7f54741eb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.718+0000 7f5479000700 1 -- 172.21.15.47:0/3280497414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54680094a0 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.719+0000 7f5479000700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 0x7f547414c920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54680090b0 tx=0x7f5468004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.719+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f546801aa70 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.719+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f546801abd0 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.719+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54680243f0 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.719+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54740c2750 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.719+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54740c2d10 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.720+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54740c1230 con 0x7f547406bdb0 2024-05-10T04:57:14.721 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.721+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f546802d450 con 0x7f547406bdb0 2024-05-10T04:57:14.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.722+0000 7f5470c00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f545406acc0 0x7f545406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:14.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.722+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f546808aae0 con 0x7f547406bdb0 2024-05-10T04:57:14.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.722+0000 7f5473e00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f545406acc0 0x7f545406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:14.723 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.723+0000 7f5473e00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f545406acc0 0x7f545406d1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5460007fd0 tx=0x7f5460009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:14.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.727+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f54680558f0 con 0x7f547406bdb0 2024-05-10T04:57:14.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.986+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f54741eb3b0 con 0x7f547406bdb0 2024-05-10T04:57:14.987 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.986+0000 7f5470c00700 1 -- 172.21.15.47:0/3280497414 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5468015020 con 0x7f547406bdb0 2024-05-10T04:57:14.987 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f545406acc0 msgr2=0x7f545406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f545406acc0 0x7f545406d1d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5460007fd0 tx=0x7f5460009040 comp rx=0 tx=0).stop 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 msgr2=0x7f547414c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 0x7f547414c920 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54680090b0 tx=0x7f5468004750 comp rx=0 tx=0).stop 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 shutdown_connections 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f545406acc0 0x7f545406d1d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f54740c6cc0 0x7f54740be3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f547406bdb0 0x7f547414c920 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 --2- 172.21.15.47:0/3280497414 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f54740c5cf0 0x7f54741eb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:14.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 >> 172.21.15.47:0/3280497414 conn(0x7f54740ca960 msgr2=0x7f5474156780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:14.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 shutdown_connections 2024-05-10T04:57:14.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:14.989+0000 7f547ba00700 1 -- 172.21.15.47:0/3280497414 wait complete. 2024-05-10T04:57:15.022 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:57:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.320+0000 7f15c9800700 1 Processor -- start 2024-05-10T04:57:15.321 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.320+0000 7f15c9800700 1 -- start start 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.322+0000 7f15c9800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c6d40 0x7f15c41560e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.322+0000 7f15c9800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40c5370 con 0x7f15c40c17a0 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.322+0000 7f15c9800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15c40c1bb0 con 0x7f15c40c0230 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.322+0000 7f15c9800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c40c2550 con 0x7f15c40c6d40 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c2000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f15c40c17a0 0x7f15c406cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41686/0 (socket says 172.21.15.47:41686) 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c2000700 1 -- 172.21.15.47:0/61568754 learned_addr learned my addr 172.21.15.47:0/61568754 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:15.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c2a00700 1 --2- 172.21.15.47:0/61568754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c6d40 0x7f15c41560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923565740 0 0) 0x7f15c40c5370 con 0x7f15c40c17a0 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15a80035b0 con 0x7f15c40c17a0 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950543865 0 0) 0x7f15c40c1bb0 con 0x7f15c40c0230 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15c40c5370 con 0x7f15c40c0230 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c2a00700 1 -- 172.21.15.47:0/61568754 >> v1:172.21.15.117:6789/0 conn(0x7f15c40c0230 legacy=0x7f15c40c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c2a00700 1 -- 172.21.15.47:0/61568754 >> v1:172.21.15.47:6789/0 conn(0x7f15c40c17a0 legacy=0x7f15c406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.323+0000 7f15c2a00700 1 -- 172.21.15.47:0/61568754 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c40bf9e0 con 0x7f15c40c6d40 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.324+0000 7f15c2a00700 1 --2- 172.21.15.47:0/61568754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c6d40 0x7f15c41560e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009870 tx=0x7f15b4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=679ddf683cf67e97 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.324+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011830 con 0x7f15c40c6d40 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.324+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b4011990 con 0x7f15c40c6d40 2024-05-10T04:57:15.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.324+0000 7f15c1600700 1 -- 172.21.15.47:0/61568754 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b4011d20 con 0x7f15c40c6d40 2024-05-10T04:57:15.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 -- 172.21.15.47:0/61568754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c6d40 msgr2=0x7f15c41560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 --2- 172.21.15.47:0/61568754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c6d40 0x7f15c41560e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f15b4009870 tx=0x7f15b4009b80 comp rx=0 tx=0).stop 2024-05-10T04:57:15.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 -- 172.21.15.47:0/61568754 shutdown_connections 2024-05-10T04:57:15.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 --2- 172.21.15.47:0/61568754 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c6d40 0x7f15c41560e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.326 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 -- 172.21.15.47:0/61568754 >> 172.21.15.47:0/61568754 conn(0x7f15c4067630 msgr2=0x7f15c40ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:15.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 -- 172.21.15.47:0/61568754 shutdown_connections 2024-05-10T04:57:15.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.325+0000 7f15c9800700 1 -- 172.21.15.47:0/61568754 wait complete. 2024-05-10T04:57:15.327 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.327+0000 7f15c9800700 1 Processor -- start 2024-05-10T04:57:15.328 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.327+0000 7f15c9800700 1 -- start start 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c9800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 0x7f15c4136550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c9800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c17a0 0x7f15c4139290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c9800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c40c6d40 0x7f15c41ee520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c9800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41ebcc0 con 0x7f15c40c6d40 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c9800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41ef240 con 0x7f15c40c17a0 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c9800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c41ead80 con 0x7f15c40c0230 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c17a0 0x7f15c4139290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 0x7f15c4136550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 0x7f15c4136550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:48688/0 (socket says 172.21.15.47:48688) 2024-05-10T04:57:15.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 -- 172.21.15.47:0/865154258 learned_addr learned my addr 172.21.15.47:0/865154258 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:15.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c3400700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c40c6d40 0x7f15c41ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 -- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c17a0 msgr2=0x7f15c4139290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c17a0 0x7f15c4139290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 -- 172.21.15.47:0/865154258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c40c6d40 msgr2=0x7f15c41ee520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c40c6d40 0x7f15c41ee520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.331 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.329+0000 7f15c2a00700 1 -- 172.21.15.47:0/865154258 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094a0 con 0x7f15c40c0230 2024-05-10T04:57:15.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.330+0000 7f15c2a00700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 0x7f15c4136550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f15b40090b0 tx=0x7f15b4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:15.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.330+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b401a6e0 con 0x7f15c40c0230 2024-05-10T04:57:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.330+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b401a840 con 0x7f15c40c0230 2024-05-10T04:57:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.330+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b401abb0 con 0x7f15c40c0230 2024-05-10T04:57:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.330+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c41eb040 con 0x7f15c40c0230 2024-05-10T04:57:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.330+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c41eb600 con 0x7f15c40c0230 2024-05-10T04:57:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.331+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4074720 con 0x7f15c40c0230 2024-05-10T04:57:15.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.332+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15b4022070 con 0x7f15c40c0230 2024-05-10T04:57:15.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.333+0000 7f15baa00700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15a406acc0 0x7f15a406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.333+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15b408a1b0 con 0x7f15c40c0230 2024-05-10T04:57:15.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.334+0000 7f15c2000700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15a406acc0 0x7f15a406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.334+0000 7f15c2000700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15a406acc0 0x7f15a406d1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15c40c0c00 tx=0x7f15b0007e00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:15.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.340+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15b4055070 con 0x7f15c40c0230 2024-05-10T04:57:15.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 370944 8.99 MB/sec execute 63 sec latency 220.927 ms 2024-05-10T04:57:15.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.576+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15c40c6b20 con 0x7f15c40c0230 2024-05-10T04:57:15.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.577+0000 7f15baa00700 1 -- 172.21.15.47:0/865154258 <== mon.2 v2:172.21.15.117:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15b40090e0 con 0x7f15c40c0230 2024-05-10T04:57:15.578 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15a406acc0 msgr2=0x7f15a406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15a406acc0 0x7f15a406d1d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f15c40c0c00 tx=0x7f15b0007e00 comp rx=0 tx=0).stop 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 msgr2=0x7f15c4136550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 0x7f15c4136550 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f15b40090b0 tx=0x7f15b4004750 comp rx=0 tx=0).stop 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 shutdown_connections 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15c40c6d40 0x7f15c41ee520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15a406acc0 0x7f15a406d1d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.580 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15c40c0230 0x7f15c4136550 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 --2- 172.21.15.47:0/865154258 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15c40c17a0 0x7f15c4139290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 >> 172.21.15.47:0/865154258 conn(0x7f15c4067630 msgr2=0x7f15c40c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:15.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 shutdown_connections 2024-05-10T04:57:15.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.579+0000 7f15c9800700 1 -- 172.21.15.47:0/865154258 wait complete. 2024-05-10T04:57:15.608 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:57:15.899 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.899+0000 7f6b7bc00700 1 Processor -- start 2024-05-10T04:57:15.900 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.899+0000 7f6b7bc00700 1 -- start start 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b7bc00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b740aab00 0x7f6b740c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b7bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740ab7a0 0x7f6b740c6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b7bc00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b74152e60 con 0x7f6b740c2040 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b7bc00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b740c2870 con 0x7f6b740aab00 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b7bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7414fec0 con 0x7f6b740ab7a0 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b79200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f6b740aab00 0x7f6b740c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b73e00700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7f6b740c2040 0x7f6b740c1080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:51250/0 (socket says 172.21.15.47:51250) 2024-05-10T04:57:15.902 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b73e00700 1 -- 172.21.15.47:0/493957702 learned_addr learned my addr 172.21.15.47:0/493957702 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:15.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.901+0000 7f6b79c00700 1 --2- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740ab7a0 0x7f6b740c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.902+0000 7f6b79200700 1 -- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740ab7a0 msgr2=0x7f6b740c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.902+0000 7f6b79200700 1 --2- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740ab7a0 0x7f6b740c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.902+0000 7f6b79200700 1 -- 172.21.15.47:0/493957702 >> v1:172.21.15.117:6789/0 conn(0x7f6b740c2040 legacy=0x7f6b740c1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.902+0000 7f6b79200700 1 -- 172.21.15.47:0/493957702 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74153390 con 0x7f6b740aab00 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.902+0000 7f6b79200700 1 --2- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740aab00 0x7f6b740c3b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009870 tx=0x7f6b68009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e855e07b1ab59502 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.902+0000 7f6b73400700 1 -- 172.21.15.47:0/493957702 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011830 con 0x7f6b740aab00 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b73400700 1 -- 172.21.15.47:0/493957702 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b68011990 con 0x7f6b740aab00 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b73400700 1 -- 172.21.15.47:0/493957702 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68011d20 con 0x7f6b740aab00 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 -- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740aab00 msgr2=0x7f6b740c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740aab00 0x7f6b740c3b10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6b68009870 tx=0x7f6b68009b80 comp rx=0 tx=0).stop 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 -- 172.21.15.47:0/493957702 shutdown_connections 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740ab7a0 0x7f6b740c6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/493957702 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740aab00 0x7f6b740c3b10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 -- 172.21.15.47:0/493957702 >> 172.21.15.47:0/493957702 conn(0x7f6b740a8ae0 msgr2=0x7f6b740a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:15.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 -- 172.21.15.47:0/493957702 shutdown_connections 2024-05-10T04:57:15.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.903+0000 7f6b7bc00700 1 -- 172.21.15.47:0/493957702 wait complete. 2024-05-10T04:57:15.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.906+0000 7f6b7bc00700 1 Processor -- start 2024-05-10T04:57:15.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.906+0000 7f6b7bc00700 1 -- start start 2024-05-10T04:57:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b7bc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 0x7f6b74072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b7bc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740ab7a0 0x7f6b741dcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b7bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740c2040 0x7f6b741ec770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b7bc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741dd880 con 0x7f6b740aab00 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b7bc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b740c04d0 con 0x7f6b740ab7a0 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b7bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b741e9180 con 0x7f6b740c2040 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b79200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 0x7f6b74072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b79200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 0x7f6b74072270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35724/0 (socket says 172.21.15.47:35724) 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b79200700 1 -- 172.21.15.47:0/488486093 learned_addr learned my addr 172.21.15.47:0/488486093 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b73e00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740ab7a0 0x7f6b741dcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.907+0000 7f6b79c00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740c2040 0x7f6b741ec770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b79200700 1 -- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740c2040 msgr2=0x7f6b741ec770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b79200700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740c2040 0x7f6b741ec770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b79200700 1 -- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740ab7a0 msgr2=0x7f6b741dcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b79200700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740ab7a0 0x7f6b741dcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:15.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b79200700 1 -- 172.21.15.47:0/488486093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b680094a0 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b79200700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 0x7f6b74072270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6b68014040 tx=0x7f6b68004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.908+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b680036a0 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.909+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6801e070 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.909+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b68003a60 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.909+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7414d360 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.909+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b741e9720 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.910+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b741dc9b0 con 0x7f6b740aab00 2024-05-10T04:57:15.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.911+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6b68003bc0 con 0x7f6b740aab00 2024-05-10T04:57:15.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.912+0000 7f6b70c00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6b5406ac90 0x7f6b5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:15.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.912+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b6808a600 con 0x7f6b740aab00 2024-05-10T04:57:15.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.912+0000 7f6b73e00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6b5406ac90 0x7f6b5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:15.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.913+0000 7f6b73e00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6b5406ac90 0x7f6b5406d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b740c2800 tx=0x7f6b60009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:15.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:15.917+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6b68055410 con 0x7f6b740aab00 2024-05-10T04:57:16.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.185+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b74074720 con 0x7f6b740aab00 2024-05-10T04:57:16.186 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.185+0000 7f6b70c00700 1 -- 172.21.15.47:0/488486093 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b68058a30 con 0x7f6b740aab00 2024-05-10T04:57:16.186 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T04:57:16.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6b5406ac90 msgr2=0x7f6b5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6b5406ac90 0x7f6b5406d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6b740c2800 tx=0x7f6b60009040 comp rx=0 tx=0).stop 2024-05-10T04:57:16.189 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 msgr2=0x7f6b74072270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 0x7f6b74072270 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6b68014040 tx=0x7f6b68004750 comp rx=0 tx=0).stop 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 shutdown_connections 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6b5406ac90 0x7f6b5406d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6b740c2040 0x7f6b741ec770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6b740aab00 0x7f6b74072270 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 --2- 172.21.15.47:0/488486093 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6b740ab7a0 0x7f6b741dcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 >> 172.21.15.47:0/488486093 conn(0x7f6b740a8ae0 msgr2=0x7f6b7406ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:16.190 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 shutdown_connections 2024-05-10T04:57:16.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.188+0000 7f6b7bc00700 1 -- 172.21.15.47:0/488486093 wait complete. 2024-05-10T04:57:16.216 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T04:57:16.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 373241 9.07 MB/sec execute 64 sec latency 25.210 ms 2024-05-10T04:57:16.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.512+0000 7f00c9200700 1 Processor -- start 2024-05-10T04:57:16.513 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.512+0000 7f00c9200700 1 -- start start 2024-05-10T04:57:16.517 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c9200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c40c6d90 0x7f00c4155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:16.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c9200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f00c40ca8f0 0x7f00c40cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:16.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c9200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40c31e0 con 0x7f00c40c3600 2024-05-10T04:57:16.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c9200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40c50e0 con 0x7f00c40c6d90 2024-05-10T04:57:16.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c9200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40c5340 con 0x7f00c40ca8f0 2024-05-10T04:57:16.518 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c1e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c40c6d90 0x7f00c4155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c1e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f00c40c6d90 0x7f00c4155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35730/0 (socket says 172.21.15.47:35730) 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c1e00700 1 -- 172.21.15.47:0/2852729931 learned_addr learned my addr 172.21.15.47:0/2852729931 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.514+0000 7f00c1400700 1 --2- 172.21.15.47:0/2852729931 >> v2:172.21.15.117:3300/0 conn(0x7f00c40ca8f0 0x7f00c40cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.515+0000 7f00c1e00700 1 -- 172.21.15.47:0/2852729931 >> v2:172.21.15.117:3300/0 conn(0x7f00c40ca8f0 msgr2=0x7f00c40cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.515+0000 7f00c1e00700 1 --2- 172.21.15.47:0/2852729931 >> v2:172.21.15.117:3300/0 conn(0x7f00c40ca8f0 0x7f00c40cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.515+0000 7f00c1e00700 1 -- 172.21.15.47:0/2852729931 >> v1:172.21.15.117:6789/0 conn(0x7f00c40c3600 legacy=0x7f00c40c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.515+0000 7f00c1e00700 1 -- 172.21.15.47:0/2852729931 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40c5620 con 0x7f00c40c6d90 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.515+0000 7f00c1e00700 1 --2- 172.21.15.47:0/2852729931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c6d90 0x7f00c4155ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00c40cb370 tx=0x7f00b4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867fe01d50a7f4e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.516+0000 7f00c0a00700 1 -- 172.21.15.47:0/2852729931 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4011830 con 0x7f00c40c6d90 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.516+0000 7f00c0a00700 1 -- 172.21.15.47:0/2852729931 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b4011990 con 0x7f00c40c6d90 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.516+0000 7f00c0a00700 1 -- 172.21.15.47:0/2852729931 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4011d20 con 0x7f00c40c6d90 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.516+0000 7f00c9200700 1 -- 172.21.15.47:0/2852729931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c6d90 msgr2=0x7f00c4155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.519 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.516+0000 7f00c9200700 1 --2- 172.21.15.47:0/2852729931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c6d90 0x7f00c4155ef0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f00c40cb370 tx=0x7f00b4009bd0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.517+0000 7f00c9200700 1 -- 172.21.15.47:0/2852729931 shutdown_connections 2024-05-10T04:57:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.517+0000 7f00c9200700 1 --2- 172.21.15.47:0/2852729931 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c6d90 0x7f00c4155ef0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.517+0000 7f00c9200700 1 --2- 172.21.15.47:0/2852729931 >> v2:172.21.15.117:3300/0 conn(0x7f00c40ca8f0 0x7f00c40cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.517+0000 7f00c9200700 1 -- 172.21.15.47:0/2852729931 >> 172.21.15.47:0/2852729931 conn(0x7f00c40c7620 msgr2=0x7f00c40c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.517+0000 7f00c9200700 1 -- 172.21.15.47:0/2852729931 shutdown_connections 2024-05-10T04:57:16.520 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.517+0000 7f00c9200700 1 -- 172.21.15.47:0/2852729931 wait complete. 2024-05-10T04:57:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.519+0000 7f00c9200700 1 Processor -- start 2024-05-10T04:57:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.519+0000 7f00c9200700 1 -- start start 2024-05-10T04:57:16.522 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.520+0000 7f00c9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 0x7f00c4143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.520+0000 7f00c9200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40c6d90 0x7f00c4143e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.520+0000 7f00c9200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40ca8f0 0x7f00c40c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.520+0000 7f00c9200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4144ae0 con 0x7f00c40c3600 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.520+0000 7f00c9200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c4152900 con 0x7f00c40ca8f0 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.520+0000 7f00c9200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40c19c0 con 0x7f00c40c6d90 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 0x7f00c4143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 0x7f00c4143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35732/0 (socket says 172.21.15.47:35732) 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 -- 172.21.15.47:0/940941809 learned_addr learned my addr 172.21.15.47:0/940941809 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1400700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40c6d90 0x7f00c4143e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:16.523 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c2800700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40ca8f0 0x7f00c40c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 -- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40c6d90 msgr2=0x7f00c4143e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40c6d90 0x7f00c4143e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 -- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40ca8f0 msgr2=0x7f00c40c0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40ca8f0 0x7f00c40c0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 -- 172.21.15.47:0/940941809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b4009550 con 0x7f00c40c3600 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.521+0000 7f00c1e00700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 0x7f00c4143590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009c10 tx=0x7f00b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.522+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4004510 con 0x7f00c40c3600 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.522+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b401e070 con 0x7f00c40c3600 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.522+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b40038e0 con 0x7f00c40c3600 2024-05-10T04:57:16.524 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.522+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c4144e30 con 0x7f00c40c3600 2024-05-10T04:57:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.522+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c4146ad0 con 0x7f00c40c3600 2024-05-10T04:57:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.523+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c4074720 con 0x7f00c40c3600 2024-05-10T04:57:16.525 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.524+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00b4003a40 con 0x7f00c40c3600 2024-05-10T04:57:16.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.525+0000 7f00ba000700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f00a406acc0 0x7f00a406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:16.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.525+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00b408a460 con 0x7f00c40c3600 2024-05-10T04:57:16.526 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.525+0000 7f00c1400700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f00a406acc0 0x7f00a406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:16.527 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.526+0000 7f00c1400700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f00a406acc0 0x7f00a406d1d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00c40c4940 tx=0x7f00b0009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:16.531 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.530+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f00b4055310 con 0x7f00c40c3600 2024-05-10T04:57:16.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.759+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f00c40bf960 con 0x7f00c40c3600 2024-05-10T04:57:16.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.759+0000 7f00ba000700 1 -- 172.21.15.47:0/940941809 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f00b4058930 con 0x7f00c40c3600 2024-05-10T04:57:16.760 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:57:16.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f00a406acc0 msgr2=0x7f00a406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f00a406acc0 0x7f00a406d1d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f00c40c4940 tx=0x7f00b0009210 comp rx=0 tx=0).stop 2024-05-10T04:57:16.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 msgr2=0x7f00c4143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 0x7f00c4143590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009c10 tx=0x7f00b4004750 comp rx=0 tx=0).stop 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 shutdown_connections 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f00c40ca8f0 0x7f00c40c0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f00c40c3600 0x7f00c4143590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f00a406acc0 0x7f00a406d1d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 --2- 172.21.15.47:0/940941809 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f00c40c6d90 0x7f00c4143e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 >> 172.21.15.47:0/940941809 conn(0x7f00c40c7620 msgr2=0x7f00c40c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 shutdown_connections 2024-05-10T04:57:16.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:16.762+0000 7f00c9200700 1 -- 172.21.15.47:0/940941809 wait complete. 2024-05-10T04:57:16.788 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:57:17.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.071+0000 7f9d2bc00700 1 Processor -- start 2024-05-10T04:57:17.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.071+0000 7f9d2bc00700 1 -- start start 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d2bc00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9d240c6d90 0x7f9d24155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d2bc00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d240ca8f0 0x7f9d240cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d2bc00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240c31e0 con 0x7f9d240c3600 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d2bc00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d240c50e0 con 0x7f9d240c6d90 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d2bc00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d240c5340 con 0x7f9d240ca8f0 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d29200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9d240c6d90 0x7f9d24155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d23e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9d240ca8f0 0x7f9d240cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d29c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9d240c3600 0x7f9d240c3a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41700/0 (socket says 172.21.15.47:41700) 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.073+0000 7f9d29c00700 1 -- 172.21.15.47:0/3900301310 learned_addr learned my addr 172.21.15.47:0/3900301310 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d29200700 1 -- 172.21.15.47:0/3900301310 >> v2:172.21.15.117:3300/0 conn(0x7f9d240ca8f0 msgr2=0x7f9d240cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d29200700 1 --2- 172.21.15.47:0/3900301310 >> v2:172.21.15.117:3300/0 conn(0x7f9d240ca8f0 0x7f9d240cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d29200700 1 -- 172.21.15.47:0/3900301310 >> v1:172.21.15.47:6789/0 conn(0x7f9d240c3600 legacy=0x7f9d240c3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d29200700 1 -- 172.21.15.47:0/3900301310 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d240c5620 con 0x7f9d240c6d90 2024-05-10T04:57:17.075 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d23e00700 1 --2- 172.21.15.47:0/3900301310 >> v2:172.21.15.117:3300/0 conn(0x7f9d240ca8f0 0x7f9d240cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:57:17.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d29200700 1 --2- 172.21.15.47:0/3900301310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24155ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d240cb370 tx=0x7f9d18009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eabbc3e5efa1f55 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:17.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d23400700 1 -- 172.21.15.47:0/3900301310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011830 con 0x7f9d240c6d90 2024-05-10T04:57:17.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d23400700 1 -- 172.21.15.47:0/3900301310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18011990 con 0x7f9d240c6d90 2024-05-10T04:57:17.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.074+0000 7f9d23400700 1 -- 172.21.15.47:0/3900301310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18011d20 con 0x7f9d240c6d90 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3900301310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 msgr2=0x7f9d24155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3900301310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24155ef0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9d240cb370 tx=0x7f9d18009b20 comp rx=0 tx=0).stop 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3900301310 shutdown_connections 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3900301310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24155ef0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3900301310 >> v2:172.21.15.117:3300/0 conn(0x7f9d240ca8f0 0x7f9d240cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3900301310 >> 172.21.15.47:0/3900301310 conn(0x7f9d240c7620 msgr2=0x7f9d240c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3900301310 shutdown_connections 2024-05-10T04:57:17.077 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.075+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3900301310 wait complete. 2024-05-10T04:57:17.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.077+0000 7f9d2bc00700 1 Processor -- start 2024-05-10T04:57:17.078 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.077+0000 7f9d2bc00700 1 -- start start 2024-05-10T04:57:17.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d2bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d240c3600 0x7f9d240bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d2bc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24143d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d2bc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d240ca8f0 0x7f9d24146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d2bc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c00c0 con 0x7f9d240c6d90 2024-05-10T04:57:17.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d2bc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d241450f0 con 0x7f9d240ca8f0 2024-05-10T04:57:17.080 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d2bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240c04f0 con 0x7f9d240c3600 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24143d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d23e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24143d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35758/0 (socket says 172.21.15.47:35758) 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d23e00700 1 -- 172.21.15.47:0/3720121794 learned_addr learned my addr 172.21.15.47:0/3720121794 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d29200700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d240c3600 0x7f9d240bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.079+0000 7f9d29c00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d240ca8f0 0x7f9d24146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d23e00700 1 -- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d240c3600 msgr2=0x7f9d240bfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d23e00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d240c3600 0x7f9d240bfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d23e00700 1 -- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d240ca8f0 msgr2=0x7f9d24146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d23e00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d240ca8f0 0x7f9d24146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d23e00700 1 -- 172.21.15.47:0/3720121794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100094a0 con 0x7f9d240c6d90 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d29c00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d240ca8f0 0x7f9d24146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d29200700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d240c3600 0x7f9d240bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T04:57:17.081 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d23e00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24143d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000e9b0 tx=0x7f9d1000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000c850 con 0x7f9d240c6d90 2024-05-10T04:57:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000c9b0 con 0x7f9d240c6d90 2024-05-10T04:57:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d180094a0 con 0x7f9d240c6d90 2024-05-10T04:57:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000cd60 con 0x7f9d240c6d90 2024-05-10T04:57:17.082 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.080+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d240c1460 con 0x7f9d240c6d90 2024-05-10T04:57:17.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.081+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d241ebe60 con 0x7f9d240c6d90 2024-05-10T04:57:17.083 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.082+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9d10013470 con 0x7f9d240c6d90 2024-05-10T04:57:17.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.083+0000 7f9d20c00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9d0406ac90 0x7f9d0406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.083+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9d10089850 con 0x7f9d240c6d90 2024-05-10T04:57:17.084 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.084+0000 7f9d29200700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9d0406ac90 0x7f9d0406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.085 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.085+0000 7f9d29200700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9d0406ac90 0x7f9d0406d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d240cb370 tx=0x7f9d18008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:17.089 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.088+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9d10054670 con 0x7f9d240c6d90 2024-05-10T04:57:17.344 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.344+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d24074720 con 0x7f9d240c6d90 2024-05-10T04:57:17.345 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.344+0000 7f9d20c00700 1 -- 172.21.15.47:0/3720121794 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d10057c90 con 0x7f9d240c6d90 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9d0406ac90 msgr2=0x7f9d0406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9d0406ac90 0x7f9d0406d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d240cb370 tx=0x7f9d18008030 comp rx=0 tx=0).stop 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 msgr2=0x7f9d24143d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24143d40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000e9b0 tx=0x7f9d1000ed70 comp rx=0 tx=0).stop 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 shutdown_connections 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9d240ca8f0 0x7f9d24146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9d0406ac90 0x7f9d0406d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9d240c3600 0x7f9d240bfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 --2- 172.21.15.47:0/3720121794 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9d240c6d90 0x7f9d24143d40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 >> 172.21.15.47:0/3720121794 conn(0x7f9d240c7620 msgr2=0x7f9d240c8530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 shutdown_connections 2024-05-10T04:57:17.348 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.347+0000 7f9d2bc00700 1 -- 172.21.15.47:0/3720121794 wait complete. 2024-05-10T04:57:17.349 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-10T04:57:17.377 DEBUG:teuthology.orchestra.run.smithi047:> set -ex 2024-05-10T04:57:17.377 DEBUG:teuthology.orchestra.run.smithi047:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T04:57:17.423 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T04:57:17.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 376393 9.22 MB/sec execute 65 sec latency 7.714 ms 2024-05-10T04:57:17.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.744+0000 7fd689400700 1 Processor -- start 2024-05-10T04:57:17.745 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.744+0000 7fd689400700 1 -- start start 2024-05-10T04:57:17.746 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd689400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd6840c5c40 0x7fd684155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd689400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6841597e0 con 0x7fd684152b90 2024-05-10T04:57:17.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd689400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd684158bd0 con 0x7fd6840c8e00 2024-05-10T04:57:17.747 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd689400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6841564f0 con 0x7fd6840c5c40 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd682800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fd6840c5c40 0x7fd684155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd683200700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fd6840c8e00 0x7fd6840c9210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:51274/0 (socket says 172.21.15.47:51274) 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.746+0000 7fd683200700 1 -- 172.21.15.47:0/1973189934 learned_addr learned my addr 172.21.15.47:0/1973189934 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906928554 0 0) 0x7fd684158bd0 con 0x7fd6840c8e00 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6680035b0 con 0x7fd6840c8e00 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1618184807 0 0) 0x7fd6841597e0 con 0x7fd684152b90 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd684158bd0 con 0x7fd684152b90 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd682800700 1 -- 172.21.15.47:0/1973189934 >> v1:172.21.15.117:6789/0 conn(0x7fd6840c8e00 legacy=0x7fd6840c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd682800700 1 -- 172.21.15.47:0/1973189934 >> v1:172.21.15.47:6789/0 conn(0x7fd684152b90 legacy=0x7fd6840c7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.747+0000 7fd682800700 1 -- 172.21.15.47:0/1973189934 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd684158eb0 con 0x7fd6840c5c40 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.748+0000 7fd682800700 1 --2- 172.21.15.47:0/1973189934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6840c5c40 0x7fd684155fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd674009840 tx=0x7fd674009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fc4b010b507ea6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:17.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.748+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674011830 con 0x7fd6840c5c40 2024-05-10T04:57:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.748+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674011990 con 0x7fd6840c5c40 2024-05-10T04:57:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.748+0000 7fd681400700 1 -- 172.21.15.47:0/1973189934 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674011d20 con 0x7fd6840c5c40 2024-05-10T04:57:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.749+0000 7fd689400700 1 -- 172.21.15.47:0/1973189934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6840c5c40 msgr2=0x7fd684155fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.749+0000 7fd689400700 1 --2- 172.21.15.47:0/1973189934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6840c5c40 0x7fd684155fb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd674009840 tx=0x7fd674009b50 comp rx=0 tx=0).stop 2024-05-10T04:57:17.750 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.750+0000 7fd689400700 1 -- 172.21.15.47:0/1973189934 shutdown_connections 2024-05-10T04:57:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.750+0000 7fd689400700 1 --2- 172.21.15.47:0/1973189934 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd6840c5c40 0x7fd684155fb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.750+0000 7fd689400700 1 -- 172.21.15.47:0/1973189934 >> 172.21.15.47:0/1973189934 conn(0x7fd6840ac8b0 msgr2=0x7fd6840accc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.750+0000 7fd689400700 1 -- 172.21.15.47:0/1973189934 shutdown_connections 2024-05-10T04:57:17.751 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.750+0000 7fd689400700 1 -- 172.21.15.47:0/1973189934 wait complete. 2024-05-10T04:57:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.752+0000 7fd689400700 1 Processor -- start 2024-05-10T04:57:17.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.753+0000 7fd689400700 1 -- start start 2024-05-10T04:57:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd689400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6840c5c40 0x7fd6840ab460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd689400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6840c8e00 0x7fd6841eb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd689400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd684152b90 0x7fd6840c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd689400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68414c870 con 0x7fd684152b90 2024-05-10T04:57:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd689400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841eb320 con 0x7fd6840c5c40 2024-05-10T04:57:17.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd689400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd684147c00 con 0x7fd6840c8e00 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd681e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6840c8e00 0x7fd6841eb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd682800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6840c5c40 0x7fd6840ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd683200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd684152b90 0x7fd6840c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd681e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6840c8e00 0x7fd6841eb770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:48738/0 (socket says 172.21.15.47:48738) 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd682800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6840c5c40 0x7fd6840ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:59336/0 (socket says 172.21.15.47:59336) 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.755+0000 7fd681e00700 1 -- 172.21.15.47:0/592733685 learned_addr learned my addr 172.21.15.47:0/592733685 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd683200700 1 -- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6840c8e00 msgr2=0x7fd6841eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd683200700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6840c8e00 0x7fd6841eb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd683200700 1 -- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6840c5c40 msgr2=0x7fd6840ab460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd683200700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6840c5c40 0x7fd6840ab460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd683200700 1 -- 172.21.15.47:0/592733685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740094a0 con 0x7fd684152b90 2024-05-10T04:57:17.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd683200700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd684152b90 0x7fd6840c4350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6840ad4e0 tx=0x7fd67c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00a9e0 con 0x7fd684152b90 2024-05-10T04:57:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.756+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c00ab40 con 0x7fd684152b90 2024-05-10T04:57:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.757+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6841497d0 con 0x7fd684152b90 2024-05-10T04:57:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.757+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00ce80 con 0x7fd684152b90 2024-05-10T04:57:17.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.757+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd684149a20 con 0x7fd684152b90 2024-05-10T04:57:17.759 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.758+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd684156660 con 0x7fd684152b90 2024-05-10T04:57:17.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.760+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd67c01b3b0 con 0x7fd684152b90 2024-05-10T04:57:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.761+0000 7fd67aa00700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd66406ac90 0x7fd66406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:17.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.761+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd67c089080 con 0x7fd684152b90 2024-05-10T04:57:17.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.761+0000 7fd682800700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd66406ac90 0x7fd66406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:17.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.762+0000 7fd682800700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd66406ac90 0x7fd66406d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd674009840 tx=0x7fd674008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:17.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:17.766+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd67c0bc900 con 0x7fd684152b90 2024-05-10T04:57:18.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.045+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd684154ae0 con 0x7fd684152b90 2024-05-10T04:57:18.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.046+0000 7fd67aa00700 1 -- 172.21.15.47:0/592733685 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fd67c053f40 con 0x7fd684152b90 2024-05-10T04:57:18.047 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T04:57:18.048 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:52:40.317170+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T04:57:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd66406ac90 msgr2=0x7fd66406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd66406ac90 0x7fd66406d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd674009840 tx=0x7fd674008030 comp rx=0 tx=0).stop 2024-05-10T04:57:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd684152b90 msgr2=0x7fd6840c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd684152b90 0x7fd6840c4350 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd6840ad4e0 tx=0x7fd67c00cd50 comp rx=0 tx=0).stop 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 shutdown_connections 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd684152b90 0x7fd6840c4350 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd6840c5c40 0x7fd6840ab460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd66406ac90 0x7fd66406d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 --2- 172.21.15.47:0/592733685 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6840c8e00 0x7fd6841eb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 >> 172.21.15.47:0/592733685 conn(0x7fd6840ac8b0 msgr2=0x7fd68406c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 shutdown_connections 2024-05-10T04:57:18.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.049+0000 7fd689400700 1 -- 172.21.15.47:0/592733685 wait complete. 2024-05-10T04:57:18.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T04:57:18.076 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T04:57:18.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.356+0000 7f8c47400700 1 Processor -- start 2024-05-10T04:57:18.357 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.356+0000 7f8c47400700 1 -- start start 2024-05-10T04:57:18.359 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c47400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c40152bb0 0x7f8c400c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c47400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8c4006bdb0 0x7f8c4006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c47400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4006d640 con 0x7f8c400c6cc0 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c47400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c40152fc0 con 0x7f8c4006bdb0 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c47400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c400c9800 con 0x7f8c40152bb0 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c45400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f8c4006bdb0 0x7f8c4006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c44a00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f8c400c6cc0 0x7f8c400c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41716/0 (socket says 172.21.15.47:41716) 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c44a00700 1 -- 172.21.15.47:0/2596235493 learned_addr learned my addr 172.21.15.47:0/2596235493 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:18.360 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.358+0000 7f8c3fe00700 1 --2- 172.21.15.47:0/2596235493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c40152bb0 0x7f8c400c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.359+0000 7f8c45400700 1 -- 172.21.15.47:0/2596235493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c40152bb0 msgr2=0x7f8c400c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:18.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.359+0000 7f8c45400700 1 --2- 172.21.15.47:0/2596235493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c40152bb0 0x7f8c400c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.359+0000 7f8c45400700 1 -- 172.21.15.47:0/2596235493 >> v1:172.21.15.47:6789/0 conn(0x7f8c400c6cc0 legacy=0x7f8c400c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.359+0000 7f8c45400700 1 -- 172.21.15.47:0/2596235493 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4006c700 con 0x7f8c4006bdb0 2024-05-10T04:57:18.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.359+0000 7f8c3f400700 1 -- 172.21.15.47:0/2596235493 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2449910988 0 0) 0x7f8c4006d640 con 0x7f8c400c6cc0 2024-05-10T04:57:18.361 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.359+0000 7f8c45400700 1 --2- 172.21.15.47:0/2596235493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4006bdb0 0x7f8c4006c1c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009d90 tx=0x7f8c3800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd2fd6d8cb01f9f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:18.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c3f400700 1 -- 172.21.15.47:0/2596235493 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3800e070 con 0x7f8c4006bdb0 2024-05-10T04:57:18.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c3f400700 1 -- 172.21.15.47:0/2596235493 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c3800bb20 con 0x7f8c4006bdb0 2024-05-10T04:57:18.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c3f400700 1 -- 172.21.15.47:0/2596235493 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38012430 con 0x7f8c4006bdb0 2024-05-10T04:57:18.362 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c47400700 1 -- 172.21.15.47:0/2596235493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4006bdb0 msgr2=0x7f8c4006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c47400700 1 --2- 172.21.15.47:0/2596235493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4006bdb0 0x7f8c4006c1c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8c38009d90 tx=0x7f8c3800b330 comp rx=0 tx=0).stop 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c47400700 1 -- 172.21.15.47:0/2596235493 shutdown_connections 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c47400700 1 --2- 172.21.15.47:0/2596235493 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c4006bdb0 0x7f8c4006c1c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c47400700 1 --2- 172.21.15.47:0/2596235493 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c40152bb0 0x7f8c400c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.360+0000 7f8c47400700 1 -- 172.21.15.47:0/2596235493 >> 172.21.15.47:0/2596235493 conn(0x7f8c400ca960 msgr2=0x7f8c400cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.361+0000 7f8c47400700 1 -- 172.21.15.47:0/2596235493 shutdown_connections 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.361+0000 7f8c47400700 1 -- 172.21.15.47:0/2596235493 wait complete. 2024-05-10T04:57:18.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.363+0000 7f8c47400700 1 Processor -- start 2024-05-10T04:57:18.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.363+0000 7f8c47400700 1 -- start start 2024-05-10T04:57:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.364+0000 7f8c47400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c4006bdb0 0x7f8c4014d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.364+0000 7f8c47400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c400c6cc0 0x7f8c401ef200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.364+0000 7f8c47400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 0x7f8c400c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.364+0000 7f8c47400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c40148850 con 0x7f8c40152bb0 2024-05-10T04:57:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.364+0000 7f8c47400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401ec470 con 0x7f8c400c6cc0 2024-05-10T04:57:18.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.364+0000 7f8c47400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c401555a0 con 0x7f8c4006bdb0 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 0x7f8c400c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 0x7f8c400c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35790/0 (socket says 172.21.15.47:35790) 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 -- 172.21.15.47:0/3147949717 learned_addr learned my addr 172.21.15.47:0/3147949717 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c3fe00700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c400c6cc0 0x7f8c401ef200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c44a00700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c4006bdb0 0x7f8c4014d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 -- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c4006bdb0 msgr2=0x7f8c4014d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c4006bdb0 0x7f8c4014d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 -- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c400c6cc0 msgr2=0x7f8c401ef200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c400c6cc0 0x7f8c401ef200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.365+0000 7f8c45400700 1 -- 172.21.15.47:0/3147949717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c38009a70 con 0x7f8c40152bb0 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.366+0000 7f8c45400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 0x7f8c400c42c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c400ca930 tx=0x7f8c38004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:18.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.366+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38012430 con 0x7f8c40152bb0 2024-05-10T04:57:18.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.366+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c38020070 con 0x7f8c40152bb0 2024-05-10T04:57:18.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.366+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c40155db0 con 0x7f8c40152bb0 2024-05-10T04:57:18.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.366+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c38004280 con 0x7f8c40152bb0 2024-05-10T04:57:18.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.366+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4014afe0 con 0x7f8c40152bb0 2024-05-10T04:57:18.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.367+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c400c7160 con 0x7f8c40152bb0 2024-05-10T04:57:18.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.368+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8c380043e0 con 0x7f8c40152bb0 2024-05-10T04:57:18.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.369+0000 7f8c3cc00700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c2006ac90 0x7f8c2006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.369+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8c38022070 con 0x7f8c40152bb0 2024-05-10T04:57:18.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.369+0000 7f8c44a00700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c2006ac90 0x7f8c2006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.370+0000 7f8c44a00700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c2006ac90 0x7f8c2006d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c34000f60 tx=0x7f8c34007e70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:18.375 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.374+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f8c380561e0 con 0x7f8c40152bb0 2024-05-10T04:57:18.445 INFO:tasks.workunit.client.1.smithi117.stdout: 1 379026 9.27 MB/sec execute 66 sec latency 35.164 ms 2024-05-10T04:57:18.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.598+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8c40074720 con 0x7f8c40152bb0 2024-05-10T04:57:18.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.599+0000 7f8c3cc00700 1 -- 172.21.15.47:0/3147949717 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8c38059800 con 0x7f8c40152bb0 2024-05-10T04:57:18.599 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T04:57:18.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c2006ac90 msgr2=0x7f8c2006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c2006ac90 0x7f8c2006d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8c34000f60 tx=0x7f8c34007e70 comp rx=0 tx=0).stop 2024-05-10T04:57:18.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 msgr2=0x7f8c400c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 0x7f8c400c42c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8c400ca930 tx=0x7f8c38004ad0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 shutdown_connections 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f8c40152bb0 0x7f8c400c42c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f8c2006ac90 0x7f8c2006d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f8c4006bdb0 0x7f8c4014d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 --2- 172.21.15.47:0/3147949717 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f8c400c6cc0 0x7f8c401ef200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 >> 172.21.15.47:0/3147949717 conn(0x7f8c400ca960 msgr2=0x7f8c40151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 shutdown_connections 2024-05-10T04:57:18.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.601+0000 7f8c47400700 1 -- 172.21.15.47:0/3147949717 wait complete. 2024-05-10T04:57:18.631 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T04:57:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.904+0000 7faa8f800700 1 Processor -- start 2024-05-10T04:57:18.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.904+0000 7faa8f800700 1 -- start start 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa8f800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa8806c4c0 0x7faa880c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa8f800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8806d640 con 0x7faa88152bb0 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa8f800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa880c9800 con 0x7faa880c6cc0 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa8f800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa88152fc0 con 0x7faa8806c4c0 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa87e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7faa88152bb0 0x7faa8806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41726/0 (socket says 172.21.15.47:41726) 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa87e00700 1 -- 172.21.15.47:0/2362759083 learned_addr learned my addr 172.21.15.47:0/2362759083 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:18.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa8d800700 1 --2- 172.21.15.47:0/2362759083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa8806c4c0 0x7faa880c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3402968244 0 0) 0x7faa8806d640 con 0x7faa88152bb0 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.906+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa700035b0 con 0x7faa88152bb0 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909903881 0 0) 0x7faa880c9800 con 0x7faa880c6cc0 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa8806d640 con 0x7faa880c6cc0 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa8d800700 1 -- 172.21.15.47:0/2362759083 >> v1:172.21.15.117:6789/0 conn(0x7faa880c6cc0 legacy=0x7faa880c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa8d800700 1 -- 172.21.15.47:0/2362759083 >> v1:172.21.15.47:6789/0 conn(0x7faa88152bb0 legacy=0x7faa8806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3692951663 0 0) 0x7faa700035b0 con 0x7faa88152bb0 2024-05-10T04:57:18.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa8d800700 1 -- 172.21.15.47:0/2362759083 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa880c8910 con 0x7faa8806c4c0 2024-05-10T04:57:18.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa8d800700 1 --2- 172.21.15.47:0/2362759083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa8806c4c0 0x7faa880c5cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa80009dc0 tx=0x7faa8000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b56ebc941c85062 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:18.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000e070 con 0x7faa8806c4c0 2024-05-10T04:57:18.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80003a20 con 0x7faa8806c4c0 2024-05-10T04:57:18.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.907+0000 7faa87400700 1 -- 172.21.15.47:0/2362759083 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74001670 con 0x7faa8806c4c0 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 -- 172.21.15.47:0/2362759083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa8806c4c0 msgr2=0x7faa880c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 --2- 172.21.15.47:0/2362759083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa8806c4c0 0x7faa880c5cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa80009dc0 tx=0x7faa8000b330 comp rx=0 tx=0).stop 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 -- 172.21.15.47:0/2362759083 shutdown_connections 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 --2- 172.21.15.47:0/2362759083 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa8806c4c0 0x7faa880c5cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 -- 172.21.15.47:0/2362759083 >> 172.21.15.47:0/2362759083 conn(0x7faa880ca960 msgr2=0x7faa880cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 -- 172.21.15.47:0/2362759083 shutdown_connections 2024-05-10T04:57:18.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.908+0000 7faa8f800700 1 -- 172.21.15.47:0/2362759083 wait complete. 2024-05-10T04:57:18.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.910+0000 7faa8f800700 1 Processor -- start 2024-05-10T04:57:18.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.911+0000 7faa8f800700 1 -- start start 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8f800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 0x7faa881543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8f800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880c6cc0 0x7faa8814c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8f800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa88152bb0 0x7faa881e1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8f800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa881dee10 con 0x7faa88152bb0 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8f800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8814d9f0 con 0x7faa8806c4c0 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8f800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8814d4d0 con 0x7faa880c6cc0 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8ce00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 0x7faa881543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.914 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8d800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa88152bb0 0x7faa881e1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8ce00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 0x7faa881543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:59356/0 (socket says 172.21.15.47:59356) 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa8ce00700 1 -- 172.21.15.47:0/3698221390 learned_addr learned my addr 172.21.15.47:0/3698221390 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.912+0000 7faa87e00700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880c6cc0 0x7faa8814c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8d800700 1 -- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880c6cc0 msgr2=0x7faa8814c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8d800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880c6cc0 0x7faa8814c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8d800700 1 -- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 msgr2=0x7faa881543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8d800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 0x7faa881543a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8d800700 1 -- 172.21.15.47:0/3698221390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009a70 con 0x7faa88152bb0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8ce00700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 0x7faa881543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8d800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa88152bb0 0x7faa881e1e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa80009fd0 tx=0x7faa80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800042c0 con 0x7faa88152bb0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80004420 con 0x7faa88152bb0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800047d0 con 0x7faa88152bb0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa881eb820 con 0x7faa88152bb0 2024-05-10T04:57:18.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.913+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8814d1f0 con 0x7faa88152bb0 2024-05-10T04:57:18.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.915+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa88072ec0 con 0x7faa88152bb0 2024-05-10T04:57:18.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.915+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faa8001c460 con 0x7faa88152bb0 2024-05-10T04:57:18.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.916+0000 7faa84c00700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faa6806ac90 0x7faa6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:18.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.916+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa8008ac10 con 0x7faa88152bb0 2024-05-10T04:57:18.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.916+0000 7faa8ce00700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faa6806ac90 0x7faa6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:18.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.917+0000 7faa8ce00700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faa6806ac90 0x7faa6806d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0011e0 tx=0x7faa7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:18.922 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:18.921+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faa80059530 con 0x7faa88152bb0 2024-05-10T04:57:19.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.154+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faa88074720 con 0x7faa88152bb0 2024-05-10T04:57:19.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.154+0000 7faa84c00700 1 -- 172.21.15.47:0/3698221390 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7faa80020020 con 0x7faa88152bb0 2024-05-10T04:57:19.155 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:57:19.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faa6806ac90 msgr2=0x7faa6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faa6806ac90 0x7faa6806d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa7c0011e0 tx=0x7faa7c009040 comp rx=0 tx=0).stop 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa88152bb0 msgr2=0x7faa881e1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa88152bb0 0x7faa881e1e10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7faa80009fd0 tx=0x7faa80004ad0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 shutdown_connections 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7faa88152bb0 0x7faa881e1e10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7faa8806c4c0 0x7faa881543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faa6806ac90 0x7faa6806d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 --2- 172.21.15.47:0/3698221390 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7faa880c6cc0 0x7faa8814c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 >> 172.21.15.47:0/3698221390 conn(0x7faa880ca960 msgr2=0x7faa8806bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 shutdown_connections 2024-05-10T04:57:19.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.157+0000 7faa8f800700 1 -- 172.21.15.47:0/3698221390 wait complete. 2024-05-10T04:57:19.184 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T04:57:19.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 381655 9.31 MB/sec execute 67 sec latency 6.950 ms 2024-05-10T04:57:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.462+0000 7f6635600700 1 Processor -- start 2024-05-10T04:57:19.462 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.462+0000 7f6635600700 1 -- start start 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.463+0000 7f6635600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66300c6cc0 0x7f6630152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.463+0000 7f6635600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f663006bdb0 0x7f663006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.463+0000 7f6635600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f663006d640 con 0x7f66300c5cf0 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.463+0000 7f6635600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66300c9800 con 0x7f66300c6cc0 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.463+0000 7f6635600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663006c700 con 0x7f663006bdb0 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662ea00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f66300c6cc0 0x7f6630152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:19.465 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662e000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f66300c5cf0 0x7f66300c8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41734/0 (socket says 172.21.15.47:41734) 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662e000700 1 -- 172.21.15.47:0/2593805241 learned_addr learned my addr 172.21.15.47:0/2593805241 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662f400700 1 --2- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f663006bdb0 0x7f663006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662d600700 1 -- 172.21.15.47:0/2593805241 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2930288009 0 0) 0x7f663006d640 con 0x7f66300c5cf0 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662d600700 1 -- 172.21.15.47:0/2593805241 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66140035b0 con 0x7f66300c5cf0 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662ea00700 1 -- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f663006bdb0 msgr2=0x7f663006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662ea00700 1 --2- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f663006bdb0 0x7f663006c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662ea00700 1 -- 172.21.15.47:0/2593805241 >> v1:172.21.15.47:6789/0 conn(0x7f66300c5cf0 legacy=0x7f66300c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.464+0000 7f662ea00700 1 -- 172.21.15.47:0/2593805241 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66300c6100 con 0x7f66300c6cc0 2024-05-10T04:57:19.466 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.465+0000 7f662ea00700 1 --2- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66300c6cc0 0x7f6630152bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6620009840 tx=0x7f6620009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d2af1b7281c8e2e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:19.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.465+0000 7f662d600700 1 -- 172.21.15.47:0/2593805241 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620011830 con 0x7f66300c6cc0 2024-05-10T04:57:19.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.465+0000 7f662d600700 1 -- 172.21.15.47:0/2593805241 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6620011990 con 0x7f66300c6cc0 2024-05-10T04:57:19.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.465+0000 7f662d600700 1 -- 172.21.15.47:0/2593805241 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620011d20 con 0x7f66300c6cc0 2024-05-10T04:57:19.467 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 -- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66300c6cc0 msgr2=0x7f6630152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 --2- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66300c6cc0 0x7f6630152bb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6620009840 tx=0x7f6620009b50 comp rx=0 tx=0).stop 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 -- 172.21.15.47:0/2593805241 shutdown_connections 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 --2- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f66300c6cc0 0x7f6630152bb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 --2- 172.21.15.47:0/2593805241 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f663006bdb0 0x7f663006c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 -- 172.21.15.47:0/2593805241 >> 172.21.15.47:0/2593805241 conn(0x7f66300ca960 msgr2=0x7f66300cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 -- 172.21.15.47:0/2593805241 shutdown_connections 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.466+0000 7f6635600700 1 -- 172.21.15.47:0/2593805241 wait complete. 2024-05-10T04:57:19.468 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.468+0000 7f6635600700 1 Processor -- start 2024-05-10T04:57:19.469 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.468+0000 7f6635600700 1 -- start start 2024-05-10T04:57:19.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.469+0000 7f6635600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f663006bdb0 0x7f6630155170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:19.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f6635600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 0x7f663014cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:19.471 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f6635600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66300c6cc0 0x7f6630146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f6635600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6630149940 con 0x7f66300c5cf0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f6635600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66301eea40 con 0x7f663006bdb0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f6635600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663014baa0 con 0x7f66300c6cc0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 0x7f663014cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 0x7f663014cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35806/0 (socket says 172.21.15.47:35806) 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 -- 172.21.15.47:0/3227433802 learned_addr learned my addr 172.21.15.47:0/3227433802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662ea00700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f663006bdb0 0x7f6630155170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662f400700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66300c6cc0 0x7f6630146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 -- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66300c6cc0 msgr2=0x7f6630146c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66300c6cc0 0x7f6630146c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 -- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f663006bdb0 msgr2=0x7f6630155170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f663006bdb0 0x7f6630155170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.470+0000 7f662e000700 1 -- 172.21.15.47:0/3227433802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66200094a0 con 0x7f66300c5cf0 2024-05-10T04:57:19.472 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.471+0000 7f662e000700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 0x7f663014cac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c400 tx=0x7f661c00c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.471+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c005d70 con 0x7f66300c5cf0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.471+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c00ce10 con 0x7f66300c5cf0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.471+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f663014c630 con 0x7f66300c5cf0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.471+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661c007310 con 0x7f66300c5cf0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.471+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663014de40 con 0x7f66300c5cf0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.472+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6630074720 con 0x7f66300c5cf0 2024-05-10T04:57:19.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.473+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f661c007470 con 0x7f66300c5cf0 2024-05-10T04:57:19.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.474+0000 7f6626a00700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f661006acc0 0x7f661006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:19.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.474+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f661c088a30 con 0x7f66300c5cf0 2024-05-10T04:57:19.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.474+0000 7f662ea00700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f661006acc0 0x7f661006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:19.475 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.475+0000 7f662ea00700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f661006acc0 0x7f661006d1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c00 tx=0x7f6620008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:19.479 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.479+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f661c053900 con 0x7f66300c5cf0 2024-05-10T04:57:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.706+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6630156b30 con 0x7f66300c5cf0 2024-05-10T04:57:19.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.706+0000 7f6626a00700 1 -- 172.21.15.47:0/3227433802 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f661c0170a0 con 0x7f66300c5cf0 2024-05-10T04:57:19.707 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f661006acc0 msgr2=0x7f661006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f661006acc0 0x7f661006d1d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6620000c00 tx=0x7f6620008030 comp rx=0 tx=0).stop 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 msgr2=0x7f663014cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 0x7f663014cac0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f661c00c400 tx=0x7f661c00c710 comp rx=0 tx=0).stop 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 shutdown_connections 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f661006acc0 0x7f661006d1d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f66300c6cc0 0x7f6630146c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f663006bdb0 0x7f6630155170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 --2- 172.21.15.47:0/3227433802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f66300c5cf0 0x7f663014cac0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 >> 172.21.15.47:0/3227433802 conn(0x7f66300ca960 msgr2=0x7f6630152060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 shutdown_connections 2024-05-10T04:57:19.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:19.709+0000 7f6635600700 1 -- 172.21.15.47:0/3227433802 wait complete. 2024-05-10T04:57:19.736 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T04:57:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.041+0000 7efc71000700 1 Processor -- start 2024-05-10T04:57:20.042 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.041+0000 7efc71000700 1 -- start start 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc71000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7efc6c1594a0 0x7efc6c152980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc71000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c155da0 con 0x7efc6c0ca120 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc71000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc6c1562d0 con 0x7efc6c0c59a0 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc71000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6c159080 con 0x7efc6c1594a0 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc63e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7efc6c0ca120 0x7efc6c0c70e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41746/0 (socket says 172.21.15.47:41746) 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc63e00700 1 -- 172.21.15.47:0/3807063137 learned_addr learned my addr 172.21.15.47:0/3807063137 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:20.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.043+0000 7efc6be00700 1 --2- 172.21.15.47:0/3807063137 >> v2:172.21.15.117:3300/0 conn(0x7efc6c1594a0 0x7efc6c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1410570915 0 0) 0x7efc6c155da0 con 0x7efc6c0ca120 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc500035b0 con 0x7efc6c0ca120 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433735055 0 0) 0x7efc6c1562d0 con 0x7efc6c0c59a0 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc6c155da0 con 0x7efc6c0c59a0 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6be00700 1 -- 172.21.15.47:0/3807063137 >> v1:172.21.15.117:6789/0 conn(0x7efc6c0c59a0 legacy=0x7efc6c0c8af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6be00700 1 -- 172.21.15.47:0/3807063137 >> v1:172.21.15.47:6789/0 conn(0x7efc6c0ca120 legacy=0x7efc6c0c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6be00700 1 -- 172.21.15.47:0/3807063137 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0c6cc0 con 0x7efc6c1594a0 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6be00700 1 --2- 172.21.15.47:0/3807063137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c1594a0 0x7efc6c152980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc64009d90 tx=0x7efc6400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85bee8d35a559ab9 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.044+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400e070 con 0x7efc6c1594a0 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6400bb20 con 0x7efc6c1594a0 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc6aa00700 1 -- 172.21.15.47:0/3807063137 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6400be90 con 0x7efc6c1594a0 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 -- 172.21.15.47:0/3807063137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c1594a0 msgr2=0x7efc6c152980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 --2- 172.21.15.47:0/3807063137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c1594a0 0x7efc6c152980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc64009d90 tx=0x7efc6400b330 comp rx=0 tx=0).stop 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 -- 172.21.15.47:0/3807063137 shutdown_connections 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 --2- 172.21.15.47:0/3807063137 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c1594a0 0x7efc6c152980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 -- 172.21.15.47:0/3807063137 >> 172.21.15.47:0/3807063137 conn(0x7efc6c0ac320 msgr2=0x7efc6c0ac730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 -- 172.21.15.47:0/3807063137 shutdown_connections 2024-05-10T04:57:20.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.045+0000 7efc71000700 1 -- 172.21.15.47:0/3807063137 wait complete. 2024-05-10T04:57:20.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.048+0000 7efc71000700 1 Processor -- start 2024-05-10T04:57:20.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.048+0000 7efc71000700 1 -- start start 2024-05-10T04:57:20.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc71000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c0c59a0 0x7efc6c1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc71000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c0ca120 0x7efc6c154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc71000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 0x7efc6c140a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc71000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1532c0 con 0x7efc6c1594a0 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc71000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1e0600 con 0x7efc6c0c59a0 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc71000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6c1ebae0 con 0x7efc6c0ca120 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc6be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 0x7efc6c140a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc6b400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c0c59a0 0x7efc6c1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc6b400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c0c59a0 0x7efc6c1514e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:59382/0 (socket says 172.21.15.47:59382) 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc6be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 0x7efc6c140a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35812/0 (socket says 172.21.15.47:35812) 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.049+0000 7efc6b400700 1 -- 172.21.15.47:0/488117959 learned_addr learned my addr 172.21.15.47:0/488117959 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc63e00700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c0ca120 0x7efc6c154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc6be00700 1 -- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c0ca120 msgr2=0x7efc6c154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc6be00700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c0ca120 0x7efc6c154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc6be00700 1 -- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c0c59a0 msgr2=0x7efc6c1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc6be00700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c0c59a0 0x7efc6c1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc6be00700 1 -- 172.21.15.47:0/488117959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009a70 con 0x7efc6c1594a0 2024-05-10T04:57:20.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc6be00700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 0x7efc6c140a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0c7d50 tx=0x7efc64004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64007000 con 0x7efc6c1594a0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.051+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc6c0aba90 con 0x7efc6c1594a0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.050+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6401f070 con 0x7efc6c1594a0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.051+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64003c60 con 0x7efc6c1594a0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.051+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc6c1e2560 con 0x7efc6c1594a0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.052+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc6c074720 con 0x7efc6c1594a0 2024-05-10T04:57:20.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.053+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc64004030 con 0x7efc6c1594a0 2024-05-10T04:57:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.054+0000 7efc63400700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efc4806acc0 0x7efc4806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.054+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efc6408ae00 con 0x7efc6c1594a0 2024-05-10T04:57:20.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.054+0000 7efc6b400700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efc4806acc0 0x7efc4806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.055+0000 7efc6b400700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efc4806acc0 0x7efc4806d1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0011e0 tx=0x7efc5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:20.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.058+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7efc640596d0 con 0x7efc6c1594a0 2024-05-10T04:57:20.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.277+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efc6c0c77c0 con 0x7efc6c1594a0 2024-05-10T04:57:20.280 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.278+0000 7efc63400700 1 -- 172.21.15.47:0/488117959 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7efc64059260 con 0x7efc6c1594a0 2024-05-10T04:57:20.281 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efc4806acc0 msgr2=0x7efc4806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efc4806acc0 0x7efc4806d1d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0011e0 tx=0x7efc5c009040 comp rx=0 tx=0).stop 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 msgr2=0x7efc6c140a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 0x7efc6c140a60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7efc6c0c7d50 tx=0x7efc64004ad0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 shutdown_connections 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efc6c1594a0 0x7efc6c140a60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efc6c0c59a0 0x7efc6c1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efc4806acc0 0x7efc4806d1d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 --2- 172.21.15.47:0/488117959 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efc6c0ca120 0x7efc6c154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.280+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 >> 172.21.15.47:0/488117959 conn(0x7efc6c0ac320 msgr2=0x7efc6c0c6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:20.282 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.281+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 shutdown_connections 2024-05-10T04:57:20.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.281+0000 7efc71000700 1 -- 172.21.15.47:0/488117959 wait complete. 2024-05-10T04:57:20.306 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T04:57:20.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 383837 9.38 MB/sec execute 68 sec latency 18.554 ms 2024-05-10T04:57:20.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.596+0000 7f729bc00700 1 Processor -- start 2024-05-10T04:57:20.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.596+0000 7f729bc00700 1 -- start start 2024-05-10T04:57:20.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f729bc00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f729414f200 0x7f7294151a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f729bc00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7294151fc0 0x7f72941523d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.601 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f729bc00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72940ab330 con 0x7f72940ab850 2024-05-10T04:57:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f729bc00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72940c1c50 con 0x7f7294151fc0 2024-05-10T04:57:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f729bc00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729406eff0 con 0x7f729414f200 2024-05-10T04:57:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f7294151fc0 0x7f72941523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299200700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f72940ab850 0x7f72940c6610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:41750/0 (socket says 172.21.15.47:41750) 2024-05-10T04:57:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299200700 1 -- 172.21.15.47:0/2726265248 learned_addr learned my addr 172.21.15.47:0/2726265248 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T04:57:20.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7293e00700 1 --2- 172.21.15.47:0/2726265248 >> v2:172.21.15.117:3300/0 conn(0x7f729414f200 0x7f7294151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299c00700 1 -- 172.21.15.47:0/2726265248 >> v2:172.21.15.117:3300/0 conn(0x7f729414f200 msgr2=0x7f7294151a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299c00700 1 --2- 172.21.15.47:0/2726265248 >> v2:172.21.15.117:3300/0 conn(0x7f729414f200 0x7f7294151a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299c00700 1 -- 172.21.15.47:0/2726265248 >> v1:172.21.15.47:6789/0 conn(0x7f72940ab850 legacy=0x7f72940c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.598+0000 7f7299c00700 1 -- 172.21.15.47:0/2726265248 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72940ab000 con 0x7f7294151fc0 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.599+0000 7f7299c00700 1 --2- 172.21.15.47:0/2726265248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7294151fc0 0x7f72941523d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7294152bd0 tx=0x7f728c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb13c1dcafedf490 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.599+0000 7f7293400700 1 -- 172.21.15.47:0/2726265248 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c00e070 con 0x7f7294151fc0 2024-05-10T04:57:20.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.599+0000 7f7293400700 1 -- 172.21.15.47:0/2726265248 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728c00bb20 con 0x7f7294151fc0 2024-05-10T04:57:20.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.599+0000 7f7293400700 1 -- 172.21.15.47:0/2726265248 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f728c012430 con 0x7f7294151fc0 2024-05-10T04:57:20.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 -- 172.21.15.47:0/2726265248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7294151fc0 msgr2=0x7f72941523d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 --2- 172.21.15.47:0/2726265248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7294151fc0 0x7f72941523d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7294152bd0 tx=0x7f728c00b330 comp rx=0 tx=0).stop 2024-05-10T04:57:20.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 -- 172.21.15.47:0/2726265248 shutdown_connections 2024-05-10T04:57:20.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 --2- 172.21.15.47:0/2726265248 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f7294151fc0 0x7f72941523d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 --2- 172.21.15.47:0/2726265248 >> v2:172.21.15.117:3300/0 conn(0x7f729414f200 0x7f7294151a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 -- 172.21.15.47:0/2726265248 >> 172.21.15.47:0/2726265248 conn(0x7f72940a8ae0 msgr2=0x7f72940a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:20.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 -- 172.21.15.47:0/2726265248 shutdown_connections 2024-05-10T04:57:20.605 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.600+0000 7f729bc00700 1 -- 172.21.15.47:0/2726265248 wait complete. 2024-05-10T04:57:20.611 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.602+0000 7f729bc00700 1 Processor -- start 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.602+0000 7f729bc00700 1 -- start start 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f729bc00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72940ab850 0x7f7294149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f729bc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 0x7f72941403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f729bc00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7294151fc0 0x7f7294145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f729bc00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294140930 con 0x7f729414f200 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f729bc00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7294151810 con 0x7f7294151fc0 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f729bc00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72940c5e30 con 0x7f72940ab850 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 0x7f72941403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 0x7f72941403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:35826/0 (socket says 172.21.15.47:35826) 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 -- 172.21.15.47:0/2469427935 learned_addr learned my addr 172.21.15.47:0/2469427935 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7299200700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72940ab850 0x7f7294149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7299c00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7294151fc0 0x7f7294145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 -- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72940ab850 msgr2=0x7f7294149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.612 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72940ab850 0x7f7294149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 -- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7294151fc0 msgr2=0x7f7294145540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7294151fc0 0x7f7294145540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.604+0000 7f7293e00700 1 -- 172.21.15.47:0/2469427935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f728c009a70 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.605+0000 7f7293e00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 0x7f72941403f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f728000e870 tx=0x7f728000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.605+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7280009590 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.605+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7280013680 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.605+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72800139f0 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.605+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729414b040 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.605+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72941ef220 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.606+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7294149e30 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.607+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7280013b50 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.608+0000 7f7290c00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727406acc0 0x7f727406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.608+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7280089980 con 0x7f729414f200 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.609+0000 7f7299200700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727406acc0 0x7f727406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T04:57:20.613 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.609+0000 7f7299200700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727406acc0 0x7f727406d1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7288005910 tx=0x7f7288009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T04:57:20.614 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.613+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f7280054670 con 0x7f729414f200 2024-05-10T04:57:20.851 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.851+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7294074720 con 0x7f729414f200 2024-05-10T04:57:20.852 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.851+0000 7f7290c00700 1 -- 172.21.15.47:0/2469427935 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7280017080 con 0x7f729414f200 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727406acc0 msgr2=0x7f727406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727406acc0 0x7f727406d1d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7288005910 tx=0x7f7288009040 comp rx=0 tx=0).stop 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 msgr2=0x7f72941403f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 0x7f72941403f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f728000e870 tx=0x7f728000eb80 comp rx=0 tx=0).stop 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 shutdown_connections 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f7294151fc0 0x7f7294145540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727406acc0 0x7f727406d1d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f72940ab850 0x7f7294149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 --2- 172.21.15.47:0/2469427935 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729414f200 0x7f72941403f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 >> 172.21.15.47:0/2469427935 conn(0x7f72940a8ae0 msgr2=0x7f7294148e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T04:57:20.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 shutdown_connections 2024-05-10T04:57:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T04:57:20.854+0000 7f729bc00700 1 -- 172.21.15.47:0/2469427935 wait complete. 2024-05-10T04:57:20.856 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-10T04:57:20.885 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi047.front.sepia.ceph.com... 2024-05-10T04:57:20.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:57:20.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-10T04:57:20.962 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T04:57:20.979 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi047.stderr:ceph-fuse[53803]: fuse finished with error 0 and tester_r 0 2024-05-10T04:57:21.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 386813 9.50 MB/sec execute 69 sec latency 42.574 ms 2024-05-10T04:57:22.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 389130 9.48 MB/sec execute 70 sec latency 40.104 ms 2024-05-10T04:57:23.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 391383 9.55 MB/sec execute 71 sec latency 11.633 ms 2024-05-10T04:57:23.937 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:57:23.941 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:57:24.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 394269 9.65 MB/sec execute 72 sec latency 28.589 ms 2024-05-10T04:57:25.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 397432 9.76 MB/sec execute 73 sec latency 8.180 ms 2024-05-10T04:57:26.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 399795 9.75 MB/sec execute 74 sec latency 27.443 ms 2024-05-10T04:57:27.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T04:57:27.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:57:27.065 DEBUG:teuthology.orchestra.run.smithi047:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-10T04:57:27.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:57:27.111 DEBUG:teuthology.orchestra.run.smithi047:> ip netns list 2024-05-10T04:57:27.156 INFO:teuthology.orchestra.run.smithi047.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-10T04:57:27.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:57:27.157 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-10T04:57:27.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T04:57:27.231 DEBUG:teuthology.orchestra.run.smithi047:> sudo ip link delete ceph-brx 2024-05-10T04:57:27.343 DEBUG:teuthology.parallel:result is None 2024-05-10T04:57:27.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 402042 9.80 MB/sec execute 75 sec latency 11.549 ms 2024-05-10T04:57:28.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 404812 9.90 MB/sec execute 76 sec latency 32.906 ms 2024-05-10T04:57:29.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 407890 10.00 MB/sec execute 77 sec latency 8.836 ms 2024-05-10T04:57:30.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 410519 9.99 MB/sec execute 78 sec latency 8.503 ms 2024-05-10T04:57:31.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 412670 10.03 MB/sec execute 79 sec latency 36.504 ms 2024-05-10T04:57:32.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 415717 10.12 MB/sec execute 80 sec latency 10.734 ms 2024-05-10T04:57:33.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 418812 10.23 MB/sec execute 81 sec latency 30.288 ms 2024-05-10T04:57:34.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 421460 10.24 MB/sec execute 82 sec latency 7.011 ms 2024-05-10T04:57:35.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 424025 10.28 MB/sec execute 83 sec latency 6.627 ms 2024-05-10T04:57:36.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 426270 10.32 MB/sec execute 84 sec latency 44.120 ms 2024-05-10T04:57:37.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 429443 10.42 MB/sec execute 85 sec latency 16.914 ms 2024-05-10T04:57:38.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 431426 10.37 MB/sec execute 86 sec latency 75.694 ms 2024-05-10T04:57:39.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 432388 10.34 MB/sec execute 87 sec latency 102.318 ms 2024-05-10T04:57:40.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 433953 10.31 MB/sec execute 88 sec latency 26.990 ms 2024-05-10T04:57:41.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 436883 10.39 MB/sec execute 89 sec latency 20.932 ms 2024-05-10T04:57:42.446 INFO:tasks.workunit.client.1.smithi117.stdout: 1 439996 10.47 MB/sec execute 90 sec latency 33.914 ms 2024-05-10T04:57:43.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 442409 10.46 MB/sec execute 91 sec latency 13.483 ms 2024-05-10T04:57:44.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 443231 10.41 MB/sec execute 92 sec latency 121.051 ms 2024-05-10T04:57:45.450 INFO:tasks.workunit.client.1.smithi117.stdout: 1 445782 10.43 MB/sec execute 93 sec latency 29.731 ms 2024-05-10T04:57:46.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 448348 10.50 MB/sec execute 94 sec latency 9.941 ms 2024-05-10T04:57:47.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 451097 10.54 MB/sec execute 95 sec latency 30.203 ms 2024-05-10T04:57:48.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 454291 10.62 MB/sec execute 96 sec latency 8.626 ms 2024-05-10T04:57:49.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 456640 10.60 MB/sec execute 97 sec latency 37.329 ms 2024-05-10T04:57:50.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 458802 10.77 MB/sec execute 98 sec latency 39.311 ms 2024-05-10T04:57:51.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 462149 10.90 MB/sec execute 99 sec latency 6.726 ms 2024-05-10T04:57:52.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 464484 10.87 MB/sec execute 100 sec latency 38.210 ms 2024-05-10T04:57:53.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 467005 10.93 MB/sec execute 101 sec latency 15.497 ms 2024-05-10T04:57:54.088 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:57:54.094 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:57:54.447 INFO:tasks.workunit.client.1.smithi117.stdout: 1 467925 10.85 MB/sec execute 102 sec latency 630.789 ms 2024-05-10T04:57:55.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 468455 10.79 MB/sec execute 103 sec latency 722.634 ms 2024-05-10T04:57:56.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 470631 10.80 MB/sec execute 104 sec latency 21.177 ms 2024-05-10T04:57:57.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 473284 10.83 MB/sec execute 105 sec latency 7.457 ms 2024-05-10T04:57:58.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 476338 10.90 MB/sec execute 106 sec latency 29.784 ms 2024-05-10T04:57:59.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 478270 10.86 MB/sec execute 107 sec latency 80.206 ms 2024-05-10T04:58:00.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 480671 10.89 MB/sec execute 108 sec latency 7.189 ms 2024-05-10T04:58:01.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 483673 10.96 MB/sec execute 109 sec latency 27.065 ms 2024-05-10T04:58:02.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 486743 11.01 MB/sec execute 110 sec latency 41.069 ms 2024-05-10T04:58:03.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 489212 10.99 MB/sec execute 111 sec latency 7.320 ms 2024-05-10T04:58:04.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 491288 11.01 MB/sec execute 112 sec latency 51.457 ms 2024-05-10T04:58:05.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 494321 11.08 MB/sec execute 113 sec latency 15.188 ms 2024-05-10T04:58:06.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 497479 11.13 MB/sec execute 114 sec latency 7.884 ms 2024-05-10T04:58:07.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 499803 11.11 MB/sec execute 115 sec latency 33.364 ms 2024-05-10T04:58:08.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 502159 11.14 MB/sec execute 116 sec latency 6.610 ms 2024-05-10T04:58:09.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 504969 11.19 MB/sec execute 117 sec latency 36.155 ms 2024-05-10T04:58:10.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 508235 11.25 MB/sec execute 118 sec latency 6.809 ms 2024-05-10T04:58:11.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 510583 11.23 MB/sec execute 119 sec latency 20.787 ms 2024-05-10T04:58:12.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 513229 11.27 MB/sec execute 120 sec latency 6.223 ms 2024-05-10T04:58:13.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 515937 11.30 MB/sec execute 121 sec latency 9.262 ms 2024-05-10T04:58:14.448 INFO:tasks.workunit.client.1.smithi117.stdout: 1 518746 11.34 MB/sec execute 122 sec latency 188.681 ms 2024-05-10T04:58:15.449 INFO:tasks.workunit.client.1.smithi117.stdout: 1 519934 11.28 MB/sec execute 123 sec latency 319.286 ms 2024-05-10T04:58:16.449 INFO:tasks.workunit.client.1.smithi117.stdout: 1 522899 11.33 MB/sec execute 124 sec latency 7.328 ms 2024-05-10T04:58:17.449 INFO:tasks.workunit.client.1.smithi117.stdout: 1 525883 11.38 MB/sec execute 125 sec latency 26.921 ms 2024-05-10T04:58:18.449 INFO:tasks.workunit.client.1.smithi117.stdout: 1 528481 11.39 MB/sec execute 126 sec latency 6.912 ms 2024-05-10T04:58:19.449 INFO:tasks.workunit.client.1.smithi117.stdout: 1 530116 11.36 MB/sec execute 127 sec latency 163.692 ms 2024-05-10T04:58:20.450 INFO:tasks.workunit.client.1.smithi117.stdout: 1 531545 11.32 MB/sec execute 128 sec latency 237.365 ms 2024-05-10T04:58:21.450 INFO:tasks.workunit.client.1.smithi117.stdout: 1 533576 11.33 MB/sec execute 129 sec latency 23.406 ms 2024-05-10T04:58:22.450 INFO:tasks.workunit.client.1.smithi117.stdout: 1 536702 11.39 MB/sec execute 130 sec latency 18.529 ms 2024-05-10T04:58:23.450 INFO:tasks.workunit.client.1.smithi117.stdout: 1 539409 11.40 MB/sec execute 131 sec latency 7.334 ms 2024-05-10T04:58:24.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 541538 11.40 MB/sec execute 132 sec latency 70.867 ms 2024-05-10T04:58:25.361 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:58:25.370 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:58:25.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 543251 11.39 MB/sec execute 133 sec latency 194.247 ms 2024-05-10T04:58:26.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 544675 11.35 MB/sec execute 134 sec latency 32.710 ms 2024-05-10T04:58:27.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 547620 11.40 MB/sec execute 135 sec latency 6.796 ms 2024-05-10T04:58:28.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 550840 11.45 MB/sec execute 136 sec latency 11.476 ms 2024-05-10T04:58:29.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 553022 11.42 MB/sec execute 137 sec latency 30.767 ms 2024-05-10T04:58:30.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 555104 11.43 MB/sec execute 138 sec latency 31.749 ms 2024-05-10T04:58:31.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 558240 11.48 MB/sec execute 139 sec latency 8.979 ms 2024-05-10T04:58:32.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 561337 11.52 MB/sec execute 140 sec latency 6.816 ms 2024-05-10T04:58:33.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 563455 11.49 MB/sec execute 141 sec latency 49.063 ms 2024-05-10T04:58:34.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 565602 11.51 MB/sec execute 142 sec latency 8.080 ms 2024-05-10T04:58:35.451 INFO:tasks.workunit.client.1.smithi117.stdout: 1 568590 11.56 MB/sec execute 143 sec latency 21.419 ms 2024-05-10T04:58:36.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 569523 11.49 MB/sec execute 144 sec latency 350.657 ms 2024-05-10T04:58:37.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 572416 11.53 MB/sec execute 145 sec latency 8.936 ms 2024-05-10T04:58:38.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 575276 11.55 MB/sec execute 146 sec latency 8.707 ms 2024-05-10T04:58:39.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 577093 11.54 MB/sec execute 147 sec latency 43.761 ms 2024-05-10T04:58:40.452 INFO:tasks.workunit.client.1.smithi117.stdout: 1 578364 11.51 MB/sec execute 148 sec latency 151.818 ms 2024-05-10T04:58:41.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 579666 11.48 MB/sec execute 149 sec latency 148.380 ms 2024-05-10T04:58:42.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 582733 11.53 MB/sec execute 150 sec latency 34.226 ms 2024-05-10T04:58:43.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 585089 11.51 MB/sec execute 151 sec latency 38.032 ms 2024-05-10T04:58:44.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 587197 11.52 MB/sec execute 152 sec latency 45.540 ms 2024-05-10T04:58:45.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 589768 11.55 MB/sec execute 153 sec latency 61.027 ms 2024-05-10T04:58:46.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 592197 11.53 MB/sec execute 154 sec latency 9.757 ms 2024-05-10T04:58:47.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 594758 11.56 MB/sec execute 155 sec latency 6.610 ms 2024-05-10T04:58:48.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 597252 11.58 MB/sec execute 156 sec latency 27.132 ms 2024-05-10T04:58:49.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 600220 11.61 MB/sec execute 157 sec latency 9.056 ms 2024-05-10T04:58:50.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 601959 11.59 MB/sec execute 158 sec latency 37.264 ms 2024-05-10T04:58:51.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 604139 11.60 MB/sec execute 159 sec latency 312.859 ms 2024-05-10T04:58:52.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 606719 11.61 MB/sec execute 160 sec latency 8.185 ms 2024-05-10T04:58:53.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 608448 11.59 MB/sec execute 161 sec latency 64.076 ms 2024-05-10T04:58:54.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 611374 11.62 MB/sec execute 162 sec latency 7.180 ms 2024-05-10T04:58:55.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 613942 11.63 MB/sec execute 163 sec latency 34.087 ms 2024-05-10T04:58:55.540 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:58:55.545 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:58:56.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 616736 11.64 MB/sec execute 164 sec latency 6.991 ms 2024-05-10T04:58:57.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 618822 11.64 MB/sec execute 165 sec latency 49.172 ms 2024-05-10T04:58:58.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 621945 11.69 MB/sec execute 166 sec latency 12.876 ms 2024-05-10T04:58:59.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 625036 11.72 MB/sec execute 167 sec latency 8.997 ms 2024-05-10T04:59:00.453 INFO:tasks.workunit.client.1.smithi117.stdout: 1 627634 11.71 MB/sec execute 168 sec latency 7.535 ms 2024-05-10T04:59:01.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 629540 11.71 MB/sec execute 169 sec latency 27.129 ms 2024-05-10T04:59:02.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 632555 11.75 MB/sec execute 170 sec latency 24.575 ms 2024-05-10T04:59:03.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 634932 11.74 MB/sec execute 171 sec latency 28.164 ms 2024-05-10T04:59:04.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 636864 11.73 MB/sec execute 172 sec latency 23.837 ms 2024-05-10T04:59:05.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 639681 11.77 MB/sec execute 173 sec latency 10.015 ms 2024-05-10T04:59:06.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 642244 11.77 MB/sec execute 174 sec latency 35.487 ms 2024-05-10T04:59:07.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 644674 11.77 MB/sec execute 175 sec latency 7.780 ms 2024-05-10T04:59:08.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 647084 11.78 MB/sec execute 176 sec latency 30.154 ms 2024-05-10T04:59:09.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 650210 11.82 MB/sec execute 177 sec latency 6.786 ms 2024-05-10T04:59:10.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 652791 11.82 MB/sec execute 178 sec latency 29.288 ms 2024-05-10T04:59:11.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 654998 11.83 MB/sec execute 179 sec latency 6.928 ms 2024-05-10T04:59:12.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 657707 11.84 MB/sec execute 180 sec latency 7.796 ms 2024-05-10T04:59:13.454 INFO:tasks.workunit.client.1.smithi117.stdout: 1 660800 11.88 MB/sec execute 181 sec latency 11.824 ms 2024-05-10T04:59:14.455 INFO:tasks.workunit.client.1.smithi117.stdout: 1 663127 11.86 MB/sec execute 182 sec latency 36.497 ms 2024-05-10T04:59:15.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 665063 11.86 MB/sec execute 183 sec latency 36.179 ms 2024-05-10T04:59:16.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 665526 11.82 MB/sec execute 184 sec latency 423.616 ms 2024-05-10T04:59:17.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 667238 11.80 MB/sec execute 185 sec latency 369.971 ms 2024-05-10T04:59:18.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 667913 11.76 MB/sec execute 186 sec latency 51.039 ms 2024-05-10T04:59:19.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 670601 11.77 MB/sec execute 187 sec latency 7.895 ms 2024-05-10T04:59:20.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 672683 11.77 MB/sec execute 188 sec latency 23.925 ms 2024-05-10T04:59:21.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 673573 11.72 MB/sec execute 189 sec latency 394.192 ms 2024-05-10T04:59:22.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 675508 11.72 MB/sec execute 190 sec latency 100.294 ms 2024-05-10T04:59:23.456 INFO:tasks.workunit.client.1.smithi117.stdout: 1 677973 11.73 MB/sec execute 191 sec latency 67.212 ms 2024-05-10T04:59:24.457 INFO:tasks.workunit.client.1.smithi117.stdout: 1 680401 11.73 MB/sec execute 192 sec latency 12.259 ms 2024-05-10T04:59:25.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 682660 11.74 MB/sec execute 193 sec latency 32.106 ms 2024-05-10T04:59:25.649 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:59:25.653 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:59:26.457 INFO:tasks.workunit.client.1.smithi117.stdout: 1 685671 11.77 MB/sec execute 194 sec latency 30.234 ms 2024-05-10T04:59:27.457 INFO:tasks.workunit.client.1.smithi117.stdout: 1 688299 11.77 MB/sec execute 195 sec latency 21.504 ms 2024-05-10T04:59:28.457 INFO:tasks.workunit.client.1.smithi117.stdout: 1 690507 11.78 MB/sec execute 196 sec latency 11.267 ms 2024-05-10T04:59:29.457 INFO:tasks.workunit.client.1.smithi117.stdout: 1 693111 11.79 MB/sec execute 197 sec latency 38.482 ms 2024-05-10T04:59:30.457 INFO:tasks.workunit.client.1.smithi117.stdout: 1 696249 11.82 MB/sec execute 198 sec latency 7.933 ms 2024-05-10T04:59:31.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 698518 11.80 MB/sec execute 199 sec latency 8.360 ms 2024-05-10T04:59:32.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 700527 11.81 MB/sec execute 200 sec latency 38.547 ms 2024-05-10T04:59:33.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 703503 11.84 MB/sec execute 201 sec latency 39.170 ms 2024-05-10T04:59:34.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 706144 11.84 MB/sec execute 202 sec latency 7.674 ms 2024-05-10T04:59:35.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 708311 11.84 MB/sec execute 203 sec latency 26.037 ms 2024-05-10T04:59:36.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 710816 11.85 MB/sec execute 204 sec latency 13.255 ms 2024-05-10T04:59:37.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 713593 11.87 MB/sec execute 205 sec latency 53.182 ms 2024-05-10T04:59:38.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 716100 11.86 MB/sec execute 206 sec latency 7.096 ms 2024-05-10T04:59:39.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 718221 11.87 MB/sec execute 207 sec latency 17.316 ms 2024-05-10T04:59:40.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 721151 11.90 MB/sec execute 208 sec latency 50.027 ms 2024-05-10T04:59:41.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 723835 11.90 MB/sec execute 209 sec latency 6.992 ms 2024-05-10T04:59:42.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 726108 11.90 MB/sec execute 210 sec latency 12.731 ms 2024-05-10T04:59:43.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 728544 11.91 MB/sec execute 211 sec latency 42.261 ms 2024-05-10T04:59:44.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 731650 11.94 MB/sec execute 212 sec latency 7.154 ms 2024-05-10T04:59:45.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 733986 11.93 MB/sec execute 213 sec latency 11.074 ms 2024-05-10T04:59:46.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 735950 11.93 MB/sec execute 214 sec latency 40.190 ms 2024-05-10T04:59:47.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 738850 11.96 MB/sec execute 215 sec latency 47.185 ms 2024-05-10T04:59:48.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 741076 11.94 MB/sec execute 216 sec latency 10.039 ms 2024-05-10T04:59:49.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 742742 11.94 MB/sec execute 217 sec latency 200.803 ms 2024-05-10T04:59:50.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 745504 11.95 MB/sec execute 218 sec latency 10.969 ms 2024-05-10T04:59:51.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 746365 11.91 MB/sec execute 219 sec latency 370.667 ms 2024-05-10T04:59:52.458 INFO:tasks.workunit.client.1.smithi117.stdout: 1 746387 11.86 MB/sec execute 220 sec latency 405.215 ms 2024-05-10T04:59:53.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 747440 11.83 MB/sec execute 221 sec latency 673.742 ms 2024-05-10T04:59:54.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 748872 11.81 MB/sec execute 222 sec latency 56.258 ms 2024-05-10T04:59:55.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 751197 11.81 MB/sec execute 223 sec latency 10.817 ms 2024-05-10T04:59:55.761 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:59:55.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T04:59:56.365 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-05-10T04:59:56.363+0000 7f7229400700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50115) UID: 0 2024-05-10T04:59:56.365 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-05-10T04:59:56.363+0000 7fa259800700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50115) UID: 0 2024-05-10T04:59:56.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 753122 11.82 MB/sec execute 224 sec latency 342.161 ms 2024-05-10T04:59:57.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 755274 11.80 MB/sec execute 225 sec latency 51.040 ms 2024-05-10T04:59:58.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 757057 11.80 MB/sec execute 226 sec latency 40.441 ms 2024-05-10T04:59:59.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 760134 11.83 MB/sec execute 227 sec latency 14.251 ms 2024-05-10T05:00:00.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 762639 11.83 MB/sec execute 228 sec latency 23.426 ms 2024-05-10T05:00:01.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 764939 11.83 MB/sec execute 229 sec latency 7.178 ms 2024-05-10T05:00:02.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 767635 11.84 MB/sec execute 230 sec latency 12.574 ms 2024-05-10T05:00:03.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 770259 11.85 MB/sec execute 231 sec latency 52.456 ms 2024-05-10T05:00:04.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 772478 11.85 MB/sec execute 232 sec latency 7.661 ms 2024-05-10T05:00:05.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 774770 11.86 MB/sec execute 233 sec latency 39.149 ms 2024-05-10T05:00:06.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 777842 11.88 MB/sec execute 234 sec latency 33.161 ms 2024-05-10T05:00:07.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 780348 11.88 MB/sec execute 235 sec latency 10.569 ms 2024-05-10T05:00:08.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 782390 11.87 MB/sec execute 236 sec latency 13.290 ms 2024-05-10T05:00:09.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 784992 11.89 MB/sec execute 237 sec latency 49.658 ms 2024-05-10T05:00:10.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 787291 11.88 MB/sec execute 238 sec latency 8.434 ms 2024-05-10T05:00:11.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 789337 11.89 MB/sec execute 239 sec latency 14.362 ms 2024-05-10T05:00:12.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 792021 11.91 MB/sec execute 240 sec latency 42.716 ms 2024-05-10T05:00:13.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 794175 11.89 MB/sec execute 241 sec latency 9.421 ms 2024-05-10T05:00:14.459 INFO:tasks.workunit.client.1.smithi117.stdout: 1 796053 11.89 MB/sec execute 242 sec latency 34.678 ms 2024-05-10T05:00:15.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 798707 11.90 MB/sec execute 243 sec latency 26.766 ms 2024-05-10T05:00:16.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 800502 11.89 MB/sec execute 244 sec latency 8.401 ms 2024-05-10T05:00:17.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 802857 11.90 MB/sec execute 245 sec latency 32.987 ms 2024-05-10T05:00:18.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 805383 11.90 MB/sec execute 246 sec latency 8.496 ms 2024-05-10T05:00:19.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 807047 11.89 MB/sec execute 247 sec latency 36.602 ms 2024-05-10T05:00:20.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 809822 11.91 MB/sec execute 248 sec latency 29.312 ms 2024-05-10T05:00:21.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 812478 11.91 MB/sec execute 249 sec latency 8.871 ms 2024-05-10T05:00:22.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 814479 11.91 MB/sec execute 250 sec latency 21.270 ms 2024-05-10T05:00:23.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 817193 11.92 MB/sec execute 251 sec latency 32.289 ms 2024-05-10T05:00:24.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 820136 11.94 MB/sec execute 252 sec latency 8.086 ms 2024-05-10T05:00:25.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 822009 11.92 MB/sec execute 253 sec latency 8.784 ms 2024-05-10T05:00:26.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 824360 11.93 MB/sec execute 254 sec latency 42.914 ms 2024-05-10T05:00:27.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 827202 11.95 MB/sec execute 255 sec latency 18.902 ms 2024-05-10T05:00:28.460 INFO:tasks.workunit.client.1.smithi117.stdout: 1 827567 11.91 MB/sec execute 256 sec latency 245.313 ms 2024-05-10T05:00:29.462 INFO:tasks.workunit.client.1.smithi117.stdout: 1 828099 11.87 MB/sec execute 257 sec latency 122.551 ms 2024-05-10T05:00:30.462 INFO:tasks.workunit.client.1.smithi117.stdout: 1 831000 11.89 MB/sec execute 258 sec latency 23.063 ms 2024-05-10T05:00:31.462 INFO:tasks.workunit.client.1.smithi117.stdout: 1 831911 11.85 MB/sec execute 259 sec latency 371.940 ms 2024-05-10T05:00:32.462 INFO:tasks.workunit.client.1.smithi117.stdout: 1 834650 11.87 MB/sec execute 260 sec latency 42.447 ms 2024-05-10T05:00:33.463 INFO:tasks.workunit.client.1.smithi117.stdout: 1 837124 11.87 MB/sec execute 261 sec latency 53.551 ms 2024-05-10T05:00:34.463 INFO:tasks.workunit.client.1.smithi117.stdout: 1 837749 11.84 MB/sec execute 262 sec latency 287.774 ms 2024-05-10T05:00:35.463 INFO:tasks.workunit.client.1.smithi117.stdout: 1 838508 11.81 MB/sec execute 263 sec latency 59.708 ms 2024-05-10T05:00:36.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 841521 11.83 MB/sec execute 264 sec latency 7.397 ms 2024-05-10T05:00:37.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 842392 11.80 MB/sec execute 265 sec latency 343.141 ms 2024-05-10T05:00:38.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 845320 11.82 MB/sec execute 266 sec latency 43.130 ms 2024-05-10T05:00:39.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 847788 11.82 MB/sec execute 267 sec latency 9.470 ms 2024-05-10T05:00:40.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 850082 11.82 MB/sec execute 268 sec latency 7.976 ms 2024-05-10T05:00:41.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 852667 11.83 MB/sec execute 269 sec latency 35.854 ms 2024-05-10T05:00:42.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 855738 11.85 MB/sec execute 270 sec latency 9.353 ms 2024-05-10T05:00:43.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 857632 11.84 MB/sec execute 271 sec latency 66.074 ms 2024-05-10T05:00:44.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 860066 11.84 MB/sec execute 272 sec latency 19.920 ms 2024-05-10T05:00:45.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 863047 11.87 MB/sec execute 273 sec latency 9.098 ms 2024-05-10T05:00:46.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 865227 11.85 MB/sec execute 274 sec latency 47.722 ms 2024-05-10T05:00:47.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 867459 11.86 MB/sec execute 275 sec latency 7.302 ms 2024-05-10T05:00:48.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 870222 11.88 MB/sec execute 276 sec latency 45.149 ms 2024-05-10T05:00:49.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 872846 11.88 MB/sec execute 277 sec latency 9.238 ms 2024-05-10T05:00:50.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 874572 11.87 MB/sec execute 278 sec latency 40.833 ms 2024-05-10T05:00:51.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 877354 11.89 MB/sec execute 279 sec latency 8.029 ms 2024-05-10T05:00:52.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 879405 11.87 MB/sec execute 280 sec latency 49.075 ms 2024-05-10T05:00:53.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 881378 11.87 MB/sec execute 281 sec latency 9.377 ms 2024-05-10T05:00:54.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 884234 11.90 MB/sec execute 282 sec latency 31.105 ms 2024-05-10T05:00:55.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 886278 11.88 MB/sec execute 283 sec latency 14.808 ms 2024-05-10T05:00:56.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 888243 11.88 MB/sec execute 284 sec latency 31.189 ms 2024-05-10T05:00:57.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 891188 11.90 MB/sec execute 285 sec latency 32.999 ms 2024-05-10T05:00:58.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 893507 11.89 MB/sec execute 286 sec latency 8.464 ms 2024-05-10T05:00:59.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 894957 11.89 MB/sec execute 287 sec latency 164.665 ms 2024-05-10T05:01:00.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 895457 11.85 MB/sec execute 288 sec latency 282.596 ms 2024-05-10T05:01:01.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 897272 11.83 MB/sec execute 289 sec latency 240.668 ms 2024-05-10T05:01:02.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 899480 11.84 MB/sec execute 290 sec latency 8.109 ms 2024-05-10T05:01:03.464 INFO:tasks.workunit.client.1.smithi117.stdout: 1 902360 11.86 MB/sec execute 291 sec latency 8.955 ms 2024-05-10T05:01:04.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 904095 11.84 MB/sec execute 292 sec latency 236.636 ms 2024-05-10T05:01:05.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 904647 11.82 MB/sec execute 293 sec latency 413.533 ms 2024-05-10T05:01:06.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 906280 11.80 MB/sec execute 294 sec latency 21.917 ms 2024-05-10T05:01:07.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 909206 11.83 MB/sec execute 295 sec latency 20.397 ms 2024-05-10T05:01:08.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 911738 11.83 MB/sec execute 296 sec latency 36.565 ms 2024-05-10T05:01:09.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 913890 11.83 MB/sec execute 297 sec latency 9.211 ms 2024-05-10T05:01:10.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 916611 11.84 MB/sec execute 298 sec latency 12.164 ms 2024-05-10T05:01:11.465 INFO:tasks.workunit.client.1.smithi117.stdout: 1 918239 11.88 MB/sec execute 299 sec latency 49.277 ms 2024-05-10T05:01:12.466 INFO:tasks.workunit.client.1.smithi117.stdout: 1 920333 11.89 MB/sec execute 300 sec latency 367.038 ms 2024-05-10T05:01:13.466 INFO:tasks.workunit.client.1.smithi117.stdout: 1 922642 11.87 MB/sec execute 301 sec latency 7.566 ms 2024-05-10T05:01:14.466 INFO:tasks.workunit.client.1.smithi117.stdout: 1 924590 11.88 MB/sec execute 302 sec latency 104.308 ms 2024-05-10T05:01:15.467 INFO:tasks.workunit.client.1.smithi117.stdout: 1 925685 11.85 MB/sec execute 303 sec latency 279.736 ms 2024-05-10T05:01:16.467 INFO:tasks.workunit.client.1.smithi117.stdout: 1 927788 11.86 MB/sec execute 304 sec latency 37.051 ms 2024-05-10T05:01:17.467 INFO:tasks.workunit.client.1.smithi117.stdout: 1 930311 11.86 MB/sec execute 305 sec latency 35.291 ms 2024-05-10T05:01:18.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 932336 11.86 MB/sec execute 306 sec latency 10.433 ms 2024-05-10T05:01:19.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 935031 11.87 MB/sec execute 307 sec latency 11.054 ms 2024-05-10T05:01:20.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 937067 11.86 MB/sec execute 308 sec latency 59.062 ms 2024-05-10T05:01:21.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 939296 11.86 MB/sec execute 309 sec latency 20.655 ms 2024-05-10T05:01:22.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 941804 11.88 MB/sec execute 310 sec latency 283.052 ms 2024-05-10T05:01:23.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 943704 11.86 MB/sec execute 311 sec latency 351.500 ms 2024-05-10T05:01:24.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 945863 11.86 MB/sec execute 312 sec latency 8.176 ms 2024-05-10T05:01:25.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 948758 11.88 MB/sec execute 313 sec latency 57.337 ms 2024-05-10T05:01:26.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 951042 11.87 MB/sec execute 314 sec latency 9.964 ms 2024-05-10T05:01:27.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 953133 11.87 MB/sec execute 315 sec latency 10.319 ms 2024-05-10T05:01:28.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 955988 11.89 MB/sec execute 316 sec latency 30.722 ms 2024-05-10T05:01:29.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 958518 11.89 MB/sec execute 317 sec latency 8.778 ms 2024-05-10T05:01:30.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 960565 11.89 MB/sec execute 318 sec latency 46.184 ms 2024-05-10T05:01:31.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 963239 11.90 MB/sec execute 319 sec latency 36.478 ms 2024-05-10T05:01:32.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 966147 11.91 MB/sec execute 320 sec latency 8.036 ms 2024-05-10T05:01:33.468 INFO:tasks.workunit.client.1.smithi117.stdout: 1 968253 11.90 MB/sec execute 321 sec latency 11.757 ms 2024-05-10T05:01:34.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 970394 11.91 MB/sec execute 322 sec latency 39.975 ms 2024-05-10T05:01:35.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 973227 11.92 MB/sec execute 323 sec latency 10.067 ms 2024-05-10T05:01:36.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 975379 11.91 MB/sec execute 324 sec latency 17.615 ms 2024-05-10T05:01:37.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 977623 11.92 MB/sec execute 325 sec latency 66.841 ms 2024-05-10T05:01:38.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 980356 11.93 MB/sec execute 326 sec latency 8.631 ms 2024-05-10T05:01:39.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 982063 11.92 MB/sec execute 327 sec latency 11.917 ms 2024-05-10T05:01:40.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 984410 11.92 MB/sec execute 328 sec latency 49.525 ms 2024-05-10T05:01:41.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 986561 11.91 MB/sec execute 329 sec latency 8.830 ms 2024-05-10T05:01:42.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 988392 11.91 MB/sec execute 330 sec latency 12.970 ms 2024-05-10T05:01:43.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 990693 11.91 MB/sec execute 331 sec latency 83.794 ms 2024-05-10T05:01:44.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 992684 11.91 MB/sec execute 332 sec latency 8.849 ms 2024-05-10T05:01:45.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 995202 11.92 MB/sec execute 333 sec latency 37.990 ms 2024-05-10T05:01:46.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 997795 11.92 MB/sec execute 334 sec latency 22.478 ms 2024-05-10T05:01:47.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 999603 11.91 MB/sec execute 335 sec latency 28.301 ms 2024-05-10T05:01:48.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1002315 11.93 MB/sec execute 336 sec latency 43.113 ms 2024-05-10T05:01:49.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1004886 11.93 MB/sec execute 337 sec latency 8.259 ms 2024-05-10T05:01:50.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1006198 11.91 MB/sec execute 338 sec latency 128.915 ms 2024-05-10T05:01:51.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1008623 11.92 MB/sec execute 339 sec latency 31.504 ms 2024-05-10T05:01:52.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1009936 11.90 MB/sec execute 340 sec latency 281.232 ms 2024-05-10T05:01:53.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1012791 11.92 MB/sec execute 341 sec latency 383.999 ms 2024-05-10T05:01:54.469 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1015425 11.92 MB/sec execute 342 sec latency 8.571 ms 2024-05-10T05:01:55.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1016782 11.91 MB/sec execute 343 sec latency 122.829 ms 2024-05-10T05:01:56.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1017300 11.88 MB/sec execute 344 sec latency 422.537 ms 2024-05-10T05:01:57.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1018814 11.87 MB/sec execute 345 sec latency 53.528 ms 2024-05-10T05:01:58.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1021023 11.87 MB/sec execute 346 sec latency 39.964 ms 2024-05-10T05:01:59.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1023805 11.88 MB/sec execute 347 sec latency 7.138 ms 2024-05-10T05:02:00.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1026512 11.89 MB/sec execute 348 sec latency 39.699 ms 2024-05-10T05:02:01.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1027258 11.87 MB/sec execute 349 sec latency 156.920 ms 2024-05-10T05:02:02.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1027601 11.83 MB/sec execute 350 sec latency 117.116 ms 2024-05-10T05:02:03.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1029615 11.83 MB/sec execute 351 sec latency 352.485 ms 2024-05-10T05:02:04.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1031416 11.82 MB/sec execute 352 sec latency 8.936 ms 2024-05-10T05:02:05.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1034171 11.84 MB/sec execute 353 sec latency 13.336 ms 2024-05-10T05:02:06.470 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1036186 11.83 MB/sec execute 354 sec latency 45.156 ms 2024-05-10T05:02:07.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1038111 11.83 MB/sec execute 355 sec latency 11.011 ms 2024-05-10T05:02:08.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1041077 11.85 MB/sec execute 356 sec latency 40.823 ms 2024-05-10T05:02:09.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1043221 11.83 MB/sec execute 357 sec latency 36.457 ms 2024-05-10T05:02:10.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1045223 11.84 MB/sec execute 358 sec latency 7.975 ms 2024-05-10T05:02:11.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1048225 11.85 MB/sec execute 359 sec latency 8.287 ms 2024-05-10T05:02:12.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1050343 11.84 MB/sec execute 360 sec latency 53.353 ms 2024-05-10T05:02:13.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1051898 11.84 MB/sec execute 361 sec latency 360.336 ms 2024-05-10T05:02:14.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1053987 11.83 MB/sec execute 362 sec latency 35.948 ms 2024-05-10T05:02:15.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1056114 11.83 MB/sec execute 363 sec latency 7.665 ms 2024-05-10T05:02:16.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1058981 11.85 MB/sec execute 364 sec latency 38.334 ms 2024-05-10T05:02:17.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1061491 11.85 MB/sec execute 365 sec latency 43.774 ms 2024-05-10T05:02:18.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1063796 11.85 MB/sec execute 366 sec latency 7.680 ms 2024-05-10T05:02:19.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1066377 11.86 MB/sec execute 367 sec latency 21.771 ms 2024-05-10T05:02:20.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1069394 11.87 MB/sec execute 368 sec latency 24.603 ms 2024-05-10T05:02:21.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1071728 11.86 MB/sec execute 369 sec latency 7.575 ms 2024-05-10T05:02:22.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1073907 11.87 MB/sec execute 370 sec latency 8.731 ms 2024-05-10T05:02:23.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1076649 11.88 MB/sec execute 371 sec latency 38.794 ms 2024-05-10T05:02:24.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1078935 11.87 MB/sec execute 372 sec latency 22.764 ms 2024-05-10T05:02:25.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1081055 11.88 MB/sec execute 373 sec latency 14.488 ms 2024-05-10T05:02:26.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1083974 11.89 MB/sec execute 374 sec latency 7.865 ms 2024-05-10T05:02:27.471 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1086357 11.89 MB/sec execute 375 sec latency 79.743 ms 2024-05-10T05:02:28.472 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1088371 11.89 MB/sec execute 376 sec latency 23.226 ms 2024-05-10T05:02:29.472 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1090965 11.90 MB/sec execute 377 sec latency 26.661 ms 2024-05-10T05:02:30.472 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1093683 11.90 MB/sec execute 378 sec latency 22.732 ms 2024-05-10T05:02:31.472 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1095713 11.90 MB/sec execute 379 sec latency 9.238 ms 2024-05-10T05:02:32.472 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1097731 11.90 MB/sec execute 380 sec latency 197.146 ms 2024-05-10T05:02:33.472 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1097810 11.87 MB/sec execute 381 sec latency 675.792 ms 2024-05-10T05:02:34.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1098673 11.85 MB/sec execute 382 sec latency 73.565 ms 2024-05-10T05:02:35.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1100811 11.85 MB/sec execute 383 sec latency 86.918 ms 2024-05-10T05:02:36.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1102839 11.84 MB/sec execute 384 sec latency 9.296 ms 2024-05-10T05:02:37.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1105100 11.85 MB/sec execute 385 sec latency 103.886 ms 2024-05-10T05:02:38.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1105433 11.82 MB/sec execute 386 sec latency 265.063 ms 2024-05-10T05:02:39.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1107302 11.81 MB/sec execute 387 sec latency 55.789 ms 2024-05-10T05:02:40.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1109214 11.81 MB/sec execute 388 sec latency 23.251 ms 2024-05-10T05:02:41.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1111612 11.81 MB/sec execute 389 sec latency 188.545 ms 2024-05-10T05:02:42.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1113005 11.80 MB/sec execute 390 sec latency 314.572 ms 2024-05-10T05:02:43.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1115713 11.81 MB/sec execute 391 sec latency 25.761 ms 2024-05-10T05:02:44.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1118331 11.82 MB/sec execute 392 sec latency 55.999 ms 2024-05-10T05:02:45.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1120434 11.81 MB/sec execute 393 sec latency 30.834 ms 2024-05-10T05:02:46.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1123157 11.82 MB/sec execute 394 sec latency 8.785 ms 2024-05-10T05:02:47.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1126207 11.84 MB/sec execute 395 sec latency 26.789 ms 2024-05-10T05:02:47.590 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:02:47.765 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:02:48.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1128789 11.84 MB/sec execute 396 sec latency 9.031 ms 2024-05-10T05:02:49.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1130943 11.84 MB/sec execute 397 sec latency 7.731 ms 2024-05-10T05:02:50.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1133471 11.85 MB/sec execute 398 sec latency 41.019 ms 2024-05-10T05:02:51.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1135877 11.84 MB/sec execute 399 sec latency 8.475 ms 2024-05-10T05:02:52.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1137627 11.84 MB/sec execute 400 sec latency 11.787 ms 2024-05-10T05:02:53.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1140506 11.85 MB/sec execute 401 sec latency 23.087 ms 2024-05-10T05:02:54.473 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1142657 11.84 MB/sec execute 402 sec latency 40.677 ms 2024-05-10T05:02:55.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1144651 11.84 MB/sec execute 403 sec latency 17.187 ms 2024-05-10T05:02:56.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1147629 11.86 MB/sec execute 404 sec latency 27.984 ms 2024-05-10T05:02:57.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1150315 11.86 MB/sec execute 405 sec latency 20.608 ms 2024-05-10T05:02:58.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1152727 11.86 MB/sec execute 406 sec latency 7.496 ms 2024-05-10T05:02:59.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1155051 11.87 MB/sec execute 407 sec latency 47.800 ms 2024-05-10T05:03:00.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1158065 11.88 MB/sec execute 408 sec latency 7.890 ms 2024-05-10T05:03:01.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1160418 11.87 MB/sec execute 409 sec latency 7.968 ms 2024-05-10T05:03:02.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1162341 11.87 MB/sec execute 410 sec latency 11.112 ms 2024-05-10T05:03:03.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1165289 11.89 MB/sec execute 411 sec latency 26.546 ms 2024-05-10T05:03:04.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1167471 11.88 MB/sec execute 412 sec latency 37.721 ms 2024-05-10T05:03:05.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1169557 11.88 MB/sec execute 413 sec latency 9.251 ms 2024-05-10T05:03:06.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1172504 11.90 MB/sec execute 414 sec latency 7.944 ms 2024-05-10T05:03:07.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1174588 11.89 MB/sec execute 415 sec latency 49.472 ms 2024-05-10T05:03:08.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1176379 11.89 MB/sec execute 416 sec latency 91.541 ms 2024-05-10T05:03:09.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1178864 11.89 MB/sec execute 417 sec latency 56.357 ms 2024-05-10T05:03:10.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1180696 11.89 MB/sec execute 418 sec latency 25.522 ms 2024-05-10T05:03:11.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1183305 11.89 MB/sec execute 419 sec latency 7.967 ms 2024-05-10T05:03:12.474 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1185728 11.89 MB/sec execute 420 sec latency 39.840 ms 2024-05-10T05:03:13.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1186693 11.88 MB/sec execute 421 sec latency 376.736 ms 2024-05-10T05:03:14.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1186702 11.85 MB/sec execute 422 sec latency 550.375 ms 2024-05-10T05:03:15.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1187280 11.83 MB/sec execute 423 sec latency 476.930 ms 2024-05-10T05:03:16.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1188382 11.81 MB/sec execute 424 sec latency 100.838 ms 2024-05-10T05:03:17.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1190572 11.81 MB/sec execute 425 sec latency 33.662 ms 2024-05-10T05:03:17.923 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:03:17.929 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:03:18.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1193365 11.83 MB/sec execute 426 sec latency 153.984 ms 2024-05-10T05:03:19.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1194060 11.80 MB/sec execute 427 sec latency 332.333 ms 2024-05-10T05:03:20.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1197250 11.82 MB/sec execute 428 sec latency 8.494 ms 2024-05-10T05:03:21.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1200124 11.82 MB/sec execute 429 sec latency 8.494 ms 2024-05-10T05:03:22.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1202110 11.82 MB/sec execute 430 sec latency 28.779 ms 2024-05-10T05:03:23.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1204828 11.83 MB/sec execute 431 sec latency 11.056 ms 2024-05-10T05:03:24.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1207812 11.84 MB/sec execute 432 sec latency 42.068 ms 2024-05-10T05:03:25.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1210164 11.83 MB/sec execute 433 sec latency 9.020 ms 2024-05-10T05:03:26.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1212105 11.83 MB/sec execute 434 sec latency 30.580 ms 2024-05-10T05:03:27.476 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1215073 11.85 MB/sec execute 435 sec latency 35.452 ms 2024-05-10T05:03:28.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1217999 11.85 MB/sec execute 436 sec latency 7.680 ms 2024-05-10T05:03:29.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1220578 11.85 MB/sec execute 437 sec latency 8.324 ms 2024-05-10T05:03:30.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1222437 11.86 MB/sec execute 438 sec latency 50.636 ms 2024-05-10T05:03:31.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1224947 11.86 MB/sec execute 439 sec latency 53.972 ms 2024-05-10T05:03:32.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1226810 11.86 MB/sec execute 440 sec latency 9.219 ms 2024-05-10T05:03:33.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1229313 11.86 MB/sec execute 441 sec latency 9.170 ms 2024-05-10T05:03:34.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1231823 11.86 MB/sec execute 442 sec latency 10.235 ms 2024-05-10T05:03:35.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1233276 11.85 MB/sec execute 443 sec latency 32.794 ms 2024-05-10T05:03:36.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1236051 11.86 MB/sec execute 444 sec latency 44.639 ms 2024-05-10T05:03:37.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1238075 11.85 MB/sec execute 445 sec latency 11.237 ms 2024-05-10T05:03:38.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1240204 11.86 MB/sec execute 446 sec latency 8.913 ms 2024-05-10T05:03:39.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1243043 11.87 MB/sec execute 447 sec latency 8.902 ms 2024-05-10T05:03:40.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1244315 11.85 MB/sec execute 448 sec latency 52.195 ms 2024-05-10T05:03:41.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1246945 11.86 MB/sec execute 449 sec latency 22.903 ms 2024-05-10T05:03:42.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1249169 11.85 MB/sec execute 450 sec latency 10.821 ms 2024-05-10T05:03:43.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1250926 11.85 MB/sec execute 451 sec latency 35.522 ms 2024-05-10T05:03:44.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1253872 11.87 MB/sec execute 452 sec latency 27.422 ms 2024-05-10T05:03:45.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1256099 11.86 MB/sec execute 453 sec latency 8.864 ms 2024-05-10T05:03:46.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1257291 11.86 MB/sec execute 454 sec latency 229.164 ms 2024-05-10T05:03:47.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1257582 11.83 MB/sec execute 455 sec latency 126.761 ms 2024-05-10T05:03:48.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1259033 11.82 MB/sec execute 456 sec latency 220.520 ms 2024-05-10T05:03:49.443 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:03:49.449 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:03:49.477 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1261444 11.82 MB/sec execute 457 sec latency 31.029 ms 2024-05-10T05:03:50.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1264289 11.83 MB/sec execute 458 sec latency 48.163 ms 2024-05-10T05:03:51.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1265089 11.81 MB/sec execute 459 sec latency 252.425 ms 2024-05-10T05:03:52.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1265733 11.80 MB/sec execute 460 sec latency 292.275 ms 2024-05-10T05:03:53.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1268412 11.80 MB/sec execute 461 sec latency 9.136 ms 2024-05-10T05:03:54.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1271221 11.81 MB/sec execute 462 sec latency 8.338 ms 2024-05-10T05:03:55.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1272367 11.80 MB/sec execute 463 sec latency 278.639 ms 2024-05-10T05:03:56.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1275213 11.81 MB/sec execute 464 sec latency 38.992 ms 2024-05-10T05:03:57.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1277496 11.80 MB/sec execute 465 sec latency 29.667 ms 2024-05-10T05:03:58.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1279663 11.80 MB/sec execute 466 sec latency 8.094 ms 2024-05-10T05:03:59.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1282450 11.81 MB/sec execute 467 sec latency 39.834 ms 2024-05-10T05:04:00.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1285007 11.82 MB/sec execute 468 sec latency 31.457 ms 2024-05-10T05:04:01.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1287266 11.82 MB/sec execute 469 sec latency 7.834 ms 2024-05-10T05:04:02.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1289874 11.82 MB/sec execute 470 sec latency 33.382 ms 2024-05-10T05:04:03.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1292919 11.84 MB/sec execute 471 sec latency 26.983 ms 2024-05-10T05:04:04.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1295309 11.83 MB/sec execute 472 sec latency 10.037 ms 2024-05-10T05:04:05.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1297320 11.83 MB/sec execute 473 sec latency 30.811 ms 2024-05-10T05:04:06.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1300328 11.84 MB/sec execute 474 sec latency 7.383 ms 2024-05-10T05:04:07.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1302796 11.84 MB/sec execute 475 sec latency 51.706 ms 2024-05-10T05:04:08.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1305032 11.84 MB/sec execute 476 sec latency 7.574 ms 2024-05-10T05:04:09.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1307574 11.85 MB/sec execute 477 sec latency 24.559 ms 2024-05-10T05:04:10.478 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1310416 11.86 MB/sec execute 478 sec latency 30.451 ms 2024-05-10T05:04:11.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1312715 11.85 MB/sec execute 479 sec latency 10.613 ms 2024-05-10T05:04:12.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1314800 11.85 MB/sec execute 480 sec latency 25.023 ms 2024-05-10T05:04:13.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1317870 11.87 MB/sec execute 481 sec latency 7.477 ms 2024-05-10T05:04:14.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1320105 11.86 MB/sec execute 482 sec latency 57.124 ms 2024-05-10T05:04:15.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1322032 11.86 MB/sec execute 483 sec latency 8.496 ms 2024-05-10T05:04:16.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1324881 11.87 MB/sec execute 484 sec latency 27.007 ms 2024-05-10T05:04:17.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1327054 11.86 MB/sec execute 485 sec latency 26.903 ms 2024-05-10T05:04:18.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1329159 11.87 MB/sec execute 486 sec latency 8.696 ms 2024-05-10T05:04:19.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1332121 11.88 MB/sec execute 487 sec latency 25.079 ms 2024-05-10T05:04:19.564 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:04:19.569 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:04:20.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1334064 11.87 MB/sec execute 488 sec latency 224.465 ms 2024-05-10T05:04:21.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1336084 11.87 MB/sec execute 489 sec latency 19.419 ms 2024-05-10T05:04:22.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1337163 11.86 MB/sec execute 490 sec latency 325.249 ms 2024-05-10T05:04:23.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1339064 11.86 MB/sec execute 491 sec latency 53.261 ms 2024-05-10T05:04:24.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1341218 11.85 MB/sec execute 492 sec latency 29.131 ms 2024-05-10T05:04:25.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1343245 11.85 MB/sec execute 493 sec latency 34.529 ms 2024-05-10T05:04:26.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1346222 11.87 MB/sec execute 494 sec latency 39.521 ms 2024-05-10T05:04:27.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1346813 11.84 MB/sec execute 495 sec latency 502.761 ms 2024-05-10T05:04:28.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1347802 11.83 MB/sec execute 496 sec latency 273.978 ms 2024-05-10T05:04:29.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1349870 11.83 MB/sec execute 497 sec latency 47.380 ms 2024-05-10T05:04:30.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1352230 11.83 MB/sec execute 498 sec latency 37.329 ms 2024-05-10T05:04:31.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1354180 11.83 MB/sec execute 499 sec latency 9.366 ms 2024-05-10T05:04:32.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1356942 11.84 MB/sec execute 500 sec latency 9.066 ms 2024-05-10T05:04:33.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1358978 11.83 MB/sec execute 501 sec latency 45.820 ms 2024-05-10T05:04:34.479 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1360976 11.83 MB/sec execute 502 sec latency 9.896 ms 2024-05-10T05:04:35.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1362696 11.82 MB/sec execute 503 sec latency 364.290 ms 2024-05-10T05:04:36.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1364518 11.82 MB/sec execute 504 sec latency 32.895 ms 2024-05-10T05:04:37.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1367594 11.83 MB/sec execute 505 sec latency 7.717 ms 2024-05-10T05:04:38.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1370111 11.84 MB/sec execute 506 sec latency 31.323 ms 2024-05-10T05:04:39.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1372553 11.84 MB/sec execute 507 sec latency 7.660 ms 2024-05-10T05:04:40.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1375032 11.84 MB/sec execute 508 sec latency 37.845 ms 2024-05-10T05:04:41.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1377279 11.87 MB/sec execute 509 sec latency 53.102 ms 2024-05-10T05:04:42.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1379381 11.87 MB/sec execute 510 sec latency 9.089 ms 2024-05-10T05:04:43.480 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1380283 11.86 MB/sec execute 511 sec latency 443.494 ms 2024-05-10T05:04:44.482 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1382412 11.86 MB/sec execute 512 sec latency 44.510 ms 2024-05-10T05:04:45.482 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1384512 11.85 MB/sec execute 513 sec latency 45.991 ms 2024-05-10T05:04:46.482 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1386471 11.86 MB/sec execute 514 sec latency 10.783 ms 2024-05-10T05:04:47.482 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1389071 11.86 MB/sec execute 515 sec latency 45.838 ms 2024-05-10T05:04:48.482 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1389965 11.85 MB/sec execute 516 sec latency 130.425 ms 2024-05-10T05:04:49.482 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1392224 11.85 MB/sec execute 517 sec latency 64.157 ms 2024-05-10T05:04:50.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1394552 11.85 MB/sec execute 518 sec latency 58.135 ms 2024-05-10T05:04:51.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1397045 11.85 MB/sec execute 519 sec latency 30.452 ms 2024-05-10T05:04:51.576 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:04:51.580 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:04:52.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1400148 11.86 MB/sec execute 520 sec latency 17.612 ms 2024-05-10T05:04:53.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1402374 11.86 MB/sec execute 521 sec latency 11.705 ms 2024-05-10T05:04:54.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1404271 11.86 MB/sec execute 522 sec latency 24.493 ms 2024-05-10T05:04:55.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1406812 11.86 MB/sec execute 523 sec latency 71.185 ms 2024-05-10T05:04:56.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1408484 11.86 MB/sec execute 524 sec latency 37.279 ms 2024-05-10T05:04:57.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1410949 11.86 MB/sec execute 525 sec latency 24.465 ms 2024-05-10T05:04:58.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1413175 11.86 MB/sec execute 526 sec latency 33.054 ms 2024-05-10T05:04:59.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1415024 11.85 MB/sec execute 527 sec latency 10.356 ms 2024-05-10T05:05:00.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1417894 11.87 MB/sec execute 528 sec latency 9.227 ms 2024-05-10T05:05:01.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1420108 11.86 MB/sec execute 529 sec latency 8.800 ms 2024-05-10T05:05:02.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1421914 11.86 MB/sec execute 530 sec latency 64.782 ms 2024-05-10T05:05:03.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1424695 11.87 MB/sec execute 531 sec latency 25.878 ms 2024-05-10T05:05:04.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1426615 11.86 MB/sec execute 532 sec latency 9.205 ms 2024-05-10T05:05:05.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1428744 11.86 MB/sec execute 533 sec latency 39.936 ms 2024-05-10T05:05:06.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1431291 11.86 MB/sec execute 534 sec latency 8.943 ms 2024-05-10T05:05:07.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1433098 11.86 MB/sec execute 535 sec latency 9.076 ms 2024-05-10T05:05:08.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1435635 11.87 MB/sec execute 536 sec latency 47.495 ms 2024-05-10T05:05:09.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1437739 11.86 MB/sec execute 537 sec latency 24.424 ms 2024-05-10T05:05:10.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1439641 11.86 MB/sec execute 538 sec latency 11.561 ms 2024-05-10T05:05:11.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1442241 11.86 MB/sec execute 539 sec latency 38.790 ms 2024-05-10T05:05:12.483 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1443174 11.85 MB/sec execute 540 sec latency 348.407 ms 2024-05-10T05:05:13.484 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1445618 11.85 MB/sec execute 541 sec latency 36.946 ms 2024-05-10T05:05:14.484 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1446593 11.84 MB/sec execute 542 sec latency 75.789 ms 2024-05-10T05:05:15.484 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1446661 11.82 MB/sec execute 543 sec latency 350.535 ms 2024-05-10T05:05:16.484 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1448477 11.81 MB/sec execute 544 sec latency 197.615 ms 2024-05-10T05:05:17.484 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1449322 11.80 MB/sec execute 545 sec latency 219.636 ms 2024-05-10T05:05:18.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1451401 11.80 MB/sec execute 546 sec latency 10.253 ms 2024-05-10T05:05:19.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1453584 11.80 MB/sec execute 547 sec latency 36.352 ms 2024-05-10T05:05:20.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1455995 11.80 MB/sec execute 548 sec latency 38.758 ms 2024-05-10T05:05:21.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1457660 11.80 MB/sec execute 549 sec latency 10.585 ms 2024-05-10T05:05:21.897 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:05:21.902 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:05:22.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1460361 11.81 MB/sec execute 550 sec latency 33.007 ms 2024-05-10T05:05:23.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1461912 11.80 MB/sec execute 551 sec latency 48.172 ms 2024-05-10T05:05:24.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1464260 11.80 MB/sec execute 552 sec latency 9.426 ms 2024-05-10T05:05:25.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1466320 11.79 MB/sec execute 553 sec latency 39.888 ms 2024-05-10T05:05:26.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1468362 11.80 MB/sec execute 554 sec latency 8.738 ms 2024-05-10T05:05:27.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1471174 11.81 MB/sec execute 555 sec latency 111.180 ms 2024-05-10T05:05:28.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1473266 11.80 MB/sec execute 556 sec latency 48.396 ms 2024-05-10T05:05:29.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1475267 11.80 MB/sec execute 557 sec latency 15.576 ms 2024-05-10T05:05:30.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1478168 11.81 MB/sec execute 558 sec latency 43.989 ms 2024-05-10T05:05:31.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1480332 11.80 MB/sec execute 559 sec latency 38.056 ms 2024-05-10T05:05:32.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1482426 11.80 MB/sec execute 560 sec latency 8.576 ms 2024-05-10T05:05:33.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1485405 11.82 MB/sec execute 561 sec latency 34.652 ms 2024-05-10T05:05:34.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1488205 11.82 MB/sec execute 562 sec latency 8.454 ms 2024-05-10T05:05:35.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1489764 11.81 MB/sec execute 563 sec latency 43.137 ms 2024-05-10T05:05:36.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1492659 11.82 MB/sec execute 564 sec latency 11.021 ms 2024-05-10T05:05:37.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1495417 11.83 MB/sec execute 565 sec latency 29.492 ms 2024-05-10T05:05:38.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1496991 11.82 MB/sec execute 566 sec latency 50.209 ms 2024-05-10T05:05:39.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1499573 11.83 MB/sec execute 567 sec latency 10.344 ms 2024-05-10T05:05:40.485 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1501587 11.82 MB/sec execute 568 sec latency 44.677 ms 2024-05-10T05:05:41.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1503237 11.82 MB/sec execute 569 sec latency 28.711 ms 2024-05-10T05:05:42.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1505527 11.82 MB/sec execute 570 sec latency 19.817 ms 2024-05-10T05:05:43.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1507222 11.81 MB/sec execute 571 sec latency 11.498 ms 2024-05-10T05:05:44.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1509849 11.82 MB/sec execute 572 sec latency 50.207 ms 2024-05-10T05:05:45.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1511556 11.81 MB/sec execute 573 sec latency 12.060 ms 2024-05-10T05:05:46.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1513808 11.81 MB/sec execute 574 sec latency 44.169 ms 2024-05-10T05:05:47.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1516278 11.81 MB/sec execute 575 sec latency 46.199 ms 2024-05-10T05:05:48.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1518012 11.81 MB/sec execute 576 sec latency 73.105 ms 2024-05-10T05:05:49.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1520897 11.82 MB/sec execute 577 sec latency 9.100 ms 2024-05-10T05:05:50.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1523385 11.82 MB/sec execute 578 sec latency 30.075 ms 2024-05-10T05:05:51.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1524956 11.81 MB/sec execute 579 sec latency 64.607 ms 2024-05-10T05:05:52.008 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:05:52.013 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:05:52.410 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-05-10T05:05:52.408+0000 7fa259800700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50367) UID: 0 2024-05-10T05:05:52.417 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-05-10T05:05:52.415+0000 7f7229400700 -1 Fail to open '/proc/50367/cmdline' error = (2) No such file or directory 2024-05-10T05:05:52.417 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-05-10T05:05:52.416+0000 7f7229400700 -1 received signal: Hangup from (PID: 50367) UID: 0 2024-05-10T05:05:52.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1526523 11.81 MB/sec execute 580 sec latency 381.633 ms 2024-05-10T05:05:53.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1528320 11.80 MB/sec execute 581 sec latency 31.738 ms 2024-05-10T05:05:54.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1531269 11.81 MB/sec execute 582 sec latency 9.461 ms 2024-05-10T05:05:55.486 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1533015 11.81 MB/sec execute 583 sec latency 13.622 ms 2024-05-10T05:05:56.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1535236 11.81 MB/sec execute 584 sec latency 18.880 ms 2024-05-10T05:05:57.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1535291 11.79 MB/sec execute 585 sec latency 230.657 ms 2024-05-10T05:05:58.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1535472 11.77 MB/sec execute 586 sec latency 1013.797 ms 2024-05-10T05:05:59.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1535859 11.75 MB/sec execute 587 sec latency 68.255 ms 2024-05-10T05:06:00.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1537280 11.74 MB/sec execute 588 sec latency 33.198 ms 2024-05-10T05:06:01.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1539221 11.74 MB/sec execute 589 sec latency 8.709 ms 2024-05-10T05:06:02.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1542142 11.75 MB/sec execute 590 sec latency 9.315 ms 2024-05-10T05:06:03.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1544530 11.75 MB/sec execute 591 sec latency 22.008 ms 2024-05-10T05:06:04.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1546294 11.75 MB/sec execute 592 sec latency 66.821 ms 2024-05-10T05:06:05.488 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1549243 11.76 MB/sec execute 593 sec latency 8.373 ms 2024-05-10T05:06:06.489 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1551826 11.76 MB/sec execute 594 sec latency 14.052 ms 2024-05-10T05:06:07.489 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1553224 11.75 MB/sec execute 595 sec latency 65.864 ms 2024-05-10T05:06:08.489 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1556190 11.76 MB/sec execute 596 sec latency 33.821 ms 2024-05-10T05:06:09.491 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1558393 11.76 MB/sec execute 597 sec latency 9.305 ms 2024-05-10T05:06:10.492 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1560355 11.76 MB/sec execute 598 sec latency 32.678 ms 2024-05-10T05:06:11.491 INFO:tasks.workunit.client.1.smithi117.stdout: 1 1563274 11.77 MB/sec execute 599 sec latency 57.958 ms 2024-05-10T05:06:12.491 INFO:tasks.workunit.client.1.smithi117.stdout: 1 cleanup 600 sec 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: 0 cleanup 600 sec 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Operation Count AvgLat MaxLat 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: ---------------------------------------- 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: NTCreateX 224765 0.891 675.780 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Close 165108 0.004 2.342 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Rename 9516 4.173 383.982 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Unlink 45391 1.722 394.178 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Deltree 6 67.194 120.449 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Mkdir 3 0.017 0.017 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Qpathinfo 203738 0.699 1013.779 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Qfileinfo 35704 0.002 0.311 2024-05-10T05:06:12.745 INFO:tasks.workunit.client.1.smithi117.stdout: Qfsinfo 37350 0.236 12.780 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: Sfileinfo 18310 0.034 3.280 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: Find 78768 0.170 130.415 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: WriteX 112110 0.029 75.158 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: ReadX 352190 0.011 368.937 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: LockX 730 0.557 6.732 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: UnlockX 730 0.488 3.321 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: Flush 15755 6.557 785.129 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-10T05:06:12.746 INFO:tasks.workunit.client.1.smithi117.stdout:Throughput 11.7681 MB/sec 1 clients 1 procs max_latency=1013.797 ms 2024-05-10T05:06:12.760 INFO:tasks.workunit.client.1.smithi117.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2024-05-10T05:06:12.760 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-10T05:06:12.760 INFO:tasks.workunit.client.1.smithi117.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2024-05-10T05:06:12.762 INFO:tasks.workunit.client.1.smithi117.stdout:9 of 10 processes prepared for launch 0 sec 2024-05-10T05:06:12.863 INFO:tasks.workunit.client.1.smithi117.stdout:10 of 10 processes prepared for launch 0 sec 2024-05-10T05:06:12.863 INFO:tasks.workunit.client.1.smithi117.stdout:releasing clients 2024-05-10T05:06:13.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 355 127.59 MB/sec warmup 1 sec latency 41.430 ms 2024-05-10T05:06:14.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 379 67.57 MB/sec warmup 2 sec latency 788.456 ms 2024-05-10T05:06:15.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 667 69.88 MB/sec warmup 3 sec latency 942.917 ms 2024-05-10T05:06:16.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 822 53.75 MB/sec warmup 4 sec latency 107.483 ms 2024-05-10T05:06:17.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 1274 47.91 MB/sec warmup 5 sec latency 55.769 ms 2024-05-10T05:06:18.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 2033 44.23 MB/sec warmup 6 sec latency 46.790 ms 2024-05-10T05:06:19.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 2504 40.93 MB/sec warmup 7 sec latency 160.081 ms 2024-05-10T05:06:20.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 2993 41.90 MB/sec warmup 8 sec latency 88.094 ms 2024-05-10T05:06:21.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 3635 42.92 MB/sec warmup 9 sec latency 53.377 ms 2024-05-10T05:06:22.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 3844 39.76 MB/sec warmup 10 sec latency 93.760 ms 2024-05-10T05:06:23.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 3981 36.42 MB/sec warmup 11 sec latency 114.217 ms 2024-05-10T05:06:24.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 4139 33.41 MB/sec warmup 12 sec latency 97.278 ms 2024-05-10T05:06:25.863 INFO:tasks.workunit.client.1.smithi117.stdout: 10 4274 31.02 MB/sec warmup 13 sec latency 272.589 ms 2024-05-10T05:06:26.864 INFO:tasks.workunit.client.1.smithi117.stdout: 10 4556 29.48 MB/sec warmup 14 sec latency 161.779 ms 2024-05-10T05:06:27.864 INFO:tasks.workunit.client.1.smithi117.stdout: 10 4952 28.96 MB/sec warmup 15 sec latency 271.192 ms 2024-05-10T05:06:28.864 INFO:tasks.workunit.client.1.smithi117.stdout: 10 5695 28.88 MB/sec warmup 16 sec latency 45.576 ms 2024-05-10T05:06:29.864 INFO:tasks.workunit.client.1.smithi117.stdout: 10 6206 29.14 MB/sec warmup 17 sec latency 116.398 ms 2024-05-10T05:06:30.864 INFO:tasks.workunit.client.1.smithi117.stdout: 10 6643 29.58 MB/sec warmup 18 sec latency 275.597 ms 2024-05-10T05:06:31.865 INFO:tasks.workunit.client.1.smithi117.stdout: 10 6878 28.81 MB/sec warmup 19 sec latency 599.301 ms 2024-05-10T05:06:32.865 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7234 29.09 MB/sec warmup 20 sec latency 300.857 ms 2024-05-10T05:06:33.865 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7234 27.71 MB/sec warmup 21 sec latency 1074.606 ms 2024-05-10T05:06:34.865 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7265 26.47 MB/sec warmup 22 sec latency 1889.877 ms 2024-05-10T05:06:35.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7288 25.34 MB/sec warmup 23 sec latency 807.246 ms 2024-05-10T05:06:36.866 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7340 24.49 MB/sec warmup 24 sec latency 1008.294 ms 2024-05-10T05:06:37.866 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7426 23.60 MB/sec warmup 25 sec latency 118.145 ms 2024-05-10T05:06:38.866 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7524 22.76 MB/sec warmup 26 sec latency 138.266 ms 2024-05-10T05:06:39.866 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7675 21.95 MB/sec warmup 27 sec latency 107.391 ms 2024-05-10T05:06:40.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 7827 21.24 MB/sec warmup 28 sec latency 131.995 ms 2024-05-10T05:06:41.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 8106 20.80 MB/sec warmup 29 sec latency 106.926 ms 2024-05-10T05:06:42.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 8668 21.36 MB/sec warmup 30 sec latency 53.599 ms 2024-05-10T05:06:43.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 9336 21.19 MB/sec warmup 31 sec latency 83.553 ms 2024-05-10T05:06:44.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 9881 21.74 MB/sec warmup 32 sec latency 50.438 ms 2024-05-10T05:06:45.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 10444 22.51 MB/sec warmup 33 sec latency 49.139 ms 2024-05-10T05:06:46.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 10831 22.81 MB/sec warmup 34 sec latency 109.230 ms 2024-05-10T05:06:47.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 11012 22.34 MB/sec warmup 35 sec latency 64.371 ms 2024-05-10T05:06:48.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 11149 21.75 MB/sec warmup 36 sec latency 128.356 ms 2024-05-10T05:06:49.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 11310 21.22 MB/sec warmup 37 sec latency 187.141 ms 2024-05-10T05:06:50.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 11509 20.81 MB/sec warmup 38 sec latency 126.389 ms 2024-05-10T05:06:51.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 11932 20.93 MB/sec warmup 39 sec latency 65.887 ms 2024-05-10T05:06:52.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 12540 21.01 MB/sec warmup 40 sec latency 50.346 ms 2024-05-10T05:06:53.869 INFO:tasks.workunit.client.1.smithi117.stdout: 10 13086 20.95 MB/sec warmup 41 sec latency 55.924 ms 2024-05-10T05:06:54.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 13546 21.34 MB/sec warmup 42 sec latency 105.769 ms 2024-05-10T05:06:55.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 14072 21.90 MB/sec warmup 43 sec latency 74.407 ms 2024-05-10T05:06:56.868 INFO:tasks.workunit.client.1.smithi117.stdout: 10 14376 21.97 MB/sec warmup 44 sec latency 129.032 ms 2024-05-10T05:06:57.869 INFO:tasks.workunit.client.1.smithi117.stdout: 10 14519 21.61 MB/sec warmup 45 sec latency 164.438 ms 2024-05-10T05:06:58.869 INFO:tasks.workunit.client.1.smithi117.stdout: 10 14685 21.18 MB/sec warmup 46 sec latency 49.040 ms 2024-05-10T05:06:59.869 INFO:tasks.workunit.client.1.smithi117.stdout: 10 14811 20.76 MB/sec warmup 47 sec latency 268.628 ms 2024-05-10T05:07:00.871 INFO:tasks.workunit.client.1.smithi117.stdout: 10 15044 20.49 MB/sec warmup 48 sec latency 97.762 ms 2024-05-10T05:07:01.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 15101 20.11 MB/sec warmup 49 sec latency 765.840 ms 2024-05-10T05:07:02.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 15183 19.74 MB/sec warmup 50 sec latency 1062.437 ms 2024-05-10T05:07:03.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 15434 19.72 MB/sec warmup 51 sec latency 111.394 ms 2024-05-10T05:07:04.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 15854 19.59 MB/sec warmup 52 sec latency 94.793 ms 2024-05-10T05:07:05.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 16415 19.64 MB/sec warmup 53 sec latency 52.657 ms 2024-05-10T05:07:06.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 16897 19.87 MB/sec warmup 54 sec latency 253.405 ms 2024-05-10T05:07:07.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 17152 19.83 MB/sec warmup 55 sec latency 478.181 ms 2024-05-10T05:07:08.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 17486 20.09 MB/sec warmup 56 sec latency 138.447 ms 2024-05-10T05:07:09.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 17817 20.12 MB/sec warmup 57 sec latency 100.474 ms 2024-05-10T05:07:10.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 18057 20.07 MB/sec warmup 58 sec latency 116.041 ms 2024-05-10T05:07:11.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 18210 19.75 MB/sec warmup 59 sec latency 106.163 ms 2024-05-10T05:07:12.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 18359 19.46 MB/sec warmup 60 sec latency 229.899 ms 2024-05-10T05:07:13.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 18573 19.24 MB/sec warmup 61 sec latency 119.459 ms 2024-05-10T05:07:14.872 INFO:tasks.workunit.client.1.smithi117.stdout: 10 18904 19.26 MB/sec warmup 62 sec latency 97.037 ms 2024-05-10T05:07:15.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 19435 19.17 MB/sec warmup 63 sec latency 66.427 ms 2024-05-10T05:07:16.873 INFO:tasks.workunit.client.1.smithi117.stdout: 10 19978 19.26 MB/sec warmup 64 sec latency 61.040 ms 2024-05-10T05:07:17.873 INFO:tasks.workunit.client.1.smithi117.stdout: 10 20538 19.48 MB/sec warmup 65 sec latency 193.193 ms 2024-05-10T05:07:18.873 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21114 19.95 MB/sec warmup 66 sec latency 41.097 ms 2024-05-10T05:07:19.873 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21452 20.06 MB/sec warmup 67 sec latency 109.728 ms 2024-05-10T05:07:20.873 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21685 19.94 MB/sec warmup 68 sec latency 57.358 ms 2024-05-10T05:07:21.873 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21803 19.67 MB/sec warmup 69 sec latency 262.350 ms 2024-05-10T05:07:22.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21846 19.39 MB/sec warmup 70 sec latency 829.184 ms 2024-05-10T05:07:23.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21851 19.12 MB/sec warmup 71 sec latency 1094.925 ms 2024-05-10T05:07:24.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 21932 18.87 MB/sec warmup 72 sec latency 1152.572 ms 2024-05-10T05:07:25.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 22027 18.64 MB/sec warmup 73 sec latency 147.713 ms 2024-05-10T05:07:26.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 22271 18.50 MB/sec warmup 74 sec latency 113.166 ms 2024-05-10T05:07:27.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 22529 18.50 MB/sec warmup 75 sec latency 336.368 ms 2024-05-10T05:07:28.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 22909 18.42 MB/sec warmup 76 sec latency 423.796 ms 2024-05-10T05:07:29.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 23420 18.46 MB/sec warmup 77 sec latency 106.125 ms 2024-05-10T05:07:30.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 24024 18.70 MB/sec warmup 78 sec latency 47.950 ms 2024-05-10T05:07:31.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 24517 18.90 MB/sec warmup 79 sec latency 53.761 ms 2024-05-10T05:07:32.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 24889 19.08 MB/sec warmup 80 sec latency 115.081 ms 2024-05-10T05:07:33.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 25135 19.05 MB/sec warmup 81 sec latency 125.122 ms 2024-05-10T05:07:34.874 INFO:tasks.workunit.client.1.smithi117.stdout: 10 25281 18.87 MB/sec warmup 82 sec latency 113.641 ms 2024-05-10T05:07:35.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 25417 18.66 MB/sec warmup 83 sec latency 160.374 ms 2024-05-10T05:07:36.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 25635 18.50 MB/sec warmup 84 sec latency 102.969 ms 2024-05-10T05:07:37.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 25943 18.45 MB/sec warmup 85 sec latency 72.872 ms 2024-05-10T05:07:38.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 26405 18.45 MB/sec warmup 86 sec latency 118.101 ms 2024-05-10T05:07:39.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 27003 18.55 MB/sec warmup 87 sec latency 46.767 ms 2024-05-10T05:07:40.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 27621 18.76 MB/sec warmup 88 sec latency 70.154 ms 2024-05-10T05:07:41.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 28173 19.08 MB/sec warmup 89 sec latency 62.837 ms 2024-05-10T05:07:42.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 28496 19.15 MB/sec warmup 90 sec latency 97.409 ms 2024-05-10T05:07:43.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 28726 19.09 MB/sec warmup 91 sec latency 95.573 ms 2024-05-10T05:07:44.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 28864 18.90 MB/sec warmup 92 sec latency 150.688 ms 2024-05-10T05:07:45.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 29007 18.72 MB/sec warmup 93 sec latency 189.188 ms 2024-05-10T05:07:46.875 INFO:tasks.workunit.client.1.smithi117.stdout: 10 29223 18.58 MB/sec warmup 94 sec latency 91.071 ms 2024-05-10T05:07:47.876 INFO:tasks.workunit.client.1.smithi117.stdout: 10 29519 18.52 MB/sec warmup 95 sec latency 110.272 ms 2024-05-10T05:07:48.877 INFO:tasks.workunit.client.1.smithi117.stdout: 10 29580 18.40 MB/sec warmup 96 sec latency 731.338 ms 2024-05-10T05:07:49.877 INFO:tasks.workunit.client.1.smithi117.stdout: 10 29598 18.21 MB/sec warmup 97 sec latency 1045.690 ms 2024-05-10T05:07:50.877 INFO:tasks.workunit.client.1.smithi117.stdout: 10 29858 18.11 MB/sec warmup 98 sec latency 647.822 ms 2024-05-10T05:07:51.878 INFO:tasks.workunit.client.1.smithi117.stdout: 10 30089 18.01 MB/sec warmup 99 sec latency 123.886 ms 2024-05-10T05:07:52.878 INFO:tasks.workunit.client.1.smithi117.stdout: 10 30511 18.04 MB/sec warmup 100 sec latency 131.283 ms 2024-05-10T05:07:53.880 INFO:tasks.workunit.client.1.smithi117.stdout: 10 31026 18.14 MB/sec warmup 101 sec latency 162.300 ms 2024-05-10T05:07:54.881 INFO:tasks.workunit.client.1.smithi117.stdout: 10 31288 18.14 MB/sec warmup 102 sec latency 272.297 ms 2024-05-10T05:07:55.881 INFO:tasks.workunit.client.1.smithi117.stdout: 10 31764 18.40 MB/sec warmup 103 sec latency 122.389 ms 2024-05-10T05:07:56.881 INFO:tasks.workunit.client.1.smithi117.stdout: 10 32061 18.37 MB/sec warmup 104 sec latency 120.315 ms 2024-05-10T05:07:57.881 INFO:tasks.workunit.client.1.smithi117.stdout: 10 32335 18.38 MB/sec warmup 105 sec latency 45.468 ms 2024-05-10T05:07:58.881 INFO:tasks.workunit.client.1.smithi117.stdout: 10 32459 18.21 MB/sec warmup 106 sec latency 279.629 ms 2024-05-10T05:07:59.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 32627 18.07 MB/sec warmup 107 sec latency 193.927 ms 2024-05-10T05:08:00.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 32907 18.03 MB/sec warmup 108 sec latency 72.003 ms 2024-05-10T05:08:01.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 33257 17.99 MB/sec warmup 109 sec latency 93.284 ms 2024-05-10T05:08:02.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 33841 18.02 MB/sec warmup 110 sec latency 182.109 ms 2024-05-10T05:08:03.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 34404 18.21 MB/sec warmup 111 sec latency 45.179 ms 2024-05-10T05:08:04.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 35021 18.37 MB/sec warmup 112 sec latency 48.817 ms 2024-05-10T05:08:05.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 35349 18.47 MB/sec warmup 113 sec latency 112.369 ms 2024-05-10T05:08:06.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 35638 18.45 MB/sec warmup 114 sec latency 87.390 ms 2024-05-10T05:08:07.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 35860 18.42 MB/sec warmup 115 sec latency 168.053 ms 2024-05-10T05:08:08.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 35982 18.29 MB/sec warmup 116 sec latency 391.829 ms 2024-05-10T05:08:09.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 36049 18.14 MB/sec warmup 117 sec latency 713.393 ms 2024-05-10T05:08:10.882 INFO:tasks.workunit.client.1.smithi117.stdout: 10 36058 17.99 MB/sec warmup 118 sec latency 1121.712 ms 2024-05-10T05:08:11.885 INFO:tasks.workunit.client.1.smithi117.stdout: 10 36174 17.87 MB/sec warmup 119 sec latency 1499.317 ms 2024-05-10T05:08:13.886 INFO:tasks.workunit.client.1.smithi117.stdout: 10 36505 11.90 MB/sec execute 1 sec latency 442.248 ms 2024-05-10T05:08:14.886 INFO:tasks.workunit.client.1.smithi117.stdout: 10 36847 11.63 MB/sec execute 2 sec latency 171.424 ms 2024-05-10T05:08:15.886 INFO:tasks.workunit.client.1.smithi117.stdout: 10 37213 13.18 MB/sec execute 3 sec latency 324.122 ms 2024-05-10T05:08:16.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 37706 16.15 MB/sec execute 4 sec latency 123.067 ms 2024-05-10T05:08:17.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 38278 20.00 MB/sec execute 5 sec latency 65.184 ms 2024-05-10T05:08:18.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 38754 22.30 MB/sec execute 6 sec latency 47.926 ms 2024-05-10T05:08:19.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 39118 23.28 MB/sec execute 7 sec latency 94.650 ms 2024-05-10T05:08:20.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 39382 22.45 MB/sec execute 8 sec latency 107.869 ms 2024-05-10T05:08:21.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 39545 20.43 MB/sec execute 9 sec latency 149.306 ms 2024-05-10T05:08:22.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 39767 19.00 MB/sec execute 10 sec latency 138.879 ms 2024-05-10T05:08:23.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 40075 18.55 MB/sec execute 11 sec latency 60.988 ms 2024-05-10T05:08:24.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 40454 18.09 MB/sec execute 12 sec latency 134.779 ms 2024-05-10T05:08:25.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 40820 17.93 MB/sec execute 13 sec latency 102.990 ms 2024-05-10T05:08:26.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 41388 18.74 MB/sec execute 14 sec latency 56.325 ms 2024-05-10T05:08:27.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 41975 20.09 MB/sec execute 15 sec latency 51.485 ms 2024-05-10T05:08:28.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 42445 21.02 MB/sec execute 16 sec latency 110.847 ms 2024-05-10T05:08:29.887 INFO:tasks.workunit.client.1.smithi117.stdout: 10 42666 20.75 MB/sec execute 17 sec latency 414.144 ms 2024-05-10T05:08:30.889 INFO:tasks.workunit.client.1.smithi117.stdout: 10 42754 19.98 MB/sec execute 18 sec latency 520.779 ms 2024-05-10T05:08:31.889 INFO:tasks.workunit.client.1.smithi117.stdout: 10 42758 18.93 MB/sec execute 19 sec latency 1029.826 ms 2024-05-10T05:08:32.889 INFO:tasks.workunit.client.1.smithi117.stdout: 10 42880 18.28 MB/sec execute 20 sec latency 1056.587 ms 2024-05-10T05:08:33.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 42956 17.58 MB/sec execute 21 sec latency 141.297 ms 2024-05-10T05:08:34.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 43132 17.08 MB/sec execute 22 sec latency 98.068 ms 2024-05-10T05:08:35.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 43335 16.59 MB/sec execute 23 sec latency 151.767 ms 2024-05-10T05:08:36.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 43639 16.53 MB/sec execute 24 sec latency 110.954 ms 2024-05-10T05:08:37.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 44102 16.56 MB/sec execute 25 sec latency 84.284 ms 2024-05-10T05:08:38.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 44676 17.10 MB/sec execute 26 sec latency 73.633 ms 2024-05-10T05:08:39.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 45284 17.58 MB/sec execute 27 sec latency 47.583 ms 2024-05-10T05:08:40.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 45840 18.44 MB/sec execute 28 sec latency 42.044 ms 2024-05-10T05:08:41.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 46199 18.79 MB/sec execute 29 sec latency 101.150 ms 2024-05-10T05:08:42.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 46414 18.59 MB/sec execute 30 sec latency 296.387 ms 2024-05-10T05:08:43.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 46649 18.27 MB/sec execute 31 sec latency 61.622 ms 2024-05-10T05:08:44.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 46815 17.81 MB/sec execute 32 sec latency 193.352 ms 2024-05-10T05:08:45.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 47135 17.77 MB/sec execute 33 sec latency 83.747 ms 2024-05-10T05:08:46.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 47635 17.79 MB/sec execute 34 sec latency 92.684 ms 2024-05-10T05:08:47.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 48161 17.96 MB/sec execute 35 sec latency 83.434 ms 2024-05-10T05:08:48.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 48778 18.52 MB/sec execute 36 sec latency 48.846 ms 2024-05-10T05:08:49.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 49269 18.86 MB/sec execute 37 sec latency 104.713 ms 2024-05-10T05:08:50.890 INFO:tasks.workunit.client.1.smithi117.stdout: 10 49695 19.26 MB/sec execute 38 sec latency 55.051 ms 2024-05-10T05:08:51.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 49971 19.20 MB/sec execute 39 sec latency 107.508 ms 2024-05-10T05:08:52.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 50138 18.89 MB/sec execute 40 sec latency 199.020 ms 2024-05-10T05:08:53.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 50376 18.62 MB/sec execute 41 sec latency 70.811 ms 2024-05-10T05:08:54.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 50691 18.54 MB/sec execute 42 sec latency 86.826 ms 2024-05-10T05:08:55.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 51007 18.38 MB/sec execute 43 sec latency 307.557 ms 2024-05-10T05:08:56.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 51247 18.12 MB/sec execute 44 sec latency 623.157 ms 2024-05-10T05:08:57.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 51264 17.72 MB/sec execute 45 sec latency 966.760 ms 2024-05-10T05:08:58.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 51539 17.53 MB/sec execute 46 sec latency 868.085 ms 2024-05-10T05:08:59.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 51769 17.48 MB/sec execute 47 sec latency 125.344 ms 2024-05-10T05:09:00.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 51963 17.40 MB/sec execute 48 sec latency 427.405 ms 2024-05-10T05:09:01.891 INFO:tasks.workunit.client.1.smithi117.stdout: 10 52501 17.81 MB/sec execute 49 sec latency 81.198 ms 2024-05-10T05:09:02.892 INFO:tasks.workunit.client.1.smithi117.stdout: 10 52797 17.80 MB/sec execute 50 sec latency 275.560 ms 2024-05-10T05:09:03.892 INFO:tasks.workunit.client.1.smithi117.stdout: 10 53099 17.88 MB/sec execute 51 sec latency 142.017 ms 2024-05-10T05:09:04.892 INFO:tasks.workunit.client.1.smithi117.stdout: 10 53404 17.97 MB/sec execute 52 sec latency 108.461 ms 2024-05-10T05:09:04.973 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:09:04.978 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:09:05.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 53604 17.77 MB/sec execute 53 sec latency 169.217 ms 2024-05-10T05:09:06.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 53838 17.60 MB/sec execute 54 sec latency 169.107 ms 2024-05-10T05:09:07.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 54103 17.45 MB/sec execute 55 sec latency 152.821 ms 2024-05-10T05:09:08.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 54474 17.42 MB/sec execute 56 sec latency 172.977 ms 2024-05-10T05:09:09.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 54973 17.45 MB/sec execute 57 sec latency 98.873 ms 2024-05-10T05:09:10.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 55324 17.51 MB/sec execute 58 sec latency 381.220 ms 2024-05-10T05:09:11.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 55881 17.81 MB/sec execute 59 sec latency 94.810 ms 2024-05-10T05:09:12.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 56020 17.63 MB/sec execute 60 sec latency 370.424 ms 2024-05-10T05:09:13.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 56522 17.94 MB/sec execute 61 sec latency 207.397 ms 2024-05-10T05:09:14.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 56756 17.93 MB/sec execute 62 sec latency 96.952 ms 2024-05-10T05:09:15.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 57060 17.91 MB/sec execute 63 sec latency 122.912 ms 2024-05-10T05:09:16.893 INFO:tasks.workunit.client.1.smithi117.stdout: 10 57296 17.80 MB/sec execute 64 sec latency 132.500 ms 2024-05-10T05:09:17.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 57397 17.58 MB/sec execute 65 sec latency 474.026 ms 2024-05-10T05:09:18.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 57647 17.45 MB/sec execute 66 sec latency 403.973 ms 2024-05-10T05:09:19.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 57854 17.38 MB/sec execute 67 sec latency 122.097 ms 2024-05-10T05:09:20.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 58350 17.34 MB/sec execute 68 sec latency 113.624 ms 2024-05-10T05:09:21.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 58844 17.41 MB/sec execute 69 sec latency 63.352 ms 2024-05-10T05:09:22.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 59314 17.64 MB/sec execute 70 sec latency 123.227 ms 2024-05-10T05:09:23.894 INFO:tasks.workunit.client.1.smithi117.stdout: 10 59851 17.95 MB/sec execute 71 sec latency 113.194 ms 2024-05-10T05:09:24.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 60239 18.03 MB/sec execute 72 sec latency 104.403 ms 2024-05-10T05:09:25.896 INFO:tasks.workunit.client.1.smithi117.stdout: 10 60508 18.03 MB/sec execute 73 sec latency 144.286 ms 2024-05-10T05:09:26.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 60739 17.90 MB/sec execute 74 sec latency 127.659 ms 2024-05-10T05:09:27.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 60944 17.78 MB/sec execute 75 sec latency 244.057 ms 2024-05-10T05:09:28.896 INFO:tasks.workunit.client.1.smithi117.stdout: 10 61226 17.68 MB/sec execute 76 sec latency 94.728 ms 2024-05-10T05:09:29.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 61686 17.75 MB/sec execute 77 sec latency 80.894 ms 2024-05-10T05:09:30.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 62085 17.67 MB/sec execute 78 sec latency 360.062 ms 2024-05-10T05:09:31.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 62532 17.79 MB/sec execute 79 sec latency 378.742 ms 2024-05-10T05:09:32.896 INFO:tasks.workunit.client.1.smithi117.stdout: 10 62977 17.91 MB/sec execute 80 sec latency 347.773 ms 2024-05-10T05:09:33.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 62995 17.72 MB/sec execute 81 sec latency 957.546 ms 2024-05-10T05:09:34.895 INFO:tasks.workunit.client.1.smithi117.stdout: 10 63185 17.66 MB/sec execute 82 sec latency 1099.033 ms 2024-05-10T05:09:35.244 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:09:35.249 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:09:35.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 63510 17.73 MB/sec execute 83 sec latency 101.931 ms 2024-05-10T05:09:36.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 63692 17.65 MB/sec execute 84 sec latency 155.233 ms 2024-05-10T05:09:37.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 63977 17.66 MB/sec execute 85 sec latency 97.632 ms 2024-05-10T05:09:38.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 64176 17.56 MB/sec execute 86 sec latency 143.696 ms 2024-05-10T05:09:39.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 64398 17.49 MB/sec execute 87 sec latency 177.422 ms 2024-05-10T05:09:40.898 INFO:tasks.workunit.client.1.smithi117.stdout: 10 64603 17.39 MB/sec execute 88 sec latency 115.148 ms 2024-05-10T05:09:41.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 64964 17.39 MB/sec execute 89 sec latency 97.512 ms 2024-05-10T05:09:42.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 65504 17.37 MB/sec execute 90 sec latency 52.365 ms 2024-05-10T05:09:43.897 INFO:tasks.workunit.client.1.smithi117.stdout: 10 65883 17.41 MB/sec execute 91 sec latency 158.458 ms 2024-05-10T05:09:44.898 INFO:tasks.workunit.client.1.smithi117.stdout: 10 66441 17.61 MB/sec execute 92 sec latency 59.167 ms 2024-05-10T05:09:45.898 INFO:tasks.workunit.client.1.smithi117.stdout: 10 66644 17.58 MB/sec execute 93 sec latency 440.060 ms 2024-05-10T05:09:46.898 INFO:tasks.workunit.client.1.smithi117.stdout: 10 67133 17.75 MB/sec execute 94 sec latency 91.136 ms 2024-05-10T05:09:47.898 INFO:tasks.workunit.client.1.smithi117.stdout: 10 67391 17.71 MB/sec execute 95 sec latency 131.013 ms 2024-05-10T05:09:48.900 INFO:tasks.workunit.client.1.smithi117.stdout: 10 67576 17.66 MB/sec execute 96 sec latency 413.781 ms 2024-05-10T05:09:49.900 INFO:tasks.workunit.client.1.smithi117.stdout: 10 67641 17.51 MB/sec execute 97 sec latency 920.946 ms 2024-05-10T05:09:50.900 INFO:tasks.workunit.client.1.smithi117.stdout: 10 67800 17.37 MB/sec execute 98 sec latency 393.208 ms 2024-05-10T05:09:51.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 67901 17.23 MB/sec execute 99 sec latency 622.106 ms 2024-05-10T05:09:52.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 68194 17.25 MB/sec execute 100 sec latency 180.973 ms 2024-05-10T05:09:53.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 68491 17.23 MB/sec execute 101 sec latency 164.450 ms 2024-05-10T05:09:54.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 68780 17.13 MB/sec execute 102 sec latency 144.235 ms 2024-05-10T05:09:55.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 69240 17.12 MB/sec execute 103 sec latency 89.867 ms 2024-05-10T05:09:56.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 69683 17.28 MB/sec execute 104 sec latency 77.259 ms 2024-05-10T05:09:57.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 70279 17.47 MB/sec execute 105 sec latency 55.336 ms 2024-05-10T05:09:58.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 70658 17.55 MB/sec execute 106 sec latency 86.729 ms 2024-05-10T05:09:59.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 71037 17.55 MB/sec execute 107 sec latency 46.943 ms 2024-05-10T05:10:00.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 71216 17.48 MB/sec execute 108 sec latency 288.575 ms 2024-05-10T05:10:01.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 71303 17.35 MB/sec execute 109 sec latency 521.079 ms 2024-05-10T05:10:02.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 71631 17.35 MB/sec execute 110 sec latency 98.703 ms 2024-05-10T05:10:03.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 72078 17.41 MB/sec execute 111 sec latency 50.330 ms 2024-05-10T05:10:04.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 72556 17.37 MB/sec execute 112 sec latency 122.889 ms 2024-05-10T05:10:05.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:10:05.377 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:10:05.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 73001 17.49 MB/sec execute 113 sec latency 50.580 ms 2024-05-10T05:10:05.988 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-05-10T05:10:05.987+0000 7f7229400700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50495) UID: 0 2024-05-10T05:10:05.989 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-05-10T05:10:05.987+0000 7fa259800700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50495) UID: 0 2024-05-10T05:10:06.902 INFO:tasks.workunit.client.1.smithi117.stdout: 10 73238 17.45 MB/sec execute 114 sec latency 291.010 ms 2024-05-10T05:10:07.901 INFO:tasks.workunit.client.1.smithi117.stdout: 10 73715 17.57 MB/sec execute 115 sec latency 97.374 ms 2024-05-10T05:10:08.904 INFO:tasks.workunit.client.1.smithi117.stdout: 10 74078 17.63 MB/sec execute 116 sec latency 137.850 ms 2024-05-10T05:10:09.904 INFO:tasks.workunit.client.1.smithi117.stdout: 10 74104 17.48 MB/sec execute 117 sec latency 677.256 ms 2024-05-10T05:10:10.904 INFO:tasks.workunit.client.1.smithi117.stdout: 10 74401 17.44 MB/sec execute 118 sec latency 149.273 ms 2024-05-10T05:10:11.904 INFO:tasks.workunit.client.1.smithi117.stdout: 10 74610 17.37 MB/sec execute 119 sec latency 141.128 ms 2024-05-10T05:10:12.907 INFO:tasks.workunit.client.1.smithi117.stdout: 10 74830 17.34 MB/sec execute 120 sec latency 136.796 ms 2024-05-10T05:10:13.907 INFO:tasks.workunit.client.1.smithi117.stdout: 10 75008 17.24 MB/sec execute 121 sec latency 173.024 ms 2024-05-10T05:10:14.907 INFO:tasks.workunit.client.1.smithi117.stdout: 10 75059 17.11 MB/sec execute 122 sec latency 836.893 ms 2024-05-10T05:10:15.907 INFO:tasks.workunit.client.1.smithi117.stdout: 10 75218 17.06 MB/sec execute 123 sec latency 951.211 ms 2024-05-10T05:10:16.908 INFO:tasks.workunit.client.1.smithi117.stdout: 10 75352 17.00 MB/sec execute 124 sec latency 263.548 ms 2024-05-10T05:10:17.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 75649 17.01 MB/sec execute 125 sec latency 128.662 ms 2024-05-10T05:10:18.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 76098 16.93 MB/sec execute 126 sec latency 103.298 ms 2024-05-10T05:10:19.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 76502 16.97 MB/sec execute 127 sec latency 46.887 ms 2024-05-10T05:10:20.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 76864 17.07 MB/sec execute 128 sec latency 141.693 ms 2024-05-10T05:10:21.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 77400 17.21 MB/sec execute 129 sec latency 86.479 ms 2024-05-10T05:10:22.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 77726 17.23 MB/sec execute 130 sec latency 104.812 ms 2024-05-10T05:10:23.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 78117 17.23 MB/sec execute 131 sec latency 46.364 ms 2024-05-10T05:10:24.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 78354 17.20 MB/sec execute 132 sec latency 178.403 ms 2024-05-10T05:10:25.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 78507 17.11 MB/sec execute 133 sec latency 322.299 ms 2024-05-10T05:10:26.909 INFO:tasks.workunit.client.1.smithi117.stdout: 10 78669 17.03 MB/sec execute 134 sec latency 472.074 ms 2024-05-10T05:10:27.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 79057 17.12 MB/sec execute 135 sec latency 73.191 ms 2024-05-10T05:10:28.911 INFO:tasks.workunit.client.1.smithi117.stdout: 10 79383 17.05 MB/sec execute 136 sec latency 159.405 ms 2024-05-10T05:10:29.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 79690 16.99 MB/sec execute 137 sec latency 430.999 ms 2024-05-10T05:10:30.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 79725 16.88 MB/sec execute 138 sec latency 723.519 ms 2024-05-10T05:10:31.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 79855 16.80 MB/sec execute 139 sec latency 339.781 ms 2024-05-10T05:10:32.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 79992 16.72 MB/sec execute 140 sec latency 331.650 ms 2024-05-10T05:10:33.914 INFO:tasks.workunit.client.1.smithi117.stdout: 10 80493 16.87 MB/sec execute 141 sec latency 91.334 ms 2024-05-10T05:10:34.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 80893 16.95 MB/sec execute 142 sec latency 101.871 ms 2024-05-10T05:10:35.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 81179 16.98 MB/sec execute 143 sec latency 223.991 ms 2024-05-10T05:10:36.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 81364 16.90 MB/sec execute 144 sec latency 171.372 ms 2024-05-10T05:10:37.914 INFO:tasks.workunit.client.1.smithi117.stdout: 10 81703 16.90 MB/sec execute 145 sec latency 52.682 ms 2024-05-10T05:10:38.912 INFO:tasks.workunit.client.1.smithi117.stdout: 10 81914 16.86 MB/sec execute 146 sec latency 170.069 ms 2024-05-10T05:10:39.915 INFO:tasks.workunit.client.1.smithi117.stdout: 10 82128 16.80 MB/sec execute 147 sec latency 106.550 ms 2024-05-10T05:10:40.915 INFO:tasks.workunit.client.1.smithi117.stdout: 10 82529 16.86 MB/sec execute 148 sec latency 65.716 ms 2024-05-10T05:10:41.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 82931 16.85 MB/sec execute 149 sec latency 88.679 ms 2024-05-10T05:10:42.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 83417 16.84 MB/sec execute 150 sec latency 49.800 ms 2024-05-10T05:10:43.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 83847 16.95 MB/sec execute 151 sec latency 126.810 ms 2024-05-10T05:10:44.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 84251 16.99 MB/sec execute 152 sec latency 93.537 ms 2024-05-10T05:10:45.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 84732 17.13 MB/sec execute 153 sec latency 50.862 ms 2024-05-10T05:10:46.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 85028 17.08 MB/sec execute 154 sec latency 124.040 ms 2024-05-10T05:10:47.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 85266 17.03 MB/sec execute 155 sec latency 166.002 ms 2024-05-10T05:10:48.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 85555 17.03 MB/sec execute 156 sec latency 66.515 ms 2024-05-10T05:10:49.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 85793 16.98 MB/sec execute 157 sec latency 152.779 ms 2024-05-10T05:10:50.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 86182 17.03 MB/sec execute 158 sec latency 66.157 ms 2024-05-10T05:10:51.916 INFO:tasks.workunit.client.1.smithi117.stdout: 10 86533 17.01 MB/sec execute 159 sec latency 142.548 ms 2024-05-10T05:10:52.917 INFO:tasks.workunit.client.1.smithi117.stdout: 10 86995 17.02 MB/sec execute 160 sec latency 62.210 ms 2024-05-10T05:10:53.917 INFO:tasks.workunit.client.1.smithi117.stdout: 10 87361 17.07 MB/sec execute 161 sec latency 137.853 ms 2024-05-10T05:10:54.917 INFO:tasks.workunit.client.1.smithi117.stdout: 10 87782 17.12 MB/sec execute 162 sec latency 101.170 ms 2024-05-10T05:10:55.917 INFO:tasks.workunit.client.1.smithi117.stdout: 10 88102 17.17 MB/sec execute 163 sec latency 161.576 ms 2024-05-10T05:10:56.917 INFO:tasks.workunit.client.1.smithi117.stdout: 10 88370 17.15 MB/sec execute 164 sec latency 192.091 ms 2024-05-10T05:10:57.917 INFO:tasks.workunit.client.1.smithi117.stdout: 10 88667 17.11 MB/sec execute 165 sec latency 265.965 ms 2024-05-10T05:10:58.920 INFO:tasks.workunit.client.1.smithi117.stdout: 10 88846 17.06 MB/sec execute 166 sec latency 142.809 ms 2024-05-10T05:10:59.920 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89101 17.05 MB/sec execute 167 sec latency 133.033 ms 2024-05-10T05:11:00.920 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89296 16.99 MB/sec execute 168 sec latency 403.158 ms 2024-05-10T05:11:01.920 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89314 16.90 MB/sec execute 169 sec latency 975.034 ms 2024-05-10T05:11:02.922 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89318 16.80 MB/sec execute 170 sec latency 1962.386 ms 2024-05-10T05:11:03.922 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89356 16.72 MB/sec execute 171 sec latency 2275.589 ms 2024-05-10T05:11:04.925 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89550 16.70 MB/sec execute 172 sec latency 146.767 ms 2024-05-10T05:11:05.925 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89705 16.66 MB/sec execute 173 sec latency 178.032 ms 2024-05-10T05:11:06.925 INFO:tasks.workunit.client.1.smithi117.stdout: 10 89930 16.62 MB/sec execute 174 sec latency 165.736 ms 2024-05-10T05:11:07.925 INFO:tasks.workunit.client.1.smithi117.stdout: 10 90271 16.58 MB/sec execute 175 sec latency 102.466 ms 2024-05-10T05:11:08.925 INFO:tasks.workunit.client.1.smithi117.stdout: 10 90658 16.59 MB/sec execute 176 sec latency 101.122 ms 2024-05-10T05:11:09.925 INFO:tasks.workunit.client.1.smithi117.stdout: 10 90945 16.58 MB/sec execute 177 sec latency 210.600 ms 2024-05-10T05:11:10.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 91318 16.65 MB/sec execute 178 sec latency 100.084 ms 2024-05-10T05:11:11.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 91722 16.74 MB/sec execute 179 sec latency 137.775 ms 2024-05-10T05:11:12.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 91955 16.69 MB/sec execute 180 sec latency 389.397 ms 2024-05-10T05:11:13.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 92241 16.67 MB/sec execute 181 sec latency 113.415 ms 2024-05-10T05:11:14.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 92530 16.67 MB/sec execute 182 sec latency 52.253 ms 2024-05-10T05:11:15.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 92755 16.64 MB/sec execute 183 sec latency 210.252 ms 2024-05-10T05:11:16.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 92953 16.63 MB/sec execute 184 sec latency 435.132 ms 2024-05-10T05:11:17.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 92962 16.54 MB/sec execute 185 sec latency 1363.459 ms 2024-05-10T05:11:18.926 INFO:tasks.workunit.client.1.smithi117.stdout: 10 93158 16.48 MB/sec execute 186 sec latency 1423.022 ms 2024-05-10T05:11:19.927 INFO:tasks.workunit.client.1.smithi117.stdout: 10 93351 16.44 MB/sec execute 187 sec latency 171.485 ms 2024-05-10T05:11:20.927 INFO:tasks.workunit.client.1.smithi117.stdout: 10 93749 16.44 MB/sec execute 188 sec latency 58.893 ms 2024-05-10T05:11:21.927 INFO:tasks.workunit.client.1.smithi117.stdout: 10 94142 16.46 MB/sec execute 189 sec latency 153.623 ms 2024-05-10T05:11:22.929 INFO:tasks.workunit.client.1.smithi117.stdout: 10 94406 16.43 MB/sec execute 190 sec latency 209.607 ms 2024-05-10T05:11:23.929 INFO:tasks.workunit.client.1.smithi117.stdout: 10 94876 16.53 MB/sec execute 191 sec latency 94.472 ms 2024-05-10T05:11:24.929 INFO:tasks.workunit.client.1.smithi117.stdout: 10 95406 16.62 MB/sec execute 192 sec latency 46.567 ms 2024-05-10T05:11:25.933 INFO:tasks.workunit.client.1.smithi117.stdout: 10 95725 16.61 MB/sec execute 193 sec latency 105.592 ms 2024-05-10T05:11:26.930 INFO:tasks.workunit.client.1.smithi117.stdout: 10 95884 16.56 MB/sec execute 194 sec latency 186.313 ms 2024-05-10T05:11:27.930 INFO:tasks.workunit.client.1.smithi117.stdout: 10 96107 16.54 MB/sec execute 195 sec latency 131.341 ms 2024-05-10T05:11:28.932 INFO:tasks.workunit.client.1.smithi117.stdout: 10 96339 16.51 MB/sec execute 196 sec latency 203.050 ms 2024-05-10T05:11:29.932 INFO:tasks.workunit.client.1.smithi117.stdout: 10 96623 16.52 MB/sec execute 197 sec latency 173.216 ms 2024-05-10T05:11:30.932 INFO:tasks.workunit.client.1.smithi117.stdout: 10 97012 16.53 MB/sec execute 198 sec latency 108.261 ms 2024-05-10T05:11:31.933 INFO:tasks.workunit.client.1.smithi117.stdout: 10 97428 16.52 MB/sec execute 199 sec latency 112.763 ms 2024-05-10T05:11:32.933 INFO:tasks.workunit.client.1.smithi117.stdout: 10 97549 16.46 MB/sec execute 200 sec latency 588.450 ms 2024-05-10T05:11:33.933 INFO:tasks.workunit.client.1.smithi117.stdout: 10 97713 16.43 MB/sec execute 201 sec latency 171.795 ms 2024-05-10T05:11:34.933 INFO:tasks.workunit.client.1.smithi117.stdout: 10 98050 16.46 MB/sec execute 202 sec latency 163.441 ms 2024-05-10T05:11:35.933 INFO:tasks.workunit.client.1.smithi117.stdout: 10 98547 16.53 MB/sec execute 203 sec latency 81.112 ms 2024-05-10T05:11:36.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 99006 16.60 MB/sec execute 204 sec latency 59.060 ms 2024-05-10T05:11:37.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 99100 16.53 MB/sec execute 205 sec latency 501.040 ms 2024-05-10T05:11:38.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 99264 16.47 MB/sec execute 206 sec latency 126.049 ms 2024-05-10T05:11:39.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 99488 16.46 MB/sec execute 207 sec latency 148.316 ms 2024-05-10T05:11:40.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 99763 16.45 MB/sec execute 208 sec latency 128.828 ms 2024-05-10T05:11:41.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 100058 16.47 MB/sec execute 209 sec latency 160.096 ms 2024-05-10T05:11:42.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 100489 16.48 MB/sec execute 210 sec latency 51.836 ms 2024-05-10T05:11:43.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 100807 16.46 MB/sec execute 211 sec latency 144.746 ms 2024-05-10T05:11:44.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 101300 16.48 MB/sec execute 212 sec latency 47.941 ms 2024-05-10T05:11:45.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 101625 16.52 MB/sec execute 213 sec latency 174.757 ms 2024-05-10T05:11:46.936 INFO:tasks.workunit.client.1.smithi117.stdout: 10 102068 16.57 MB/sec execute 214 sec latency 63.237 ms 2024-05-10T05:11:47.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 102487 16.63 MB/sec execute 215 sec latency 56.592 ms 2024-05-10T05:11:48.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 102785 16.59 MB/sec execute 216 sec latency 149.158 ms 2024-05-10T05:11:49.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 103027 16.57 MB/sec execute 217 sec latency 64.189 ms 2024-05-10T05:11:50.934 INFO:tasks.workunit.client.1.smithi117.stdout: 10 103268 16.57 MB/sec execute 218 sec latency 132.897 ms 2024-05-10T05:11:51.935 INFO:tasks.workunit.client.1.smithi117.stdout: 10 103536 16.56 MB/sec execute 219 sec latency 175.499 ms 2024-05-10T05:11:52.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 103694 16.53 MB/sec execute 220 sec latency 593.103 ms 2024-05-10T05:11:53.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 103705 16.46 MB/sec execute 221 sec latency 1451.824 ms 2024-05-10T05:11:54.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 103771 16.39 MB/sec execute 222 sec latency 2019.528 ms 2024-05-10T05:11:55.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 104039 16.37 MB/sec execute 223 sec latency 125.106 ms 2024-05-10T05:11:56.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 104161 16.34 MB/sec execute 224 sec latency 198.517 ms 2024-05-10T05:11:57.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 104353 16.28 MB/sec execute 225 sec latency 147.566 ms 2024-05-10T05:11:58.938 INFO:tasks.workunit.client.1.smithi117.stdout: 10 104803 16.30 MB/sec execute 226 sec latency 50.846 ms 2024-05-10T05:11:59.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 105133 16.33 MB/sec execute 227 sec latency 134.022 ms 2024-05-10T05:12:00.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 105595 16.39 MB/sec execute 228 sec latency 141.315 ms 2024-05-10T05:12:01.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 105984 16.44 MB/sec execute 229 sec latency 133.835 ms 2024-05-10T05:12:02.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 106343 16.42 MB/sec execute 230 sec latency 131.885 ms 2024-05-10T05:12:03.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 106474 16.38 MB/sec execute 231 sec latency 454.657 ms 2024-05-10T05:12:04.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 106720 16.36 MB/sec execute 232 sec latency 118.559 ms 2024-05-10T05:12:05.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 107038 16.37 MB/sec execute 233 sec latency 99.200 ms 2024-05-10T05:12:06.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 107427 16.39 MB/sec execute 234 sec latency 104.306 ms 2024-05-10T05:12:07.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 107783 16.39 MB/sec execute 235 sec latency 136.885 ms 2024-05-10T05:12:08.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 107947 16.35 MB/sec execute 236 sec latency 565.529 ms 2024-05-10T05:12:09.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 108226 16.33 MB/sec execute 237 sec latency 246.524 ms 2024-05-10T05:12:10.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 108491 16.33 MB/sec execute 238 sec latency 130.529 ms 2024-05-10T05:12:11.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 108905 16.38 MB/sec execute 239 sec latency 70.585 ms 2024-05-10T05:12:12.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 109239 16.39 MB/sec execute 240 sec latency 128.972 ms 2024-05-10T05:12:13.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 109434 16.37 MB/sec execute 241 sec latency 382.378 ms 2024-05-10T05:12:14.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 109649 16.36 MB/sec execute 242 sec latency 306.030 ms 2024-05-10T05:12:15.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 109769 16.31 MB/sec execute 243 sec latency 198.033 ms 2024-05-10T05:12:16.940 INFO:tasks.workunit.client.1.smithi117.stdout: 10 110089 16.30 MB/sec execute 244 sec latency 131.862 ms 2024-05-10T05:12:17.939 INFO:tasks.workunit.client.1.smithi117.stdout: 10 110298 16.28 MB/sec execute 245 sec latency 124.575 ms 2024-05-10T05:12:18.940 INFO:tasks.workunit.client.1.smithi117.stdout: 10 110566 16.28 MB/sec execute 246 sec latency 161.242 ms 2024-05-10T05:12:19.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 110935 16.26 MB/sec execute 247 sec latency 107.553 ms 2024-05-10T05:12:20.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 111300 16.30 MB/sec execute 248 sec latency 111.659 ms 2024-05-10T05:12:21.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 111859 16.33 MB/sec execute 249 sec latency 47.250 ms 2024-05-10T05:12:22.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 112190 16.36 MB/sec execute 250 sec latency 123.511 ms 2024-05-10T05:12:23.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 112566 16.38 MB/sec execute 251 sec latency 140.519 ms 2024-05-10T05:12:24.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 112952 16.42 MB/sec execute 252 sec latency 96.017 ms 2024-05-10T05:12:25.942 INFO:tasks.workunit.client.1.smithi117.stdout: 10 113283 16.42 MB/sec execute 253 sec latency 50.721 ms 2024-05-10T05:12:26.946 INFO:tasks.workunit.client.1.smithi117.stdout: 10 113562 16.40 MB/sec execute 254 sec latency 139.277 ms 2024-05-10T05:12:27.943 INFO:tasks.workunit.client.1.smithi117.stdout: 10 113782 16.37 MB/sec execute 255 sec latency 118.274 ms 2024-05-10T05:12:28.943 INFO:tasks.workunit.client.1.smithi117.stdout: 10 114059 16.38 MB/sec execute 256 sec latency 325.762 ms 2024-05-10T05:12:29.943 INFO:tasks.workunit.client.1.smithi117.stdout: 10 114429 16.38 MB/sec execute 257 sec latency 81.369 ms 2024-05-10T05:12:30.943 INFO:tasks.workunit.client.1.smithi117.stdout: 10 114813 16.40 MB/sec execute 258 sec latency 226.930 ms 2024-05-10T05:12:31.943 INFO:tasks.workunit.client.1.smithi117.stdout: 10 115318 16.42 MB/sec execute 259 sec latency 96.782 ms 2024-05-10T05:12:32.943 INFO:tasks.workunit.client.1.smithi117.stdout: 10 115658 16.46 MB/sec execute 260 sec latency 101.800 ms 2024-05-10T05:12:33.952 INFO:tasks.workunit.client.1.smithi117.stdout: 10 115991 16.46 MB/sec execute 261 sec latency 212.339 ms 2024-05-10T05:12:34.951 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116018 16.40 MB/sec execute 262 sec latency 1123.731 ms 2024-05-10T05:12:35.951 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116028 16.34 MB/sec execute 263 sec latency 1319.444 ms 2024-05-10T05:12:36.953 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116055 16.28 MB/sec execute 264 sec latency 1795.662 ms 2024-05-10T05:12:37.953 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116186 16.25 MB/sec execute 265 sec latency 255.083 ms 2024-05-10T05:12:38.953 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116293 16.24 MB/sec execute 266 sec latency 425.426 ms 2024-05-10T05:12:39.954 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116457 16.21 MB/sec execute 267 sec latency 422.713 ms 2024-05-10T05:12:40.955 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116691 16.19 MB/sec execute 268 sec latency 237.560 ms 2024-05-10T05:12:41.956 INFO:tasks.workunit.client.1.smithi117.stdout: 10 116877 16.15 MB/sec execute 269 sec latency 190.799 ms 2024-05-10T05:12:42.956 INFO:tasks.workunit.client.1.smithi117.stdout: 10 117228 16.15 MB/sec execute 270 sec latency 189.896 ms 2024-05-10T05:12:43.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 117439 16.12 MB/sec execute 271 sec latency 179.100 ms 2024-05-10T05:12:44.957 INFO:tasks.workunit.client.1.smithi117.stdout: 10 117652 16.11 MB/sec execute 272 sec latency 171.941 ms 2024-05-10T05:12:45.957 INFO:tasks.workunit.client.1.smithi117.stdout: 10 118086 16.13 MB/sec execute 273 sec latency 74.537 ms 2024-05-10T05:12:46.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 118404 16.16 MB/sec execute 274 sec latency 180.004 ms 2024-05-10T05:12:47.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 118916 16.17 MB/sec execute 275 sec latency 150.152 ms 2024-05-10T05:12:48.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 119270 16.21 MB/sec execute 276 sec latency 112.801 ms 2024-05-10T05:12:49.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 119636 16.22 MB/sec execute 277 sec latency 144.464 ms 2024-05-10T05:12:50.959 INFO:tasks.workunit.client.1.smithi117.stdout: 10 119947 16.24 MB/sec execute 278 sec latency 130.644 ms 2024-05-10T05:12:51.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 120219 16.22 MB/sec execute 279 sec latency 158.589 ms 2024-05-10T05:12:52.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 120537 16.22 MB/sec execute 280 sec latency 87.107 ms 2024-05-10T05:12:53.959 INFO:tasks.workunit.client.1.smithi117.stdout: 10 120869 16.21 MB/sec execute 281 sec latency 149.203 ms 2024-05-10T05:12:54.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 121224 16.23 MB/sec execute 282 sec latency 135.346 ms 2024-05-10T05:12:55.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 121655 16.24 MB/sec execute 283 sec latency 161.114 ms 2024-05-10T05:12:56.958 INFO:tasks.workunit.client.1.smithi117.stdout: 10 122170 16.30 MB/sec execute 284 sec latency 144.449 ms 2024-05-10T05:12:57.960 INFO:tasks.workunit.client.1.smithi117.stdout: 10 122573 16.30 MB/sec execute 285 sec latency 113.600 ms 2024-05-10T05:12:58.959 INFO:tasks.workunit.client.1.smithi117.stdout: 10 122972 16.35 MB/sec execute 286 sec latency 124.699 ms 2024-05-10T05:12:59.959 INFO:tasks.workunit.client.1.smithi117.stdout: 10 123268 16.34 MB/sec execute 287 sec latency 123.074 ms 2024-05-10T05:13:00.959 INFO:tasks.workunit.client.1.smithi117.stdout: 10 123627 16.37 MB/sec execute 288 sec latency 98.631 ms 2024-05-10T05:13:01.959 INFO:tasks.workunit.client.1.smithi117.stdout: 10 123942 16.37 MB/sec execute 289 sec latency 113.052 ms 2024-05-10T05:13:02.960 INFO:tasks.workunit.client.1.smithi117.stdout: 10 124225 16.34 MB/sec execute 290 sec latency 117.549 ms 2024-05-10T05:13:03.960 INFO:tasks.workunit.client.1.smithi117.stdout: 10 124506 16.32 MB/sec execute 291 sec latency 131.981 ms 2024-05-10T05:13:04.960 INFO:tasks.workunit.client.1.smithi117.stdout: 10 124932 16.35 MB/sec execute 292 sec latency 118.638 ms 2024-05-10T05:13:05.961 INFO:tasks.workunit.client.1.smithi117.stdout: 10 125019 16.32 MB/sec execute 293 sec latency 745.438 ms 2024-05-10T05:13:06.962 INFO:tasks.workunit.client.1.smithi117.stdout: 10 125047 16.26 MB/sec execute 294 sec latency 1671.454 ms 2024-05-10T05:13:07.961 INFO:tasks.workunit.client.1.smithi117.stdout: 10 125303 16.24 MB/sec execute 295 sec latency 609.835 ms 2024-05-10T05:13:08.962 INFO:tasks.workunit.client.1.smithi117.stdout: 10 125552 16.24 MB/sec execute 296 sec latency 96.996 ms 2024-05-10T05:13:09.961 INFO:tasks.workunit.client.1.smithi117.stdout: 10 125840 16.23 MB/sec execute 297 sec latency 108.248 ms 2024-05-10T05:13:10.963 INFO:tasks.workunit.client.1.smithi117.stdout: 10 126194 16.24 MB/sec execute 298 sec latency 305.970 ms 2024-05-10T05:13:11.963 INFO:tasks.workunit.client.1.smithi117.stdout: 10 126420 16.23 MB/sec execute 299 sec latency 420.890 ms 2024-05-10T05:13:12.963 INFO:tasks.workunit.client.1.smithi117.stdout: 10 126660 16.24 MB/sec execute 300 sec latency 153.855 ms 2024-05-10T05:13:13.964 INFO:tasks.workunit.client.1.smithi117.stdout: 10 127084 16.29 MB/sec execute 301 sec latency 56.516 ms 2024-05-10T05:13:14.964 INFO:tasks.workunit.client.1.smithi117.stdout: 10 127362 16.27 MB/sec execute 302 sec latency 145.567 ms 2024-05-10T05:13:15.965 INFO:tasks.workunit.client.1.smithi117.stdout: 10 127696 16.27 MB/sec execute 303 sec latency 88.311 ms 2024-05-10T05:13:16.970 INFO:tasks.workunit.client.1.smithi117.stdout: 10 127997 16.25 MB/sec execute 304 sec latency 87.736 ms 2024-05-10T05:13:17.968 INFO:tasks.workunit.client.1.smithi117.stdout: 10 128335 16.27 MB/sec execute 305 sec latency 130.603 ms 2024-05-10T05:13:18.969 INFO:tasks.workunit.client.1.smithi117.stdout: 10 128786 16.28 MB/sec execute 306 sec latency 87.879 ms 2024-05-10T05:13:19.970 INFO:tasks.workunit.client.1.smithi117.stdout: 10 129234 16.32 MB/sec execute 307 sec latency 76.637 ms 2024-05-10T05:13:20.970 INFO:tasks.workunit.client.1.smithi117.stdout: 10 129705 16.33 MB/sec execute 308 sec latency 190.838 ms 2024-05-10T05:13:21.970 INFO:tasks.workunit.client.1.smithi117.stdout: 10 130027 16.33 MB/sec execute 309 sec latency 193.271 ms 2024-05-10T05:13:22.971 INFO:tasks.workunit.client.1.smithi117.stdout: 10 130396 16.37 MB/sec execute 310 sec latency 95.195 ms 2024-05-10T05:13:23.971 INFO:tasks.workunit.client.1.smithi117.stdout: 10 130818 16.40 MB/sec execute 311 sec latency 75.069 ms 2024-05-10T05:13:24.971 INFO:tasks.workunit.client.1.smithi117.stdout: 10 131117 16.39 MB/sec execute 312 sec latency 106.980 ms 2024-05-10T05:13:25.971 INFO:tasks.workunit.client.1.smithi117.stdout: 10 131395 16.37 MB/sec execute 313 sec latency 109.508 ms 2024-05-10T05:13:26.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 131446 16.32 MB/sec execute 314 sec latency 725.243 ms 2024-05-10T05:13:27.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 131453 16.27 MB/sec execute 315 sec latency 941.889 ms 2024-05-10T05:13:28.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 131634 16.25 MB/sec execute 316 sec latency 974.286 ms 2024-05-10T05:13:29.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 131797 16.24 MB/sec execute 317 sec latency 169.884 ms 2024-05-10T05:13:30.814 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:13:30.818 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:13:30.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 132026 16.22 MB/sec execute 318 sec latency 139.816 ms 2024-05-10T05:13:31.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 132278 16.21 MB/sec execute 319 sec latency 399.156 ms 2024-05-10T05:13:32.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 132584 16.22 MB/sec execute 320 sec latency 121.257 ms 2024-05-10T05:13:33.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 133086 16.23 MB/sec execute 321 sec latency 44.370 ms 2024-05-10T05:13:34.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 133430 16.26 MB/sec execute 322 sec latency 117.250 ms 2024-05-10T05:13:35.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 133767 16.27 MB/sec execute 323 sec latency 127.525 ms 2024-05-10T05:13:36.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 134113 16.30 MB/sec execute 324 sec latency 123.367 ms 2024-05-10T05:13:37.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 134427 16.29 MB/sec execute 325 sec latency 187.880 ms 2024-05-10T05:13:38.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 134692 16.28 MB/sec execute 326 sec latency 153.791 ms 2024-05-10T05:13:39.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 134980 16.26 MB/sec execute 327 sec latency 109.725 ms 2024-05-10T05:13:40.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 135314 16.28 MB/sec execute 328 sec latency 101.025 ms 2024-05-10T05:13:41.972 INFO:tasks.workunit.client.1.smithi117.stdout: 10 135693 16.27 MB/sec execute 329 sec latency 113.316 ms 2024-05-10T05:13:42.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 136178 16.32 MB/sec execute 330 sec latency 51.488 ms 2024-05-10T05:13:43.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 136722 16.33 MB/sec execute 331 sec latency 71.323 ms 2024-05-10T05:13:44.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 137120 16.37 MB/sec execute 332 sec latency 90.612 ms 2024-05-10T05:13:45.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 137488 16.39 MB/sec execute 333 sec latency 160.890 ms 2024-05-10T05:13:46.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 137890 16.41 MB/sec execute 334 sec latency 48.511 ms 2024-05-10T05:13:47.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 138143 16.40 MB/sec execute 335 sec latency 132.046 ms 2024-05-10T05:13:48.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 138475 16.39 MB/sec execute 336 sec latency 131.081 ms 2024-05-10T05:13:49.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 138715 16.37 MB/sec execute 337 sec latency 119.388 ms 2024-05-10T05:13:50.973 INFO:tasks.workunit.client.1.smithi117.stdout: 10 139117 16.39 MB/sec execute 338 sec latency 67.820 ms 2024-05-10T05:13:51.974 INFO:tasks.workunit.client.1.smithi117.stdout: 10 139427 16.39 MB/sec execute 339 sec latency 365.458 ms 2024-05-10T05:13:52.974 INFO:tasks.workunit.client.1.smithi117.stdout: 10 139438 16.34 MB/sec execute 340 sec latency 1122.826 ms 2024-05-10T05:13:53.975 INFO:tasks.workunit.client.1.smithi117.stdout: 10 139517 16.31 MB/sec execute 341 sec latency 1502.332 ms 2024-05-10T05:13:54.975 INFO:tasks.workunit.client.1.smithi117.stdout: 10 139691 16.30 MB/sec execute 342 sec latency 131.874 ms 2024-05-10T05:13:55.976 INFO:tasks.workunit.client.1.smithi117.stdout: 10 139944 16.28 MB/sec execute 343 sec latency 133.608 ms 2024-05-10T05:13:56.976 INFO:tasks.workunit.client.1.smithi117.stdout: 10 140340 16.29 MB/sec execute 344 sec latency 78.019 ms 2024-05-10T05:13:57.977 INFO:tasks.workunit.client.1.smithi117.stdout: 10 140478 16.28 MB/sec execute 345 sec latency 551.780 ms 2024-05-10T05:13:58.977 INFO:tasks.workunit.client.1.smithi117.stdout: 10 140838 16.29 MB/sec execute 346 sec latency 291.347 ms 2024-05-10T05:13:59.977 INFO:tasks.workunit.client.1.smithi117.stdout: 10 141079 16.29 MB/sec execute 347 sec latency 179.077 ms 2024-05-10T05:14:00.977 INFO:tasks.workunit.client.1.smithi117.stdout: 10 141432 16.30 MB/sec execute 348 sec latency 119.708 ms 2024-05-10T05:14:01.978 INFO:tasks.workunit.client.1.smithi117.stdout: 10 141730 16.30 MB/sec execute 349 sec latency 91.327 ms 2024-05-10T05:14:02.473 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:14:02.478 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:14:02.978 INFO:tasks.workunit.client.1.smithi117.stdout: 10 142076 16.29 MB/sec execute 350 sec latency 96.416 ms 2024-05-10T05:14:03.978 INFO:tasks.workunit.client.1.smithi117.stdout: 10 142426 16.30 MB/sec execute 351 sec latency 85.691 ms 2024-05-10T05:14:04.978 INFO:tasks.workunit.client.1.smithi117.stdout: 10 142765 16.29 MB/sec execute 352 sec latency 103.933 ms 2024-05-10T05:14:05.978 INFO:tasks.workunit.client.1.smithi117.stdout: 10 143258 16.34 MB/sec execute 353 sec latency 45.065 ms 2024-05-10T05:14:06.979 INFO:tasks.workunit.client.1.smithi117.stdout: 10 143717 16.34 MB/sec execute 354 sec latency 92.795 ms 2024-05-10T05:14:07.979 INFO:tasks.workunit.client.1.smithi117.stdout: 10 144053 16.36 MB/sec execute 355 sec latency 110.714 ms 2024-05-10T05:14:08.979 INFO:tasks.workunit.client.1.smithi117.stdout: 10 144462 16.38 MB/sec execute 356 sec latency 131.259 ms 2024-05-10T05:14:09.979 INFO:tasks.workunit.client.1.smithi117.stdout: 10 144758 16.39 MB/sec execute 357 sec latency 130.943 ms 2024-05-10T05:14:10.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 145133 16.40 MB/sec execute 358 sec latency 94.344 ms 2024-05-10T05:14:11.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 145423 16.39 MB/sec execute 359 sec latency 181.445 ms 2024-05-10T05:14:12.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 145750 16.38 MB/sec execute 360 sec latency 91.003 ms 2024-05-10T05:14:13.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 146100 16.40 MB/sec execute 361 sec latency 86.855 ms 2024-05-10T05:14:14.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 146567 16.42 MB/sec execute 362 sec latency 91.017 ms 2024-05-10T05:14:15.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 147015 16.44 MB/sec execute 363 sec latency 128.695 ms 2024-05-10T05:14:16.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 147433 16.45 MB/sec execute 364 sec latency 88.731 ms 2024-05-10T05:14:17.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 147673 16.45 MB/sec execute 365 sec latency 376.921 ms 2024-05-10T05:14:18.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 147692 16.40 MB/sec execute 366 sec latency 1376.478 ms 2024-05-10T05:14:19.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 147699 16.36 MB/sec execute 367 sec latency 2375.195 ms 2024-05-10T05:14:20.980 INFO:tasks.workunit.client.1.smithi117.stdout: 10 147833 16.34 MB/sec execute 368 sec latency 2577.476 ms 2024-05-10T05:14:21.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 148132 16.35 MB/sec execute 369 sec latency 124.997 ms 2024-05-10T05:14:22.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 148268 16.32 MB/sec execute 370 sec latency 167.265 ms 2024-05-10T05:14:23.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 148377 16.30 MB/sec execute 371 sec latency 480.996 ms 2024-05-10T05:14:24.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 148665 16.30 MB/sec execute 372 sec latency 146.122 ms 2024-05-10T05:14:25.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 149008 16.29 MB/sec execute 373 sec latency 105.467 ms 2024-05-10T05:14:26.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 149274 16.27 MB/sec execute 374 sec latency 132.243 ms 2024-05-10T05:14:27.982 INFO:tasks.workunit.client.1.smithi117.stdout: 10 149585 16.29 MB/sec execute 375 sec latency 122.295 ms 2024-05-10T05:14:28.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 150023 16.30 MB/sec execute 376 sec latency 103.554 ms 2024-05-10T05:14:29.981 INFO:tasks.workunit.client.1.smithi117.stdout: 10 150486 16.33 MB/sec execute 377 sec latency 47.556 ms 2024-05-10T05:14:30.983 INFO:tasks.workunit.client.1.smithi117.stdout: 10 150849 16.32 MB/sec execute 378 sec latency 183.954 ms 2024-05-10T05:14:31.983 INFO:tasks.workunit.client.1.smithi117.stdout: 10 151164 16.34 MB/sec execute 379 sec latency 110.393 ms 2024-05-10T05:14:32.612 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:14:32.616 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:14:32.748 INFO:tasks.ceph.mds.b.smithi117.stderr:2024-05-10T05:14:32.747+0000 7f7229400700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50613) UID: 0 2024-05-10T05:14:32.748 INFO:tasks.ceph.mds.d.smithi117.stderr:2024-05-10T05:14:32.748+0000 7fa259800700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50613) UID: 0 2024-05-10T05:14:32.983 INFO:tasks.workunit.client.1.smithi117.stdout: 10 151502 16.35 MB/sec execute 380 sec latency 125.312 ms 2024-05-10T05:14:33.984 INFO:tasks.workunit.client.1.smithi117.stdout: 10 151647 16.32 MB/sec execute 381 sec latency 718.066 ms 2024-05-10T05:14:34.984 INFO:tasks.workunit.client.1.smithi117.stdout: 10 151710 16.29 MB/sec execute 382 sec latency 988.801 ms 2024-05-10T05:14:35.990 INFO:tasks.workunit.client.1.smithi117.stdout: 10 151884 16.27 MB/sec execute 383 sec latency 136.246 ms 2024-05-10T05:14:36.990 INFO:tasks.workunit.client.1.smithi117.stdout: 10 152217 16.28 MB/sec execute 384 sec latency 136.947 ms 2024-05-10T05:14:37.990 INFO:tasks.workunit.client.1.smithi117.stdout: 10 152545 16.28 MB/sec execute 385 sec latency 102.067 ms 2024-05-10T05:14:38.990 INFO:tasks.workunit.client.1.smithi117.stdout: 10 152787 16.26 MB/sec execute 386 sec latency 258.383 ms 2024-05-10T05:14:39.991 INFO:tasks.workunit.client.1.smithi117.stdout: 10 152859 16.23 MB/sec execute 387 sec latency 616.210 ms 2024-05-10T05:14:40.994 INFO:tasks.workunit.client.1.smithi117.stdout: 10 153101 16.23 MB/sec execute 388 sec latency 174.977 ms 2024-05-10T05:14:41.994 INFO:tasks.workunit.client.1.smithi117.stdout: 10 153511 16.23 MB/sec execute 389 sec latency 114.983 ms 2024-05-10T05:14:42.994 INFO:tasks.workunit.client.1.smithi117.stdout: 10 153818 16.24 MB/sec execute 390 sec latency 133.653 ms 2024-05-10T05:14:43.997 INFO:tasks.workunit.client.1.smithi117.stdout: 10 154268 16.25 MB/sec execute 391 sec latency 121.780 ms 2024-05-10T05:14:44.997 INFO:tasks.workunit.client.1.smithi117.stdout: 10 154633 16.27 MB/sec execute 392 sec latency 127.593 ms 2024-05-10T05:14:45.997 INFO:tasks.workunit.client.1.smithi117.stdout: 10 155003 16.28 MB/sec execute 393 sec latency 141.461 ms 2024-05-10T05:14:46.997 INFO:tasks.workunit.client.1.smithi117.stdout: 10 155472 16.32 MB/sec execute 394 sec latency 145.749 ms 2024-05-10T05:14:47.997 INFO:tasks.workunit.client.1.smithi117.stdout: 10 155816 16.32 MB/sec execute 395 sec latency 149.471 ms 2024-05-10T05:14:48.997 INFO:tasks.workunit.client.1.smithi117.stdout: 10 156090 16.30 MB/sec execute 396 sec latency 207.520 ms 2024-05-10T05:14:49.998 INFO:tasks.workunit.client.1.smithi117.stdout: 10 156388 16.31 MB/sec execute 397 sec latency 150.908 ms 2024-05-10T05:14:50.998 INFO:tasks.workunit.client.1.smithi117.stdout: 10 156643 16.31 MB/sec execute 398 sec latency 191.559 ms 2024-05-10T05:14:52.001 INFO:tasks.workunit.client.1.smithi117.stdout: 10 156984 16.30 MB/sec execute 399 sec latency 104.166 ms 2024-05-10T05:14:53.001 INFO:tasks.workunit.client.1.smithi117.stdout: 10 157341 16.31 MB/sec execute 400 sec latency 59.533 ms 2024-05-10T05:14:54.001 INFO:tasks.workunit.client.1.smithi117.stdout: 10 157709 16.31 MB/sec execute 401 sec latency 130.649 ms 2024-05-10T05:14:55.001 INFO:tasks.workunit.client.1.smithi117.stdout: 10 157744 16.27 MB/sec execute 402 sec latency 820.630 ms 2024-05-10T05:14:56.001 INFO:tasks.workunit.client.1.smithi117.stdout: 10 157869 16.24 MB/sec execute 403 sec latency 1024.042 ms 2024-05-10T05:14:57.002 INFO:tasks.workunit.client.1.smithi117.stdout: 10 157967 16.21 MB/sec execute 404 sec latency 415.015 ms 2024-05-10T05:14:58.002 INFO:tasks.workunit.client.1.smithi117.stdout: 10 158271 16.23 MB/sec execute 405 sec latency 126.052 ms 2024-05-10T05:14:59.002 INFO:tasks.workunit.client.1.smithi117.stdout: 10 158626 16.24 MB/sec execute 406 sec latency 125.276 ms 2024-05-10T05:15:00.002 INFO:tasks.workunit.client.1.smithi117.stdout: 10 158708 16.22 MB/sec execute 407 sec latency 583.624 ms 2024-05-10T05:15:01.002 INFO:tasks.workunit.client.1.smithi117.stdout: 10 158985 16.21 MB/sec execute 408 sec latency 622.638 ms 2024-05-10T05:15:02.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 159162 16.20 MB/sec execute 409 sec latency 143.440 ms 2024-05-10T05:15:03.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 159462 16.20 MB/sec execute 410 sec latency 135.403 ms 2024-05-10T05:15:04.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 159655 16.18 MB/sec execute 411 sec latency 348.516 ms 2024-05-10T05:15:05.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 159960 16.19 MB/sec execute 412 sec latency 82.861 ms 2024-05-10T05:15:06.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 160189 16.18 MB/sec execute 413 sec latency 154.598 ms 2024-05-10T05:15:07.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 160484 16.17 MB/sec execute 414 sec latency 141.681 ms 2024-05-10T05:15:08.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 160828 16.17 MB/sec execute 415 sec latency 126.763 ms 2024-05-10T05:15:09.005 INFO:tasks.workunit.client.1.smithi117.stdout: 10 161073 16.16 MB/sec execute 416 sec latency 242.677 ms 2024-05-10T05:15:10.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 161271 16.14 MB/sec execute 417 sec latency 544.860 ms 2024-05-10T05:15:11.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 161605 16.13 MB/sec execute 418 sec latency 713.525 ms 2024-05-10T05:15:12.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 161819 16.14 MB/sec execute 419 sec latency 175.885 ms 2024-05-10T05:15:13.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 162305 16.18 MB/sec execute 420 sec latency 46.311 ms 2024-05-10T05:15:14.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 162716 16.20 MB/sec execute 421 sec latency 101.476 ms 2024-05-10T05:15:15.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 162905 16.18 MB/sec execute 422 sec latency 323.744 ms 2024-05-10T05:15:16.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 163059 16.16 MB/sec execute 423 sec latency 447.075 ms 2024-05-10T05:15:17.006 INFO:tasks.workunit.client.1.smithi117.stdout: 10 163219 16.15 MB/sec execute 424 sec latency 147.966 ms 2024-05-10T05:15:18.007 INFO:tasks.workunit.client.1.smithi117.stdout: 10 163591 16.16 MB/sec execute 425 sec latency 66.522 ms 2024-05-10T05:15:19.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 163795 16.14 MB/sec execute 426 sec latency 204.910 ms 2024-05-10T05:15:20.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 164074 16.12 MB/sec execute 427 sec latency 198.141 ms 2024-05-10T05:15:21.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 164334 16.12 MB/sec execute 428 sec latency 82.713 ms 2024-05-10T05:15:22.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 164625 16.13 MB/sec execute 429 sec latency 193.324 ms 2024-05-10T05:15:23.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 164978 16.11 MB/sec execute 430 sec latency 187.695 ms 2024-05-10T05:15:24.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 165259 16.12 MB/sec execute 431 sec latency 261.721 ms 2024-05-10T05:15:25.008 INFO:tasks.workunit.client.1.smithi117.stdout: 10 165609 16.15 MB/sec execute 432 sec latency 303.145 ms 2024-05-10T05:15:26.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 165626 16.11 MB/sec execute 433 sec latency 1036.324 ms 2024-05-10T05:15:27.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 165834 16.09 MB/sec execute 434 sec latency 1389.517 ms 2024-05-10T05:15:28.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 166036 16.07 MB/sec execute 435 sec latency 240.388 ms 2024-05-10T05:15:29.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 166295 16.07 MB/sec execute 436 sec latency 175.963 ms 2024-05-10T05:15:30.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 166521 16.08 MB/sec execute 437 sec latency 168.005 ms 2024-05-10T05:15:31.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 166693 16.06 MB/sec execute 438 sec latency 283.211 ms 2024-05-10T05:15:32.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 166919 16.04 MB/sec execute 439 sec latency 227.078 ms 2024-05-10T05:15:33.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 167145 16.04 MB/sec execute 440 sec latency 154.814 ms 2024-05-10T05:15:34.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 167380 16.03 MB/sec execute 441 sec latency 160.973 ms 2024-05-10T05:15:35.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 167668 16.01 MB/sec execute 442 sec latency 180.860 ms 2024-05-10T05:15:36.009 INFO:tasks.workunit.client.1.smithi117.stdout: 10 168025 16.03 MB/sec execute 443 sec latency 70.378 ms 2024-05-10T05:15:37.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 168321 16.02 MB/sec execute 444 sec latency 176.023 ms 2024-05-10T05:15:38.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 168720 16.02 MB/sec execute 445 sec latency 165.613 ms 2024-05-10T05:15:39.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 169197 16.07 MB/sec execute 446 sec latency 44.283 ms 2024-05-10T05:15:40.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 169593 16.07 MB/sec execute 447 sec latency 126.806 ms 2024-05-10T05:15:41.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 169986 16.10 MB/sec execute 448 sec latency 49.347 ms 2024-05-10T05:15:42.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 170186 16.09 MB/sec execute 449 sec latency 137.350 ms 2024-05-10T05:15:43.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 170549 16.09 MB/sec execute 450 sec latency 91.037 ms 2024-05-10T05:15:44.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 170772 16.09 MB/sec execute 451 sec latency 176.076 ms 2024-05-10T05:15:45.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 171071 16.07 MB/sec execute 452 sec latency 92.637 ms 2024-05-10T05:15:46.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 171443 16.08 MB/sec execute 453 sec latency 56.856 ms 2024-05-10T05:15:47.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 171748 16.08 MB/sec execute 454 sec latency 148.206 ms 2024-05-10T05:15:48.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 172157 16.08 MB/sec execute 455 sec latency 160.686 ms 2024-05-10T05:15:49.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 172458 16.08 MB/sec execute 456 sec latency 228.876 ms 2024-05-10T05:15:50.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 172767 16.10 MB/sec execute 457 sec latency 228.317 ms 2024-05-10T05:15:51.010 INFO:tasks.workunit.client.1.smithi117.stdout: 10 172952 16.08 MB/sec execute 458 sec latency 581.266 ms 2024-05-10T05:15:52.011 INFO:tasks.workunit.client.1.smithi117.stdout: 10 172971 16.05 MB/sec execute 459 sec latency 1581.324 ms 2024-05-10T05:15:53.011 INFO:tasks.workunit.client.1.smithi117.stdout: 10 173070 16.03 MB/sec execute 460 sec latency 2409.078 ms 2024-05-10T05:15:54.011 INFO:tasks.workunit.client.1.smithi117.stdout: 10 173273 16.02 MB/sec execute 461 sec latency 222.148 ms 2024-05-10T05:15:55.011 INFO:tasks.workunit.client.1.smithi117.stdout: 10 173365 16.00 MB/sec execute 462 sec latency 382.552 ms 2024-05-10T05:15:56.014 INFO:tasks.workunit.client.1.smithi117.stdout: 10 173478 15.98 MB/sec execute 463 sec latency 251.888 ms 2024-05-10T05:15:57.014 INFO:tasks.workunit.client.1.smithi117.stdout: 10 173504 15.95 MB/sec execute 464 sec latency 567.245 ms 2024-05-10T05:15:58.014 INFO:tasks.workunit.client.1.smithi117.stdout: 10 173759 15.94 MB/sec execute 465 sec latency 135.008 ms 2024-05-10T05:15:59.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 174084 15.94 MB/sec execute 466 sec latency 114.176 ms 2024-05-10T05:16:00.018 INFO:tasks.workunit.client.1.smithi117.stdout: 10 174257 15.93 MB/sec execute 467 sec latency 265.334 ms 2024-05-10T05:16:01.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 174444 15.91 MB/sec execute 468 sec latency 215.354 ms 2024-05-10T05:16:02.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 174753 15.91 MB/sec execute 469 sec latency 145.466 ms 2024-05-10T05:16:03.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 175075 15.92 MB/sec execute 470 sec latency 171.430 ms 2024-05-10T05:16:04.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 175484 15.91 MB/sec execute 471 sec latency 125.952 ms 2024-05-10T05:16:05.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 175844 15.92 MB/sec execute 472 sec latency 142.320 ms 2024-05-10T05:16:06.016 INFO:tasks.workunit.client.1.smithi117.stdout: 10 176274 15.96 MB/sec execute 473 sec latency 108.918 ms 2024-05-10T05:16:07.020 INFO:tasks.workunit.client.1.smithi117.stdout: 10 176652 15.96 MB/sec execute 474 sec latency 102.505 ms 2024-05-10T05:16:08.020 INFO:tasks.workunit.client.1.smithi117.stdout: 10 177043 15.98 MB/sec execute 475 sec latency 65.450 ms 2024-05-10T05:16:09.020 INFO:tasks.workunit.client.1.smithi117.stdout: 10 177275 15.98 MB/sec execute 476 sec latency 166.580 ms 2024-05-10T05:16:10.021 INFO:tasks.workunit.client.1.smithi117.stdout: 10 177558 15.97 MB/sec execute 477 sec latency 111.789 ms 2024-05-10T05:16:11.022 INFO:tasks.workunit.client.1.smithi117.stdout: 10 177825 15.97 MB/sec execute 478 sec latency 156.579 ms 2024-05-10T05:16:12.022 INFO:tasks.workunit.client.1.smithi117.stdout: 10 177931 15.94 MB/sec execute 479 sec latency 569.034 ms 2024-05-10T05:16:13.025 INFO:tasks.workunit.client.1.smithi117.stdout: 10 178011 15.92 MB/sec execute 480 sec latency 644.039 ms 2024-05-10T05:16:14.025 INFO:tasks.workunit.client.1.smithi117.stdout: 10 178162 15.90 MB/sec execute 481 sec latency 201.294 ms 2024-05-10T05:16:15.025 INFO:tasks.workunit.client.1.smithi117.stdout: 10 178570 15.91 MB/sec execute 482 sec latency 51.051 ms 2024-05-10T05:16:16.027 INFO:tasks.workunit.client.1.smithi117.stdout: 10 178915 15.91 MB/sec execute 483 sec latency 111.093 ms 2024-05-10T05:16:17.030 INFO:tasks.workunit.client.1.smithi117.stdout: 10 179238 15.90 MB/sec execute 484 sec latency 443.118 ms 2024-05-10T05:16:18.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 179398 15.89 MB/sec execute 485 sec latency 707.721 ms 2024-05-10T05:16:19.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 179593 15.89 MB/sec execute 486 sec latency 134.596 ms 2024-05-10T05:16:20.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 180106 15.91 MB/sec execute 487 sec latency 60.242 ms 2024-05-10T05:16:21.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 180457 15.93 MB/sec execute 488 sec latency 115.634 ms 2024-05-10T05:16:22.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 180692 15.93 MB/sec execute 489 sec latency 174.073 ms 2024-05-10T05:16:23.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 180937 15.92 MB/sec execute 490 sec latency 227.834 ms 2024-05-10T05:16:24.033 INFO:tasks.workunit.client.1.smithi117.stdout: 10 181295 15.93 MB/sec execute 491 sec latency 236.845 ms 2024-05-10T05:16:25.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 181551 15.92 MB/sec execute 492 sec latency 133.376 ms 2024-05-10T05:16:26.032 INFO:tasks.workunit.client.1.smithi117.stdout: 10 181824 15.91 MB/sec execute 493 sec latency 125.252 ms 2024-05-10T05:16:27.037 INFO:tasks.workunit.client.1.smithi117.stdout: 10 182200 15.93 MB/sec execute 494 sec latency 112.107 ms 2024-05-10T05:16:28.037 INFO:tasks.workunit.client.1.smithi117.stdout: 10 182507 15.91 MB/sec execute 495 sec latency 125.717 ms 2024-05-10T05:16:29.037 INFO:tasks.workunit.client.1.smithi117.stdout: 10 182997 15.93 MB/sec execute 496 sec latency 63.348 ms 2024-05-10T05:16:30.037 INFO:tasks.workunit.client.1.smithi117.stdout: 10 183329 15.95 MB/sec execute 497 sec latency 341.674 ms 2024-05-10T05:16:31.037 INFO:tasks.workunit.client.1.smithi117.stdout: 10 183747 15.96 MB/sec execute 498 sec latency 106.902 ms 2024-05-10T05:16:32.040 INFO:tasks.workunit.client.1.smithi117.stdout: 10 184051 15.97 MB/sec execute 499 sec latency 180.513 ms 2024-05-10T05:16:33.040 INFO:tasks.workunit.client.1.smithi117.stdout: 10 184081 15.94 MB/sec execute 500 sec latency 663.052 ms 2024-05-10T05:16:34.042 INFO:tasks.workunit.client.1.smithi117.stdout: 10 184297 15.93 MB/sec execute 501 sec latency 351.878 ms 2024-05-10T05:16:35.042 INFO:tasks.workunit.client.1.smithi117.stdout: 10 184535 15.94 MB/sec execute 502 sec latency 135.090 ms 2024-05-10T05:16:36.042 INFO:tasks.workunit.client.1.smithi117.stdout: 10 184869 15.93 MB/sec execute 503 sec latency 90.229 ms 2024-05-10T05:16:37.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 185000 15.91 MB/sec execute 504 sec latency 217.486 ms 2024-05-10T05:16:38.042 INFO:tasks.workunit.client.1.smithi117.stdout: 10 185030 15.88 MB/sec execute 505 sec latency 962.102 ms 2024-05-10T05:16:39.042 INFO:tasks.workunit.client.1.smithi117.stdout: 10 185218 15.87 MB/sec execute 506 sec latency 1362.799 ms 2024-05-10T05:16:40.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 185360 15.84 MB/sec execute 507 sec latency 174.523 ms 2024-05-10T05:16:41.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 185604 15.84 MB/sec execute 508 sec latency 130.527 ms 2024-05-10T05:16:42.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 185926 15.84 MB/sec execute 509 sec latency 175.419 ms 2024-05-10T05:16:43.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 186417 15.85 MB/sec execute 510 sec latency 89.431 ms 2024-05-10T05:16:44.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 186852 15.88 MB/sec execute 511 sec latency 85.718 ms 2024-05-10T05:16:45.043 INFO:tasks.workunit.client.1.smithi117.stdout: 10 187223 15.89 MB/sec execute 512 sec latency 218.733 ms 2024-05-10T05:16:46.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 187609 15.91 MB/sec execute 513 sec latency 60.218 ms 2024-05-10T05:16:47.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 187772 15.90 MB/sec execute 514 sec latency 198.024 ms 2024-05-10T05:16:48.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 188006 15.89 MB/sec execute 515 sec latency 266.174 ms 2024-05-10T05:16:49.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 188104 15.87 MB/sec execute 516 sec latency 563.909 ms 2024-05-10T05:16:50.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 188207 15.85 MB/sec execute 517 sec latency 313.134 ms 2024-05-10T05:16:51.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 188433 15.84 MB/sec execute 518 sec latency 450.138 ms 2024-05-10T05:16:52.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 188674 15.82 MB/sec execute 519 sec latency 145.497 ms 2024-05-10T05:16:53.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 188913 15.82 MB/sec execute 520 sec latency 184.492 ms 2024-05-10T05:16:54.044 INFO:tasks.workunit.client.1.smithi117.stdout: 10 189034 15.80 MB/sec execute 521 sec latency 514.121 ms 2024-05-10T05:16:55.045 INFO:tasks.workunit.client.1.smithi117.stdout: 10 189247 15.79 MB/sec execute 522 sec latency 167.175 ms 2024-05-10T05:16:56.046 INFO:tasks.workunit.client.1.smithi117.stdout: 10 189575 15.79 MB/sec execute 523 sec latency 314.476 ms 2024-05-10T05:16:57.046 INFO:tasks.workunit.client.1.smithi117.stdout: 10 189989 15.79 MB/sec execute 524 sec latency 83.942 ms 2024-05-10T05:16:58.046 INFO:tasks.workunit.client.1.smithi117.stdout: 10 190430 15.83 MB/sec execute 525 sec latency 55.619 ms 2024-05-10T05:16:59.046 INFO:tasks.workunit.client.1.smithi117.stdout: 10 190754 15.83 MB/sec execute 526 sec latency 169.535 ms 2024-05-10T05:17:00.046 INFO:tasks.workunit.client.1.smithi117.stdout: 10 191030 15.83 MB/sec execute 527 sec latency 122.453 ms 2024-05-10T05:17:01.046 INFO:tasks.workunit.client.1.smithi117.stdout: 10 191309 15.83 MB/sec execute 528 sec latency 129.107 ms 2024-05-10T05:17:02.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 191626 15.84 MB/sec execute 529 sec latency 106.283 ms 2024-05-10T05:17:03.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 191859 15.83 MB/sec execute 530 sec latency 193.969 ms 2024-05-10T05:17:04.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 192079 15.82 MB/sec execute 531 sec latency 182.124 ms 2024-05-10T05:17:05.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 192390 15.82 MB/sec execute 532 sec latency 63.574 ms 2024-05-10T05:17:06.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 192670 15.81 MB/sec execute 533 sec latency 199.658 ms 2024-05-10T05:17:07.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 193000 15.81 MB/sec execute 534 sec latency 107.052 ms 2024-05-10T05:17:08.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 193408 15.82 MB/sec execute 535 sec latency 108.523 ms 2024-05-10T05:17:09.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 193751 15.83 MB/sec execute 536 sec latency 113.849 ms 2024-05-10T05:17:10.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 194175 15.85 MB/sec execute 537 sec latency 82.994 ms 2024-05-10T05:17:11.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 194358 15.84 MB/sec execute 538 sec latency 299.101 ms 2024-05-10T05:17:12.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 194656 15.84 MB/sec execute 539 sec latency 102.916 ms 2024-05-10T05:17:13.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195007 15.85 MB/sec execute 540 sec latency 75.986 ms 2024-05-10T05:17:14.048 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195135 15.84 MB/sec execute 541 sec latency 630.254 ms 2024-05-10T05:17:15.047 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195146 15.81 MB/sec execute 542 sec latency 1057.687 ms 2024-05-10T05:17:16.048 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195358 15.80 MB/sec execute 543 sec latency 575.331 ms 2024-05-10T05:17:17.048 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195481 15.78 MB/sec execute 544 sec latency 208.406 ms 2024-05-10T05:17:18.048 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195646 15.76 MB/sec execute 545 sec latency 166.911 ms 2024-05-10T05:17:19.048 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195794 15.74 MB/sec execute 546 sec latency 536.733 ms 2024-05-10T05:17:20.048 INFO:tasks.workunit.client.1.smithi117.stdout: 10 195895 15.73 MB/sec execute 547 sec latency 957.310 ms 2024-05-10T05:17:21.049 INFO:tasks.workunit.client.1.smithi117.stdout: 10 196079 15.71 MB/sec execute 548 sec latency 203.075 ms 2024-05-10T05:17:22.049 INFO:tasks.workunit.client.1.smithi117.stdout: 10 196188 15.69 MB/sec execute 549 sec latency 415.691 ms 2024-05-10T05:17:23.049 INFO:tasks.workunit.client.1.smithi117.stdout: 10 196496 15.69 MB/sec execute 550 sec latency 171.303 ms 2024-05-10T05:17:24.050 INFO:tasks.workunit.client.1.smithi117.stdout: 10 196956 15.71 MB/sec execute 551 sec latency 66.253 ms 2024-05-10T05:17:25.050 INFO:tasks.workunit.client.1.smithi117.stdout: 10 197299 15.71 MB/sec execute 552 sec latency 132.999 ms 2024-05-10T05:17:26.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 197776 15.74 MB/sec execute 553 sec latency 44.164 ms 2024-05-10T05:17:27.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 198088 15.75 MB/sec execute 554 sec latency 125.927 ms 2024-05-10T05:17:28.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 198387 15.75 MB/sec execute 555 sec latency 124.853 ms 2024-05-10T05:17:29.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 198686 15.76 MB/sec execute 556 sec latency 117.589 ms 2024-05-10T05:17:30.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 199013 15.75 MB/sec execute 557 sec latency 131.178 ms 2024-05-10T05:17:31.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 199237 15.74 MB/sec execute 558 sec latency 258.374 ms 2024-05-10T05:17:32.051 INFO:tasks.workunit.client.1.smithi117.stdout: 10 199396 15.73 MB/sec execute 559 sec latency 395.109 ms 2024-05-10T05:17:33.053 INFO:tasks.workunit.client.1.smithi117.stdout: 10 199733 15.73 MB/sec execute 560 sec latency 117.260 ms 2024-05-10T05:17:34.052 INFO:tasks.workunit.client.1.smithi117.stdout: 10 200038 15.73 MB/sec execute 561 sec latency 221.266 ms 2024-05-10T05:17:35.055 INFO:tasks.workunit.client.1.smithi117.stdout: 10 200060 15.70 MB/sec execute 562 sec latency 1013.473 ms 2024-05-10T05:17:36.055 INFO:tasks.workunit.client.1.smithi117.stdout: 10 200126 15.68 MB/sec execute 563 sec latency 1098.663 ms 2024-05-10T05:17:37.055 INFO:tasks.workunit.client.1.smithi117.stdout: 10 200266 15.67 MB/sec execute 564 sec latency 330.104 ms 2024-05-10T05:17:38.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 200476 15.65 MB/sec execute 565 sec latency 155.339 ms 2024-05-10T05:17:39.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 200917 15.67 MB/sec execute 566 sec latency 68.900 ms 2024-05-10T05:17:40.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 201329 15.69 MB/sec execute 567 sec latency 137.245 ms 2024-05-10T05:17:41.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 201662 15.70 MB/sec execute 568 sec latency 152.770 ms 2024-05-10T05:17:42.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 201959 15.70 MB/sec execute 569 sec latency 148.698 ms 2024-05-10T05:17:43.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 202250 15.70 MB/sec execute 570 sec latency 165.970 ms 2024-05-10T05:17:44.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 202607 15.70 MB/sec execute 571 sec latency 49.699 ms 2024-05-10T05:17:45.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 202920 15.70 MB/sec execute 572 sec latency 98.534 ms 2024-05-10T05:17:46.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 203221 15.70 MB/sec execute 573 sec latency 178.649 ms 2024-05-10T05:17:47.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 203624 15.71 MB/sec execute 574 sec latency 139.765 ms 2024-05-10T05:17:48.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 204167 15.73 MB/sec execute 575 sec latency 44.600 ms 2024-05-10T05:17:49.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 204579 15.75 MB/sec execute 576 sec latency 114.514 ms 2024-05-10T05:17:50.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 205019 15.77 MB/sec execute 577 sec latency 149.678 ms 2024-05-10T05:17:51.056 INFO:tasks.workunit.client.1.smithi117.stdout: 10 205370 15.77 MB/sec execute 578 sec latency 121.627 ms 2024-05-10T05:17:52.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 205708 15.79 MB/sec execute 579 sec latency 77.985 ms 2024-05-10T05:17:53.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 206015 15.78 MB/sec execute 580 sec latency 126.422 ms 2024-05-10T05:17:54.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 206225 15.77 MB/sec execute 581 sec latency 388.683 ms 2024-05-10T05:17:55.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 206558 15.77 MB/sec execute 582 sec latency 94.381 ms 2024-05-10T05:17:56.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 206992 15.78 MB/sec execute 583 sec latency 83.737 ms 2024-05-10T05:17:57.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 207415 15.79 MB/sec execute 584 sec latency 84.802 ms 2024-05-10T05:17:58.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 207922 15.81 MB/sec execute 585 sec latency 49.866 ms 2024-05-10T05:17:59.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 208332 15.83 MB/sec execute 586 sec latency 131.458 ms 2024-05-10T05:18:00.057 INFO:tasks.workunit.client.1.smithi117.stdout: 10 208747 15.84 MB/sec execute 587 sec latency 135.474 ms 2024-05-10T05:18:01.062 INFO:tasks.workunit.client.1.smithi117.stdout: 10 209087 15.85 MB/sec execute 588 sec latency 128.077 ms 2024-05-10T05:18:02.062 INFO:tasks.workunit.client.1.smithi117.stdout: 10 209412 15.85 MB/sec execute 589 sec latency 164.266 ms 2024-05-10T05:18:03.063 INFO:tasks.workunit.client.1.smithi117.stdout: 10 209691 15.84 MB/sec execute 590 sec latency 114.411 ms 2024-05-10T05:18:04.063 INFO:tasks.workunit.client.1.smithi117.stdout: 10 209967 15.84 MB/sec execute 591 sec latency 186.805 ms 2024-05-10T05:18:05.063 INFO:tasks.workunit.client.1.smithi117.stdout: 10 210290 15.84 MB/sec execute 592 sec latency 57.122 ms 2024-05-10T05:18:06.063 INFO:tasks.workunit.client.1.smithi117.stdout: 10 210649 15.85 MB/sec execute 593 sec latency 175.110 ms 2024-05-10T05:18:07.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 210942 15.84 MB/sec execute 594 sec latency 205.046 ms 2024-05-10T05:18:07.174 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:18:07.179 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:18:08.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 211232 15.85 MB/sec execute 595 sec latency 278.083 ms 2024-05-10T05:18:09.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 211627 15.85 MB/sec execute 596 sec latency 231.041 ms 2024-05-10T05:18:10.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 212032 15.87 MB/sec execute 597 sec latency 168.346 ms 2024-05-10T05:18:11.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 212093 15.85 MB/sec execute 598 sec latency 852.350 ms 2024-05-10T05:18:12.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 212103 15.82 MB/sec execute 599 sec latency 1558.228 ms 2024-05-10T05:18:13.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 cleanup 600 sec 2024-05-10T05:18:14.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 cleanup 601 sec 2024-05-10T05:18:15.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 cleanup 602 sec 2024-05-10T05:18:16.064 INFO:tasks.workunit.client.1.smithi117.stdout: 10 cleanup 603 sec 2024-05-10T05:18:17.064 INFO:tasks.workunit.client.1.smithi117.stdout: 1 cleanup 604 sec 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: 0 cleanup 604 sec 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: Operation Count AvgLat MaxLat 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: ---------------------------------------- 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: NTCreateX 303838 7.752 3366.907 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: Close 223307 0.005 3.780 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: Rename 12890 32.702 3214.935 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: Unlink 61281 13.026 997.104 2024-05-10T05:18:17.116 INFO:tasks.workunit.client.1.smithi117.stdout: Qpathinfo 275915 5.842 2487.626 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: Qfileinfo 48163 0.002 1.957 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: Qfsinfo 50470 0.490 126.753 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: Sfileinfo 24823 1.660 895.899 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: Find 106569 1.059 717.984 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: WriteX 150316 0.357 2275.578 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: ReadX 477210 0.047 409.963 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: LockX 992 10.648 335.838 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: UnlockX 992 10.005 257.772 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: Flush 21307 25.209 2409.070 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout: 2024-05-10T05:18:17.117 INFO:tasks.workunit.client.1.smithi117.stdout:Throughput 15.8232 MB/sec 10 clients 10 procs max_latency=2577.476 ms 2024-05-10T05:18:17.670 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-10T05:18:17.670 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-05-10T05:18:19.354 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.1... 2024-05-10T05:18:19.355 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-05-10T05:18:20.866 DEBUG:teuthology.parallel:result is None 2024-05-10T05:18:20.866 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-05-10T05:18:21.114 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-05-10T05:18:21.114 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-10T05:18:21.114 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T05:18:21.114 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T05:18:21.258 DEBUG:teuthology.orchestra.run.smithi117:> set -ex 2024-05-10T05:18:21.258 DEBUG:teuthology.orchestra.run.smithi117:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-10T05:18:21.372 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T05:18:22.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.573+0000 7fa6f9400700 1 Processor -- start 2024-05-10T05:18:22.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.574+0000 7fa6f9400700 1 -- start start 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.575+0000 7fa6f9400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6f40c2860 0x7fa6f414c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.575+0000 7fa6f9400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40c2dd0 con 0x7fa6f4071040 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.575+0000 7fa6f9400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6f40aaf10 con 0x7fa6f4152270 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.575+0000 7fa6f9400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6f40ab1f0 con 0x7fa6f40c2860 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.576+0000 7fa6f2800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fa6f40c2860 0x7fa6f414c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.576+0000 7fa6f1e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fa6f4071040 0x7fa6f40c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37182/0 (socket says 172.21.15.47:37182) 2024-05-10T05:18:22.576 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.576+0000 7fa6f1e00700 1 -- 172.21.15.47:0/2369704131 learned_addr learned my addr 172.21.15.47:0/2369704131 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:22.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.576+0000 7fa6f1400700 1 -- 172.21.15.47:0/2369704131 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775586069 0 0) 0x7fa6f40c2dd0 con 0x7fa6f4071040 2024-05-10T05:18:22.577 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.576+0000 7fa6f1400700 1 -- 172.21.15.47:0/2369704131 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6d80057c0 con 0x7fa6f4071040 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.576+0000 7fa6f2800700 1 -- 172.21.15.47:0/2369704131 >> v1:172.21.15.117:6789/0 conn(0x7fa6f4152270 legacy=0x7fa6f4152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f1400700 1 -- 172.21.15.47:0/2369704131 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013226683 0 0) 0x7fa6f40aaf10 con 0x7fa6f4152270 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f2800700 1 -- 172.21.15.47:0/2369704131 >> v1:172.21.15.47:6789/0 conn(0x7fa6f4071040 legacy=0x7fa6f40c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f2800700 1 -- 172.21.15.47:0/2369704131 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f40ab4d0 con 0x7fa6f40c2860 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f2800700 1 --2- 172.21.15.47:0/2369704131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f40c2860 0x7fa6f414c3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009840 tx=0x7fa6e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f6e9252aadf9d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f1400700 1 -- 172.21.15.47:0/2369704131 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4011830 con 0x7fa6f40c2860 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f1400700 1 -- 172.21.15.47:0/2369704131 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4011990 con 0x7fa6f40c2860 2024-05-10T05:18:22.578 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.577+0000 7fa6f1400700 1 -- 172.21.15.47:0/2369704131 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4011d20 con 0x7fa6f40c2860 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 -- 172.21.15.47:0/2369704131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f40c2860 msgr2=0x7fa6f414c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 --2- 172.21.15.47:0/2369704131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f40c2860 0x7fa6f414c3f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009840 tx=0x7fa6e4009b50 comp rx=0 tx=0).stop 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 -- 172.21.15.47:0/2369704131 shutdown_connections 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 --2- 172.21.15.47:0/2369704131 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f40c2860 0x7fa6f414c3f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 -- 172.21.15.47:0/2369704131 >> 172.21.15.47:0/2369704131 conn(0x7fa6f406ae30 msgr2=0x7fa6f406b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 -- 172.21.15.47:0/2369704131 shutdown_connections 2024-05-10T05:18:22.579 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.578+0000 7fa6f9400700 1 -- 172.21.15.47:0/2369704131 wait complete. 2024-05-10T05:18:22.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.581+0000 7fa6f9400700 1 Processor -- start 2024-05-10T05:18:22.581 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.581+0000 7fa6f9400700 1 -- start start 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f9400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6f4071040 0x7fa6f414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f9400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 0x7fa6f41e84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f9400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 0x7fa6f41deda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f9400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4149c20 con 0x7fa6f4152270 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f9400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f4150ed0 con 0x7fa6f40c2860 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f9400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f41eb180 con 0x7fa6f4071040 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f3200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 0x7fa6f41deda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f1e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 0x7fa6f41e84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f2800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6f4071040 0x7fa6f414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:22.584 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f2800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6f4071040 0x7fa6f414b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:36460/0 (socket says 172.21.15.47:36460) 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f3200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 0x7fa6f41deda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55698/0 (socket says 172.21.15.47:55698) 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f3200700 1 -- 172.21.15.47:0/4080102070 learned_addr learned my addr 172.21.15.47:0/4080102070 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.583+0000 7fa6f1e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 0x7fa6f41e84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:54986/0 (socket says 172.21.15.47:54986) 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f3200700 1 -- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6f4071040 msgr2=0x7fa6f414b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f3200700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6f4071040 0x7fa6f414b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f3200700 1 -- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 msgr2=0x7fa6f41e84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f3200700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 0x7fa6f41e84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f3200700 1 -- 172.21.15.47:0/4080102070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e40094a0 con 0x7fa6f4152270 2024-05-10T05:18:22.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f1e00700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 0x7fa6f41e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f3200700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 0x7fa6f41deda0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c790 tx=0x7fa6ec00caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec003e30 con 0x7fa6f4152270 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ec006bc0 con 0x7fa6f4152270 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f41eb460 con 0x7fa6f4152270 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.584+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ec005070 con 0x7fa6f4152270 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.585+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f41eba20 con 0x7fa6f4152270 2024-05-10T05:18:22.586 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.586+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f4074720 con 0x7fa6f4152270 2024-05-10T05:18:22.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.587+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa6ec0051d0 con 0x7fa6f4152270 2024-05-10T05:18:22.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.588+0000 7fa6eaa00700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa6d406ad10 0x7fa6d406d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:22.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.588+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6ec088cd0 con 0x7fa6f4152270 2024-05-10T05:18:22.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.588+0000 7fa6f2800700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa6d406ad10 0x7fa6d406d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:22.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.589+0000 7fa6f2800700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa6d406ad10 0x7fa6d406d220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009840 tx=0x7fa6e4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:22.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.593+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fa6ec08e020 con 0x7fa6f4152270 2024-05-10T05:18:22.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.816+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6f4070e20 con 0x7fa6f4152270 2024-05-10T05:18:22.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.817+0000 7fa6eaa00700 1 -- 172.21.15.47:0/4080102070 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18267 (secure 0 0 0) 0x7fa6ec057510 con 0x7fa6f4152270 2024-05-10T05:18:22.818 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:22.818 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:52:40.317170+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa6d406ad10 msgr2=0x7fa6d406d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa6d406ad10 0x7fa6d406d220 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009840 tx=0x7fa6e4008030 comp rx=0 tx=0).stop 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 msgr2=0x7fa6f41deda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 0x7fa6f41deda0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec00c790 tx=0x7fa6ec00caa0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 shutdown_connections 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fa6f4152270 0x7fa6f41deda0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fa6d406ad10 0x7fa6d406d220 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.820 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fa6f4071040 0x7fa6f414b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 --2- 172.21.15.47:0/4080102070 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fa6f40c2860 0x7fa6f41e84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.819+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 >> 172.21.15.47:0/4080102070 conn(0x7fa6f406ae30 msgr2=0x7fa6f41dd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.820+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 shutdown_connections 2024-05-10T05:18:22.821 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:22.820+0000 7fa6f9400700 1 -- 172.21.15.47:0/4080102070 wait complete. 2024-05-10T05:18:22.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-10T04:51:45.210667+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-10T04:51:50.735924+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-10T04:51:51.694963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-10T04:51:55.175151+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-10T05:18:22.849 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-10T05:18:23.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.128+0000 7f33a2400700 1 Processor -- start 2024-05-10T05:18:23.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.129+0000 7f33a2400700 1 -- start start 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.130+0000 7f33a2400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 0x7f339c1560e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.130+0000 7f33a2400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f339c0c0230 0x7f339c0c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.130+0000 7f33a2400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f339c0c5370 con 0x7f339c0c17a0 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.130+0000 7f33a2400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f339c0c2550 con 0x7f339c0c0230 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.130+0000 7f33a2400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c1bb0 con 0x7f339c0c6d40 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f3393e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f339c0c17a0 0x7f339c06cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37192/0 (socket says 172.21.15.47:37192) 2024-05-10T05:18:23.131 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f3393e00700 1 -- 172.21.15.47:0/3688759410 learned_addr learned my addr 172.21.15.47:0/3688759410 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339b400700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 0x7f339c1560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339be00700 1 --2- 172.21.15.47:0/3688759410 >> v2:172.21.15.117:3300/0 conn(0x7f339c0c0230 0x7f339c0c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964505456 0 0) 0x7f339c0c5370 con 0x7f339c0c17a0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33800035b0 con 0x7f339c0c17a0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 566528561 0 0) 0x7f33800035b0 con 0x7f339c0c17a0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 msgr2=0x7f339c1560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 0x7f339c1560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 >> v2:172.21.15.117:3300/0 conn(0x7f339c0c0230 msgr2=0x7f339c0c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 --2- 172.21.15.47:0/3688759410 >> v2:172.21.15.117:3300/0 conn(0x7f339c0c0230 0x7f339c0c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0bf9e0 con 0x7f339c0c17a0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f3384001670 con 0x7f339c0c17a0 2024-05-10T05:18:23.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.131+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 >> v1:172.21.15.47:6789/0 conn(0x7f339c0c17a0 legacy=0x7f339c06cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339aa00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3380003a00 0x7f3380003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339aa00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3380004850 0x7f3380004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339aa00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 0x7f3380005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c1bb0 con 0x7f3380004850 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f338000bb20 con 0x7f3380003a00 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f338000bce0 con 0x7f339c0c6d40 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f3393e00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3380004850 0x7f3380004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339b400700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3380003a00 0x7f3380003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339be00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 0x7f3380005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f3393e00700 1 -- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 msgr2=0x7f3380005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f3393e00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f339c0c6d40 0x7f3380005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f3393e00700 1 -- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3380003a00 msgr2=0x7f3380003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:23.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f3393e00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3380003a00 0x7f3380003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f3393e00700 1 -- 172.21.15.47:0/3688759410 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33800035b0 con 0x7f3380004850 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.132+0000 7f339b400700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3380003a00 0x7f3380003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.133+0000 7f3393e00700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3380004850 0x7f3380004c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f338400c210 tx=0x7f3380005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fc8f54785c00e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.133+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338400cd50 con 0x7f3380004850 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.133+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3384005960 con 0x7f3380004850 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.133+0000 7f339aa00700 1 -- 172.21.15.47:0/3688759410 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384005d10 con 0x7f3380004850 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.133+0000 7f33a2400700 1 -- 172.21.15.47:0/3688759410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3380004850 msgr2=0x7f3380004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.134+0000 7f33a2400700 1 --2- 172.21.15.47:0/3688759410 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3380004850 0x7f3380004c60 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f338400c210 tx=0x7f3380005880 comp rx=0 tx=0).stop 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.134+0000 7f339be00700 1 -- 172.21.15.47:0/3688759410 reap_dead start 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.134+0000 7f33a2400700 1 -- 172.21.15.47:0/3688759410 shutdown_connections 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.134+0000 7f33a2400700 1 -- 172.21.15.47:0/3688759410 >> 172.21.15.47:0/3688759410 conn(0x7f339c067630 msgr2=0x7f339c0ca9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.134+0000 7f33a2400700 1 -- 172.21.15.47:0/3688759410 shutdown_connections 2024-05-10T05:18:23.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.134+0000 7f33a2400700 1 -- 172.21.15.47:0/3688759410 wait complete. 2024-05-10T05:18:23.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.136+0000 7f33a2400700 1 Processor -- start 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.136+0000 7f33a2400700 1 -- start start 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f33a2400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3380004850 0x7f339c158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f33a2400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f339c0ab7a0 0x7f339c0aa1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f33a2400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 0x7f339c139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f33a2400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0ae970 con 0x7f339c0abbb0 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f33a2400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c1eac70 con 0x7f339c0ab7a0 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f33a2400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0aaf00 con 0x7f3380004850 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 0x7f339c139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 0x7f339c139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55718/0 (socket says 172.21.15.47:55718) 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 -- 172.21.15.47:0/962433659 learned_addr learned my addr 172.21.15.47:0/962433659 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f3393e00700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f339c0ab7a0 0x7f339c0aa1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3380004850 0x7f339c158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 -- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3380004850 msgr2=0x7f339c158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3380004850 0x7f339c158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 -- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f339c0ab7a0 msgr2=0x7f339c0aa1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f339c0ab7a0 0x7f339c0aa1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.138+0000 7f339be00700 1 -- 172.21.15.47:0/962433659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c1eba90 con 0x7f339c0abbb0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.139+0000 7f339be00700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 0x7f339c139310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f339c06dec0 tx=0x7f3394011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.139+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400e040 con 0x7f339c0abbb0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.139+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339400f040 con 0x7f339c0abbb0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.139+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400fe30 con 0x7f339c0abbb0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.139+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c1eae80 con 0x7f339c0abbb0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.139+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c1eb440 con 0x7f339c0abbb0 2024-05-10T05:18:23.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.140+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c074720 con 0x7f339c0abbb0 2024-05-10T05:18:23.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.141+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3394022460 con 0x7f339c0abbb0 2024-05-10T05:18:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.143+0000 7f3393400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806ac90 0x7f337806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.143+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3394089ab0 con 0x7f339c0abbb0 2024-05-10T05:18:23.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.143+0000 7f339b400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806ac90 0x7f337806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.144+0000 7f339b400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806ac90 0x7f337806d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f338c0091c0 tx=0x7f338c009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:23.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.148+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3394054830 con 0x7f339c0abbb0 2024-05-10T05:18:23.398 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.398+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f339c0c6b20 con 0x7f339c0abbb0 2024-05-10T05:18:23.399 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.399+0000 7f3393400700 1 -- 172.21.15.47:0/962433659 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3394057e50 con 0x7f339c0abbb0 2024-05-10T05:18:23.399 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 1 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806ac90 msgr2=0x7f337806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806ac90 0x7f337806d1a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f338c0091c0 tx=0x7f338c009210 comp rx=0 tx=0).stop 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 msgr2=0x7f339c139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 0x7f339c139310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f339c06dec0 tx=0x7f3394011f60 comp rx=0 tx=0).stop 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 shutdown_connections 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f339c0abbb0 0x7f339c139310 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f337806ac90 0x7f337806d1a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3380004850 0x7f339c158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 --2- 172.21.15.47:0/962433659 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f339c0ab7a0 0x7f339c0aa1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.402 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 >> 172.21.15.47:0/962433659 conn(0x7f339c067630 msgr2=0x7f339c06cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:23.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 shutdown_connections 2024-05-10T05:18:23.403 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.401+0000 7f33a2400700 1 -- 172.21.15.47:0/962433659 wait complete. 2024-05-10T05:18:23.430 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-10T05:18:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.701+0000 7f3805e00700 1 Processor -- start 2024-05-10T05:18:23.702 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.702+0000 7f3805e00700 1 -- start start 2024-05-10T05:18:23.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.703+0000 7f3805e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f38000c6cc0 0x7f3800152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.703+0000 7f3805e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f380006bdb0 0x7f380006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.703+0000 7f3805e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380006d640 con 0x7f38000c5cf0 2024-05-10T05:18:23.704 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.703+0000 7f3805e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000c9800 con 0x7f380006bdb0 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.703+0000 7f3805e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380006c700 con 0x7f38000c6cc0 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.703+0000 7f37ff400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f380006bdb0 0x7f380006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f380006bdb0 0x7f380006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55728/0 (socket says 172.21.15.47:55728) 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 -- 172.21.15.47:0/1596253806 learned_addr learned my addr 172.21.15.47:0/1596253806 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37fea00700 1 --2- 172.21.15.47:0/1596253806 >> v2:172.21.15.117:3300/0 conn(0x7f38000c6cc0 0x7f3800152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 -- 172.21.15.47:0/1596253806 >> v2:172.21.15.117:3300/0 conn(0x7f38000c6cc0 msgr2=0x7f3800152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 --2- 172.21.15.47:0/1596253806 >> v2:172.21.15.117:3300/0 conn(0x7f38000c6cc0 0x7f3800152bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 -- 172.21.15.47:0/1596253806 >> v1:172.21.15.117:6789/0 conn(0x7f38000c5cf0 legacy=0x7f38000c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 -- 172.21.15.47:0/1596253806 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000c6100 con 0x7f380006bdb0 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37fea00700 1 --2- 172.21.15.47:0/1596253806 >> v2:172.21.15.117:3300/0 conn(0x7f38000c6cc0 0x7f3800152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:23.705 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37ff400700 1 --2- 172.21.15.47:0/1596253806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380006bdb0 0x7f380006c1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f380008c3a0 tx=0x7f37f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd961d011e3ef698 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.704+0000 7f37fe000700 1 -- 172.21.15.47:0/1596253806 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800e070 con 0x7f380006bdb0 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f37fe000700 1 -- 172.21.15.47:0/1596253806 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f800b9c0 con 0x7f380006bdb0 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f37fe000700 1 -- 172.21.15.47:0/1596253806 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f800bd70 con 0x7f380006bdb0 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 -- 172.21.15.47:0/1596253806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380006bdb0 msgr2=0x7f380006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 --2- 172.21.15.47:0/1596253806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380006bdb0 0x7f380006c1c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f380008c3a0 tx=0x7f37f800b330 comp rx=0 tx=0).stop 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 -- 172.21.15.47:0/1596253806 shutdown_connections 2024-05-10T05:18:23.707 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 --2- 172.21.15.47:0/1596253806 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f380006bdb0 0x7f380006c1c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 --2- 172.21.15.47:0/1596253806 >> v2:172.21.15.117:3300/0 conn(0x7f38000c6cc0 0x7f3800152bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 -- 172.21.15.47:0/1596253806 >> 172.21.15.47:0/1596253806 conn(0x7f38000ca960 msgr2=0x7f38000cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:23.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 -- 172.21.15.47:0/1596253806 shutdown_connections 2024-05-10T05:18:23.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.705+0000 7f3805e00700 1 -- 172.21.15.47:0/1596253806 wait complete. 2024-05-10T05:18:23.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.707+0000 7f3805e00700 1 Processor -- start 2024-05-10T05:18:23.708 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.708+0000 7f3805e00700 1 -- start start 2024-05-10T05:18:23.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f3805e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f380006bdb0 0x7f38000c1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f3805e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38000c5cf0 0x7f38001ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f3805e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 0x7f380014ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.711 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f3805e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000c31e0 con 0x7f38000c6cc0 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f3805e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38001ef170 con 0x7f380006bdb0 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f3805e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3800154d40 con 0x7f38000c5cf0 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f37ff400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 0x7f380014ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f37ff400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 0x7f380014ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55740/0 (socket says 172.21.15.47:55740) 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f37ff400700 1 -- 172.21.15.47:0/3408550834 learned_addr learned my addr 172.21.15.47:0/3408550834 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f37fea00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f380006bdb0 0x7f38000c1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.709+0000 7f37f7e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38000c5cf0 0x7f38001ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37ff400700 1 -- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38000c5cf0 msgr2=0x7f38001ee780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37ff400700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38000c5cf0 0x7f38001ee780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37ff400700 1 -- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f380006bdb0 msgr2=0x7f38000c1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37ff400700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f380006bdb0 0x7f38000c1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.712 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37ff400700 1 -- 172.21.15.47:0/3408550834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f8009b30 con 0x7f38000c6cc0 2024-05-10T05:18:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37ff400700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 0x7f380014ab00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37f8012000 tx=0x7f37f8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f8004670 con 0x7f38000c6cc0 2024-05-10T05:18:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f80047d0 con 0x7f38000c6cc0 2024-05-10T05:18:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f801b670 con 0x7f38000c6cc0 2024-05-10T05:18:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.710+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3800154b20 con 0x7f38000c6cc0 2024-05-10T05:18:23.713 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.711+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38001552a0 con 0x7f38000c6cc0 2024-05-10T05:18:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.712+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800074720 con 0x7f38000c6cc0 2024-05-10T05:18:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.713+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f37f801b7d0 con 0x7f38000c6cc0 2024-05-10T05:18:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.713+0000 7f37f7400700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f37dc06ac90 0x7f37dc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.714+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37f808aa90 con 0x7f38000c6cc0 2024-05-10T05:18:23.714 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.714+0000 7f37fea00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f37dc06ac90 0x7f37dc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:23.715 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.715+0000 7f37fea00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f37dc06ac90 0x7f37dc06d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37f0006f10 tx=0x7f37f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:23.719 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.719+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f37f80559d0 con 0x7f38000c6cc0 2024-05-10T05:18:23.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.932+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38000c5610 con 0x7f38000c6cc0 2024-05-10T05:18:23.932 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.932+0000 7f37f7400700 1 -- 172.21.15.47:0/3408550834 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37f801f020 con 0x7f38000c6cc0 2024-05-10T05:18:23.932 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T05:18:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f37dc06ac90 msgr2=0x7f37dc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f37dc06ac90 0x7f37dc06d1a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f37f0006f10 tx=0x7f37f0008040 comp rx=0 tx=0).stop 2024-05-10T05:18:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 msgr2=0x7f380014ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 0x7f380014ab00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f37f8012000 tx=0x7f37f8004ad0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.935 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 shutdown_connections 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f38000c6cc0 0x7f380014ab00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f380006bdb0 0x7f38000c1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f37dc06ac90 0x7f37dc06d1a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 --2- 172.21.15.47:0/3408550834 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f38000c5cf0 0x7f38001ee780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 >> 172.21.15.47:0/3408550834 conn(0x7f38000ca960 msgr2=0x7f3800156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.934+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 shutdown_connections 2024-05-10T05:18:23.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:23.935+0000 7f3805e00700 1 -- 172.21.15.47:0/3408550834 wait complete. 2024-05-10T05:18:23.963 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-10T05:18:24.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.236+0000 7f1ad1c00700 1 Processor -- start 2024-05-10T05:18:24.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.236+0000 7f1ad1c00700 1 -- start start 2024-05-10T05:18:24.238 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1ad1c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1acc155ef0 0x7f1acc0c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1ad1c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 0x7f1acc0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1ad1c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1acc0c31e0 con 0x7f1acc0c6d90 2024-05-10T05:18:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1ad1c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1acc0c50e0 con 0x7f1acc155ef0 2024-05-10T05:18:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1ad1c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc156300 con 0x7f1acc0c3b40 2024-05-10T05:18:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1acaa00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f1acc0c6d90 0x7f1acc0ca8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37204/0 (socket says 172.21.15.47:37204) 2024-05-10T05:18:24.239 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.238+0000 7f1acaa00700 1 -- 172.21.15.47:0/748600141 learned_addr learned my addr 172.21.15.47:0/748600141 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1acb400700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 0x7f1acc0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1ac3e00700 1 --2- 172.21.15.47:0/748600141 >> v2:172.21.15.117:3300/0 conn(0x7f1acc155ef0 0x7f1acc0c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277191701 0 0) 0x7f1acc0c31e0 con 0x7f1acc0c6d90 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ab00035b0 con 0x7f1acc0c6d90 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2328555663 0 0) 0x7f1ab00035b0 con 0x7f1acc0c6d90 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 msgr2=0x7f1acc0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 0x7f1acc0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.242 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 >> v2:172.21.15.117:3300/0 conn(0x7f1acc155ef0 msgr2=0x7f1acc0c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 --2- 172.21.15.47:0/748600141 >> v2:172.21.15.117:3300/0 conn(0x7f1acc155ef0 0x7f1acc0c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc0c5340 con 0x7f1acc0c6d90 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f1abc001670 con 0x7f1acc0c6d90 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 >> v1:172.21.15.47:6789/0 conn(0x7f1acc0c6d90 legacy=0x7f1acc0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1ab0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 0x7f1ab0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab0004d90 0x7f1ab00051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc0c50e0 con 0x7f1ab0003a00 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc156300 con 0x7f1ab0004d90 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.239+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab000bb40 con 0x7f1acc0c3b40 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1ab0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1ac3e00700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 0x7f1ab0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acb400700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab0004d90 0x7f1ab00051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 -- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 msgr2=0x7f1ab0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.243 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc0c3b40 0x7f1ab0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 -- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab0004d90 msgr2=0x7f1ab00051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1ab0004d90 0x7f1ab00051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 -- 172.21.15.47:0/748600141 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00035b0 con 0x7f1ab0003a00 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.240+0000 7f1acaa00700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1ab0003e70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1acc08cbb0 tx=0x7f1ab0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c253a0e2f7a9f67 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc007c40 con 0x7f1ab0003a00 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc00ce00 con 0x7f1ab0003a00 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1aca000700 1 -- 172.21.15.47:0/748600141 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc005ba0 con 0x7f1ab0003a00 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1ad1c00700 1 -- 172.21.15.47:0/748600141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 msgr2=0x7f1ab0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/748600141 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1ab0003e70 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f1acc08cbb0 tx=0x7f1ab0005880 comp rx=0 tx=0).stop 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1acb400700 1 -- 172.21.15.47:0/748600141 reap_dead start 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1ad1c00700 1 -- 172.21.15.47:0/748600141 shutdown_connections 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.241+0000 7f1ad1c00700 1 -- 172.21.15.47:0/748600141 >> 172.21.15.47:0/748600141 conn(0x7f1acc0c7620 msgr2=0x7f1acc0c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.242+0000 7f1ad1c00700 1 -- 172.21.15.47:0/748600141 shutdown_connections 2024-05-10T05:18:24.244 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.242+0000 7f1ad1c00700 1 -- 172.21.15.47:0/748600141 wait complete. 2024-05-10T05:18:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.244+0000 7f1ad1c00700 1 Processor -- start 2024-05-10T05:18:24.245 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.244+0000 7f1ad1c00700 1 -- start start 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1ad1c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1acc0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1ad1c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1acc158e80 0x7f1acc1ead30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1ad1c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc140310 0x7f1acc140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1ad1c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc152620 con 0x7f1ab0003a00 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1ad1c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc152790 con 0x7f1acc158e80 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1ad1c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1acc1eb890 con 0x7f1acc140310 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.245+0000 7f1acaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1acc0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1acc0ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55768/0 (socket says 172.21.15.47:55768) 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 -- 172.21.15.47:0/2484805650 learned_addr learned my addr 172.21.15.47:0/2484805650 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:24.247 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acb400700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc140310 0x7f1acc140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1ac3e00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1acc158e80 0x7f1acc1ead30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 -- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc140310 msgr2=0x7f1acc140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc140310 0x7f1acc140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 -- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1acc158e80 msgr2=0x7f1acc1ead30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1acc158e80 0x7f1acc1ead30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 -- 172.21.15.47:0/2484805650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1acc1eed80 con 0x7f1ab0003a00 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1ac3e00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1acc158e80 0x7f1acc1ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1acaa00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1acc0ca8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1abc008fd0 tx=0x7f1acc0c2b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.246+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc0070d0 con 0x7f1ab0003a00 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.247+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1abc007250 con 0x7f1ab0003a00 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.247+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1abc007600 con 0x7f1ab0003a00 2024-05-10T05:18:24.248 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.247+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1acc140c60 con 0x7f1ab0003a00 2024-05-10T05:18:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.247+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1acc1529a0 con 0x7f1ab0003a00 2024-05-10T05:18:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.248+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1acc074720 con 0x7f1ab0003a00 2024-05-10T05:18:24.249 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.249+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1abc01e430 con 0x7f1ab0003a00 2024-05-10T05:18:24.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.250+0000 7f1ac2a00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1aa806acc0 0x7f1aa806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.250+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1abc08adf0 con 0x7f1ab0003a00 2024-05-10T05:18:24.250 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.250+0000 7f1ac3e00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1aa806acc0 0x7f1aa806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.251 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.251+0000 7f1ac3e00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1aa806acc0 0x7f1aa806d1d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009160 tx=0x7f1ab4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:24.254 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.254+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1abc055ca0 con 0x7f1ab0003a00 2024-05-10T05:18:24.473 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.471+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1acc1eef10 con 0x7f1ab0003a00 2024-05-10T05:18:24.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.472+0000 7f1ac2a00700 1 -- 172.21.15.47:0/2484805650 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1abc0592c0 con 0x7f1ab0003a00 2024-05-10T05:18:24.627 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 64 2024-05-10T05:18:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1aa806acc0 msgr2=0x7f1aa806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1aa806acc0 0x7f1aa806d1d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4009160 tx=0x7f1ab4008040 comp rx=0 tx=0).stop 2024-05-10T05:18:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 msgr2=0x7f1acc0ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1acc0ca8e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1abc008fd0 tx=0x7f1acc0c2b40 comp rx=0 tx=0).stop 2024-05-10T05:18:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 shutdown_connections 2024-05-10T05:18:24.628 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1aa806acc0 0x7f1aa806d1d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1acc140310 0x7f1acc140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1ab0003a00 0x7f1acc0ca8e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 --2- 172.21.15.47:0/2484805650 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1acc158e80 0x7f1acc1ead30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.474+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 >> 172.21.15.47:0/2484805650 conn(0x7f1acc0c7620 msgr2=0x7f1acc0c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.475+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 shutdown_connections 2024-05-10T05:18:24.629 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.475+0000 7f1ad1c00700 1 -- 172.21.15.47:0/2484805650 wait complete. 2024-05-10T05:18:24.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-10T05:18:24.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.904+0000 7fe92f800700 1 Processor -- start 2024-05-10T05:18:24.905 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.904+0000 7fe92f800700 1 -- start start 2024-05-10T05:18:24.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe92f800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe92806c4c0 0x7fe9280c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe92f800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92806d640 con 0x7fe928152bb0 2024-05-10T05:18:24.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe92f800700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9280c9800 con 0x7fe9280c6cc0 2024-05-10T05:18:24.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe92f800700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe928152fc0 con 0x7fe92806c4c0 2024-05-10T05:18:24.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe927e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fe928152bb0 0x7fe92806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37218/0 (socket says 172.21.15.47:37218) 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe927e00700 1 -- 172.21.15.47:0/3355820091 learned_addr learned my addr 172.21.15.47:0/3355820091 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe92d800700 1 --2- 172.21.15.47:0/3355820091 >> v2:172.21.15.117:3300/0 conn(0x7fe92806c4c0 0x7fe9280c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934322914 0 0) 0x7fe92806d640 con 0x7fe928152bb0 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.906+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9100035b0 con 0x7fe928152bb0 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784091512 0 0) 0x7fe9100035b0 con 0x7fe928152bb0 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 >> v2:172.21.15.117:3300/0 conn(0x7fe92806c4c0 msgr2=0x7fe9280c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 --2- 172.21.15.47:0/3355820091 >> v2:172.21.15.117:3300/0 conn(0x7fe92806c4c0 0x7fe9280c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 >> v1:172.21.15.117:6789/0 conn(0x7fe9280c6cc0 legacy=0x7fe9280c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9280c8910 con 0x7fe928152bb0 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7fe914001670 con 0x7fe928152bb0 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 >> v1:172.21.15.47:6789/0 conn(0x7fe928152bb0 legacy=0x7fe92806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe910003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe910004850 0x7fe910004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9100053a0 0x7fe91000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe928152fc0 con 0x7fe910003a00 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91000c2d0 con 0x7fe9100053a0 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91000c490 con 0x7fe910004850 2024-05-10T05:18:24.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe92ce00700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe910003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe92d800700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9100053a0 0x7fe91000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.907+0000 7fe927e00700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe910004850 0x7fe910004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92ce00700 1 -- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe910004850 msgr2=0x7fe910004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92ce00700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe910004850 0x7fe910004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92ce00700 1 -- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9100053a0 msgr2=0x7fe91000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92ce00700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9100053a0 0x7fe91000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92d800700 1 -- 172.21.15.47:0/3355820091 reap_dead start 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92ce00700 1 -- 172.21.15.47:0/3355820091 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9100035b0 con 0x7fe910003a00 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe92ce00700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe910003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0017c0 tx=0x7fe910005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681a28c9fa70db6b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:24.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0052d0 con 0x7fe910003a00 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c005450 con 0x7fe910003a00 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.908+0000 7fe927400700 1 -- 172.21.15.47:0/3355820091 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0038c0 con 0x7fe910003a00 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 -- 172.21.15.47:0/3355820091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 msgr2=0x7fe910003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe910003e70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0017c0 tx=0x7fe910005880 comp rx=0 tx=0).stop 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 -- 172.21.15.47:0/3355820091 shutdown_connections 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 --2- 172.21.15.47:0/3355820091 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe910003e70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 -- 172.21.15.47:0/3355820091 >> 172.21.15.47:0/3355820091 conn(0x7fe9280ca960 msgr2=0x7fe9280cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 -- 172.21.15.47:0/3355820091 shutdown_connections 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.909+0000 7fe92f800700 1 -- 172.21.15.47:0/3355820091 wait complete. 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.911+0000 7fe92f800700 1 Processor -- start 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.912+0000 7fe92f800700 1 -- start start 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92f800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe9281ee520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92f800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9280bf690 0x7fe9280c4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92f800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9280c4980 0x7fe92814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92f800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280be7f0 con 0x7fe910003a00 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92f800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280c2dd0 con 0x7fe9280c4980 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92f800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9280be510 con 0x7fe9280bf690 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92ce00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe9281ee520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92ce00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe9281ee520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55796/0 (socket says 172.21.15.47:55796) 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92ce00700 1 -- 172.21.15.47:0/2193347156 learned_addr learned my addr 172.21.15.47:0/2193347156 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe927e00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9280bf690 0x7fe9280c4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.913+0000 7fe92d800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9280c4980 0x7fe92814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92ce00700 1 -- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9280bf690 msgr2=0x7fe9280c4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92ce00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9280bf690 0x7fe9280c4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92ce00700 1 -- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9280c4980 msgr2=0x7fe92814c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92ce00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9280c4980 0x7fe92814c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:24.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92ce00700 1 -- 172.21.15.47:0/2193347156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9281eeed0 con 0x7fe910003a00 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92ce00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe9281ee520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c2a0 tx=0x7fe91c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c001290 con 0x7fe910003a00 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c007040 con 0x7fe910003a00 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0073d0 con 0x7fe910003a00 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9280c28b0 con 0x7fe910003a00 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.914+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9281ef1b0 con 0x7fe910003a00 2024-05-10T05:18:24.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.915+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280bf480 con 0x7fe910003a00 2024-05-10T05:18:24.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.916+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe91c007530 con 0x7fe910003a00 2024-05-10T05:18:24.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.918+0000 7fe924c00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe90806ac90 0x7fe90806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:24.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.918+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe91c08a1c0 con 0x7fe910003a00 2024-05-10T05:18:24.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.918+0000 7fe927e00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe90806ac90 0x7fe90806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:24.921 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.919+0000 7fe927e00700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe90806ac90 0x7fe90806d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe92814dd10 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:24.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:24.923+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe9280bf480 con 0x7fe910003a00 2024-05-10T05:18:25.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.139+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe9280bf480 con 0x7fe910003a00 2024-05-10T05:18:25.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.140+0000 7fe924c00700 1 -- 172.21.15.47:0/2193347156 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe91c021020 con 0x7fe910003a00 2024-05-10T05:18:25.141 INFO:teuthology.orchestra.run.smithi047.stdout:pg_num: 32 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe90806ac90 msgr2=0x7fe90806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe90806ac90 0x7fe90806d1a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe92814dd10 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 msgr2=0x7fe9281ee520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe9281ee520 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c2a0 tx=0x7fe91c001120 comp rx=0 tx=0).stop 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 shutdown_connections 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe9280c4980 0x7fe92814c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe910003a00 0x7fe9281ee520 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe90806ac90 0x7fe90806d1a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 --2- 172.21.15.47:0/2193347156 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe9280bf690 0x7fe9280c4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 >> 172.21.15.47:0/2193347156 conn(0x7fe9280ca960 msgr2=0x7fe928156e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 shutdown_connections 2024-05-10T05:18:25.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.142+0000 7fe92f800700 1 -- 172.21.15.47:0/2193347156 wait complete. 2024-05-10T05:18:25.170 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-10T05:18:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.443+0000 7fe252a00700 1 Processor -- start 2024-05-10T05:18:25.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.443+0000 7fe252a00700 1 -- start start 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.444+0000 7fe252a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe24c155ef0 0x7fe24c0c3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.444+0000 7fe252a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fe24c0c3b40 0x7fe24c0c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe252a00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c0c31e0 con 0x7fe24c0c6d90 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe252a00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0c50e0 con 0x7fe24c155ef0 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe252a00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c156300 con 0x7fe24c0c3b40 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe24c155ef0 0x7fe24c0c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fe24c155ef0 0x7fe24c0c3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55798/0 (socket says 172.21.15.47:55798) 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 -- 172.21.15.47:0/3150823350 learned_addr learned my addr 172.21.15.47:0/3150823350 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:25.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe250a00700 1 --2- 172.21.15.47:0/3150823350 >> v2:172.21.15.117:3300/0 conn(0x7fe24c0c3b40 0x7fe24c0c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 -- 172.21.15.47:0/3150823350 >> v2:172.21.15.117:3300/0 conn(0x7fe24c0c3b40 msgr2=0x7fe24c0c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 --2- 172.21.15.47:0/3150823350 >> v2:172.21.15.117:3300/0 conn(0x7fe24c0c3b40 0x7fe24c0c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 -- 172.21.15.47:0/3150823350 >> v1:172.21.15.117:6789/0 conn(0x7fe24c0c6d90 legacy=0x7fe24c0ca8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.445+0000 7fe24b400700 1 -- 172.21.15.47:0/3150823350 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0c5340 con 0x7fe24c155ef0 2024-05-10T05:18:25.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.446+0000 7fe24b400700 1 --2- 172.21.15.47:0/3150823350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c155ef0 0x7fe24c0c3600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe24c152fa0 tx=0x7fe238009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76917b64b8341c10 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.446+0000 7fe24aa00700 1 -- 172.21.15.47:0/3150823350 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238004230 con 0x7fe24c155ef0 2024-05-10T05:18:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.446+0000 7fe24aa00700 1 -- 172.21.15.47:0/3150823350 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238004390 con 0x7fe24c155ef0 2024-05-10T05:18:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.446+0000 7fe24aa00700 1 -- 172.21.15.47:0/3150823350 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2380036a0 con 0x7fe24c155ef0 2024-05-10T05:18:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 -- 172.21.15.47:0/3150823350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c155ef0 msgr2=0x7fe24c0c3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 --2- 172.21.15.47:0/3150823350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c155ef0 0x7fe24c0c3600 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe24c152fa0 tx=0x7fe238009bd0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 -- 172.21.15.47:0/3150823350 shutdown_connections 2024-05-10T05:18:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 --2- 172.21.15.47:0/3150823350 >> v2:172.21.15.117:3300/0 conn(0x7fe24c0c3b40 0x7fe24c0c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 --2- 172.21.15.47:0/3150823350 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c155ef0 0x7fe24c0c3600 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 -- 172.21.15.47:0/3150823350 >> 172.21.15.47:0/3150823350 conn(0x7fe24c0c7620 msgr2=0x7fe24c0c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 -- 172.21.15.47:0/3150823350 shutdown_connections 2024-05-10T05:18:25.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.447+0000 7fe252a00700 1 -- 172.21.15.47:0/3150823350 wait complete. 2024-05-10T05:18:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.449+0000 7fe252a00700 1 Processor -- start 2024-05-10T05:18:25.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.449+0000 7fe252a00700 1 -- start start 2024-05-10T05:18:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe252a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 0x7fe24c140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe252a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe24c0c6d90 0x7fe24c0c1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe252a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe24c155ef0 0x7fe24c1eb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe252a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0bfe00 con 0x7fe24c0c3b40 2024-05-10T05:18:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe252a00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c158e70 con 0x7fe24c155ef0 2024-05-10T05:18:25.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe252a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c159960 con 0x7fe24c0c6d90 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 0x7fe24c140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 0x7fe24c140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55814/0 (socket says 172.21.15.47:55814) 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 -- 172.21.15.47:0/477394462 learned_addr learned my addr 172.21.15.47:0/477394462 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe250a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe24c155ef0 0x7fe24c1eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24b400700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe24c0c6d90 0x7fe24c0c1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 -- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe24c0c6d90 msgr2=0x7fe24c0c1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe24c0c6d90 0x7fe24c0c1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 -- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe24c155ef0 msgr2=0x7fe24c1eb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe24c155ef0 0x7fe24c1eb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.451+0000 7fe24be00700 1 -- 172.21.15.47:0/477394462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009550 con 0x7fe24c0c3b40 2024-05-10T05:18:25.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.452+0000 7fe24be00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 0x7fe24c140d10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00b480 tx=0x7fe23c00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.452+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c011830 con 0x7fe24c0c3b40 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.452+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c011990 con 0x7fe24c0c3b40 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.452+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c158a30 con 0x7fe24c0c3b40 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.452+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c011d40 con 0x7fe24c0c3b40 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.452+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c1593a0 con 0x7fe24c0c3b40 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.453+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c074720 con 0x7fe24c0c3b40 2024-05-10T05:18:25.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.454+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe23c01a400 con 0x7fe24c0c3b40 2024-05-10T05:18:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.455+0000 7fe243e00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe22c06acc0 0x7fe22c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.455+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe23c0892c0 con 0x7fe24c0c3b40 2024-05-10T05:18:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.456+0000 7fe24b400700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe22c06acc0 0x7fe22c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:25.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.456+0000 7fe24b400700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe22c06acc0 0x7fe22c06d1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe24c06c700 tx=0x7fe238008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:25.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.460+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fe23c054040 con 0x7fe24c0c3b40 2024-05-10T05:18:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.692+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe24c0b0130 con 0x7fe24c0c3b40 2024-05-10T05:18:25.693 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.693+0000 7fe243e00700 1 -- 172.21.15.47:0/477394462 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe23c057660 con 0x7fe24c0c3b40 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe22c06acc0 msgr2=0x7fe22c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe22c06acc0 0x7fe22c06d1d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe24c06c700 tx=0x7fe238008030 comp rx=0 tx=0).stop 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 msgr2=0x7fe24c140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 0x7fe24c140d10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00b480 tx=0x7fe23c00b790 comp rx=0 tx=0).stop 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 shutdown_connections 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fe24c155ef0 0x7fe24c1eb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fe24c0c3b40 0x7fe24c140d10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fe22c06acc0 0x7fe22c06d1d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.696 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 --2- 172.21.15.47:0/477394462 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fe24c0c6d90 0x7fe24c0c1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:25.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 >> 172.21.15.47:0/477394462 conn(0x7fe24c0c7620 msgr2=0x7fe24c0ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:25.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 shutdown_connections 2024-05-10T05:18:25.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:25.695+0000 7fe252a00700 1 -- 172.21.15.47:0/477394462 wait complete. 2024-05-10T05:18:25.697 INFO:teuthology.orchestra.run.smithi047.stderr:listed 0 entries 2024-05-10T05:18:25.725 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-05-10T05:18:25.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T05:18:25.725 DEBUG:teuthology.orchestra.run.smithi117:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-05-10T05:18:25.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T05:18:25.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T05:18:25.891 DEBUG:teuthology.orchestra.run.smithi117:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-05-10T05:18:26.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T05:18:26.012 DEBUG:teuthology.orchestra.run.smithi117:> ip netns list 2024-05-10T05:18:26.108 INFO:teuthology.orchestra.run.smithi117.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-05-10T05:18:26.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T05:18:26.109 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-05-10T05:18:26.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-10T05:18:26.189 DEBUG:teuthology.orchestra.run.smithi117:> sudo ip link delete ceph-brx 2024-05-10T05:18:26.303 DEBUG:teuthology.parallel:result is None 2024-05-10T05:18:26.303 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-10T05:18:26.314 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-10T05:18:26.314 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:18:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.584+0000 7f89f4000700 1 Processor -- start 2024-05-10T05:18:26.585 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.584+0000 7f89f4000700 1 -- start start 2024-05-10T05:18:26.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f4000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89ec0c23b0 0x7f89ec155670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:26.587 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f4000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f89ec155bb0 0x7f89ec155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f4000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ec0c17d0 con 0x7f89ec152d40 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f4000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0c30c0 con 0x7f89ec0c23b0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f4000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ec0726d0 con 0x7f89ec155bb0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f0c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f89ec0c23b0 0x7f89ec155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f1600700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f89ec152d40 0x7f89ec06abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37226/0 (socket says 172.21.15.47:37226) 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f1600700 1 -- 172.21.15.47:0/4186040310 learned_addr learned my addr 172.21.15.47:0/4186040310 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.586+0000 7f89f2000700 1 --2- 172.21.15.47:0/4186040310 >> v2:172.21.15.117:3300/0 conn(0x7f89ec155bb0 0x7f89ec155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89f0c00700 1 -- 172.21.15.47:0/4186040310 >> v2:172.21.15.117:3300/0 conn(0x7f89ec155bb0 msgr2=0x7f89ec155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89f0c00700 1 --2- 172.21.15.47:0/4186040310 >> v2:172.21.15.117:3300/0 conn(0x7f89ec155bb0 0x7f89ec155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89f0c00700 1 -- 172.21.15.47:0/4186040310 >> v1:172.21.15.47:6789/0 conn(0x7f89ec152d40 legacy=0x7f89ec06abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89f0c00700 1 -- 172.21.15.47:0/4186040310 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec0c1ab0 con 0x7f89ec0c23b0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89ebe00700 1 -- 172.21.15.47:0/4186040310 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277928329 0 0) 0x7f89ec0c17d0 con 0x7f89ec152d40 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89f0c00700 1 --2- 172.21.15.47:0/4186040310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec155670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0c1210 tx=0x7f89d8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb99cf29cf9817a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89ebe00700 1 -- 172.21.15.47:0/4186040310 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8011830 con 0x7f89ec0c23b0 2024-05-10T05:18:26.588 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89ebe00700 1 -- 172.21.15.47:0/4186040310 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8011990 con 0x7f89ec0c23b0 2024-05-10T05:18:26.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.587+0000 7f89ebe00700 1 -- 172.21.15.47:0/4186040310 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8011d20 con 0x7f89ec0c23b0 2024-05-10T05:18:26.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 -- 172.21.15.47:0/4186040310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 msgr2=0x7f89ec155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:26.589 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 --2- 172.21.15.47:0/4186040310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec155670 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0c1210 tx=0x7f89d8009b20 comp rx=0 tx=0).stop 2024-05-10T05:18:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 -- 172.21.15.47:0/4186040310 shutdown_connections 2024-05-10T05:18:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 --2- 172.21.15.47:0/4186040310 >> v2:172.21.15.117:3300/0 conn(0x7f89ec155bb0 0x7f89ec155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 --2- 172.21.15.47:0/4186040310 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec155670 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 -- 172.21.15.47:0/4186040310 >> 172.21.15.47:0/4186040310 conn(0x7f89ec0c4220 msgr2=0x7f89ec0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 -- 172.21.15.47:0/4186040310 shutdown_connections 2024-05-10T05:18:26.590 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.588+0000 7f89f4000700 1 -- 172.21.15.47:0/4186040310 wait complete. 2024-05-10T05:18:26.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.591+0000 7f89f4000700 1 Processor -- start 2024-05-10T05:18:26.591 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.591+0000 7f89f4000700 1 -- start start 2024-05-10T05:18:26.594 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f4000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec14e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f4000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ec152d40 0x7f89ec0ac620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f4000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ec155bb0 0x7f89ec1eb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f4000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec14f620 con 0x7f89ec0c23b0 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f4000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec14f410 con 0x7f89ec155bb0 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f4000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ec0ab3f0 con 0x7f89ec152d40 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f1600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec14e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f1600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec14e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55842/0 (socket says 172.21.15.47:55842) 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.593+0000 7f89f1600700 1 -- 172.21.15.47:0/1819537625 learned_addr learned my addr 172.21.15.47:0/1819537625 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f0c00700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ec152d40 0x7f89ec0ac620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f2000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ec155bb0 0x7f89ec1eb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f1600700 1 -- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ec152d40 msgr2=0x7f89ec0ac620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f1600700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ec152d40 0x7f89ec0ac620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.595 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f1600700 1 -- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ec155bb0 msgr2=0x7f89ec1eb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f1600700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ec155bb0 0x7f89ec1eb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f1600700 1 -- 172.21.15.47:0/1819537625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80094a0 con 0x7f89ec0c23b0 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f0c00700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ec152d40 0x7f89ec0ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f1600700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec14e2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c480 tx=0x7f89e000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e00074e0 con 0x7f89ec0c23b0 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e0007640 con 0x7f89ec0c23b0 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ec0c7110 con 0x7f89ec0c23b0 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e0005a70 con 0x7f89ec0c23b0 2024-05-10T05:18:26.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.594+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ec1ec490 con 0x7f89ec0c23b0 2024-05-10T05:18:26.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.595+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ec0c3fc0 con 0x7f89ec0c23b0 2024-05-10T05:18:26.597 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.597+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f89e0005bd0 con 0x7f89ec0c23b0 2024-05-10T05:18:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.597+0000 7f89e9600700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f89cc06ac90 0x7f89cc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.598+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89e0088d10 con 0x7f89ec0c23b0 2024-05-10T05:18:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.598+0000 7f89f0c00700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f89cc06ac90 0x7f89cc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:26.598 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.599+0000 7f89f0c00700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f89cc06ac90 0x7f89cc06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89d80090b0 tx=0x7f89d801c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:26.602 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.602+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f89e0053a00 con 0x7f89ec0c23b0 2024-05-10T05:18:26.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.816+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89ec156780 con 0x7f89cc06ac90 2024-05-10T05:18:26.848 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.847+0000 7f89e9600700 1 -- 172.21.15.47:0/1819537625 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372017 (secure 0 0 0) 0x7f89ec156780 con 0x7f89cc06ac90 2024-05-10T05:18:26.854 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:26.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f89cc06ac90 msgr2=0x7f89cc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:26.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f89cc06ac90 0x7f89cc06d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f89d80090b0 tx=0x7f89d801c040 comp rx=0 tx=0).stop 2024-05-10T05:18:26.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 msgr2=0x7f89ec14e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:26.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec14e2e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89e000c480 tx=0x7f89e000c840 comp rx=0 tx=0).stop 2024-05-10T05:18:26.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 shutdown_connections 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f89ec155bb0 0x7f89ec1eb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f89ec0c23b0 0x7f89ec14e2e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f89cc06ac90 0x7f89cc06d1a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 --2- 172.21.15.47:0/1819537625 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f89ec152d40 0x7f89ec0ac620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 >> 172.21.15.47:0/1819537625 conn(0x7f89ec0c4220 msgr2=0x7f89ec0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.852+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 shutdown_connections 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:26.853+0000 7f89f4000700 1 -- 172.21.15.47:0/1819537625 wait complete. 2024-05-10T05:18:26.858 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:18:26.881 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":822,"stamp":"2024-05-10T05:18:26.688379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239161496,"num_objects":162,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":4750,"num_read_kb":580552,"num_write":359263,"num_write_kb":31012754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":528967,"ondisk_log_size":528967,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7031924,"kb_used_data":510900,"kb_used_omap":12,"kb_used_meta":6520947,"kb_avail":747942796,"statfs":{"total":773094113280,"available":765893423104,"internally_reserved":0,"allocated":523161600,"data_stored":521673140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6677450296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,5,5,16,13,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-286034677,"num_objects":-2340,"num_object_clones":0,"num_object_copies":-8168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2340,"num_whiteouts":0,"num_read":12,"num_read_kb":252,"num_write":3957,"num_write_kb":51541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.3f","version":"28'1979","reported_seq":2007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.435363+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T05:18:21.435363+0000","last_peered":"2024-05-10T05:18:21.435363+0000","last_clean":"2024-05-10T05:18:21.435363+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:18:21.435363+0000","last_undegraded":"2024-05-10T05:18:21.435363+0000","last_fullsized":"2024-05-10T05:18:21.435363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1976","reported_seq":2004,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.385071+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T05:18:21.385071+0000","last_peered":"2024-05-10T05:18:21.385071+0000","last_clean":"2024-05-10T05:18:21.385071+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:21.385071+0000","last_undegraded":"2024-05-10T05:18:21.385071+0000","last_fullsized":"2024-05-10T05:18:21.385071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2121","reported_seq":2149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.418630+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T05:18:21.418630+0000","last_peered":"2024-05-10T05:18:21.418630+0000","last_clean":"2024-05-10T05:18:21.418630+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:18:21.418630+0000","last_undegraded":"2024-05-10T05:18:21.418630+0000","last_fullsized":"2024-05-10T05:18:21.418630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2096","reported_seq":2125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.615639+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T05:18:21.615639+0000","last_peered":"2024-05-10T05:18:21.615639+0000","last_clean":"2024-05-10T05:18:21.615639+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:18:21.615639+0000","last_undegraded":"2024-05-10T05:18:21.615639+0000","last_fullsized":"2024-05-10T05:18:21.615639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2057","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646797+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T05:18:21.646797+0000","last_peered":"2024-05-10T05:18:21.646797+0000","last_clean":"2024-05-10T05:18:21.646797+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:18:21.646797+0000","last_undegraded":"2024-05-10T05:18:21.646797+0000","last_fullsized":"2024-05-10T05:18:21.646797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1962","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.623718+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T05:18:21.623718+0000","last_peered":"2024-05-10T05:18:21.623718+0000","last_clean":"2024-05-10T05:18:21.623718+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:18:21.623718+0000","last_undegraded":"2024-05-10T05:18:21.623718+0000","last_fullsized":"2024-05-10T05:18:21.623718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1962,"log_dups_size":0,"ondisk_log_size":1962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2001","reported_seq":2027,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.571299+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T05:18:21.571299+0000","last_peered":"2024-05-10T05:18:21.571299+0000","last_clean":"2024-05-10T05:18:21.571299+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:18:21.571299+0000","last_undegraded":"2024-05-10T05:18:21.571299+0000","last_fullsized":"2024-05-10T05:18:21.571299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2001,"log_dups_size":0,"ondisk_log_size":2001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2014","reported_seq":2040,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.692324+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T05:18:21.692324+0000","last_peered":"2024-05-10T05:18:21.692324+0000","last_clean":"2024-05-10T05:18:21.692324+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:18:21.692324+0000","last_undegraded":"2024-05-10T05:18:21.692324+0000","last_fullsized":"2024-05-10T05:18:21.692324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2014,"log_dups_size":0,"ondisk_log_size":2014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2072","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.463408+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T05:18:21.463408+0000","last_peered":"2024-05-10T05:18:21.463408+0000","last_clean":"2024-05-10T05:18:21.463408+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:18:21.463408+0000","last_undegraded":"2024-05-10T05:18:21.463408+0000","last_fullsized":"2024-05-10T05:18:21.463408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2074","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.378924+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T05:18:21.378924+0000","last_peered":"2024-05-10T05:18:21.378924+0000","last_clean":"2024-05-10T05:18:21.378924+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:18:21.378924+0000","last_undegraded":"2024-05-10T05:18:21.378924+0000","last_fullsized":"2024-05-10T05:18:21.378924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1952","reported_seq":1978,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.640372+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T05:18:21.640372+0000","last_peered":"2024-05-10T05:18:21.640372+0000","last_clean":"2024-05-10T05:18:21.640372+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:21.640372+0000","last_undegraded":"2024-05-10T05:18:21.640372+0000","last_fullsized":"2024-05-10T05:18:21.640372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.011781+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T05:18:26.011781+0000","last_peered":"2024-05-10T05:18:26.011781+0000","last_clean":"2024-05-10T05:18:26.011781+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:26.011781+0000","last_undegraded":"2024-05-10T05:18:26.011781+0000","last_fullsized":"2024-05-10T05:18:26.011781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2019","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.180961+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T05:18:21.180961+0000","last_peered":"2024-05-10T05:18:21.180961+0000","last_clean":"2024-05-10T05:18:21.180961+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:21.180961+0000","last_undegraded":"2024-05-10T05:18:21.180961+0000","last_fullsized":"2024-05-10T05:18:21.180961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'1998","reported_seq":2025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.492776+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T05:18:21.492776+0000","last_peered":"2024-05-10T05:18:21.492776+0000","last_clean":"2024-05-10T05:18:21.492776+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:18:21.492776+0000","last_undegraded":"2024-05-10T05:18:21.492776+0000","last_fullsized":"2024-05-10T05:18:21.492776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2101","reported_seq":2128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.391747+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T05:18:21.391747+0000","last_peered":"2024-05-10T05:18:21.391747+0000","last_clean":"2024-05-10T05:18:21.391747+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:21.391747+0000","last_undegraded":"2024-05-10T05:18:21.391747+0000","last_fullsized":"2024-05-10T05:18:21.391747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1983","reported_seq":2010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.329214+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T05:18:21.329214+0000","last_peered":"2024-05-10T05:18:21.329214+0000","last_clean":"2024-05-10T05:18:21.329214+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:18:21.329214+0000","last_undegraded":"2024-05-10T05:18:21.329214+0000","last_fullsized":"2024-05-10T05:18:21.329214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.534366+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T05:18:21.534366+0000","last_peered":"2024-05-10T05:18:21.534366+0000","last_clean":"2024-05-10T05:18:21.534366+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:21.534366+0000","last_undegraded":"2024-05-10T05:18:21.534366+0000","last_fullsized":"2024-05-10T05:18:21.534366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1984","reported_seq":2011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.516969+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T05:18:21.516969+0000","last_peered":"2024-05-10T05:18:21.516969+0000","last_clean":"2024-05-10T05:18:21.516969+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:21.516969+0000","last_undegraded":"2024-05-10T05:18:21.516969+0000","last_fullsized":"2024-05-10T05:18:21.516969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2096","reported_seq":2123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.411806+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T05:18:21.411806+0000","last_peered":"2024-05-10T05:18:21.411806+0000","last_clean":"2024-05-10T05:18:21.411806+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:18:21.411806+0000","last_undegraded":"2024-05-10T05:18:21.411806+0000","last_fullsized":"2024-05-10T05:18:21.411806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.607874+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T05:18:21.607874+0000","last_peered":"2024-05-10T05:18:21.607874+0000","last_clean":"2024-05-10T05:18:21.607874+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:18:21.607874+0000","last_undegraded":"2024-05-10T05:18:21.607874+0000","last_fullsized":"2024-05-10T05:18:21.607874+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1884","reported_seq":1913,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:11.384889+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T05:18:11.384889+0000","last_peered":"2024-05-10T05:18:11.384889+0000","last_clean":"2024-05-10T05:18:11.384889+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:11.384889+0000","last_undegraded":"2024-05-10T05:18:11.384889+0000","last_fullsized":"2024-05-10T05:18:11.384889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1884,"log_dups_size":0,"ondisk_log_size":1884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1908,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2034","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.546869+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T05:18:21.546869+0000","last_peered":"2024-05-10T05:18:21.546869+0000","last_clean":"2024-05-10T05:18:21.546869+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:18:21.546869+0000","last_undegraded":"2024-05-10T05:18:21.546869+0000","last_fullsized":"2024-05-10T05:18:21.546869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7649,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.752342+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T05:18:21.752342+0000","last_peered":"2024-05-10T05:18:21.752342+0000","last_clean":"2024-05-10T05:18:21.752342+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:18:21.752342+0000","last_undegraded":"2024-05-10T05:18:21.752342+0000","last_fullsized":"2024-05-10T05:18:21.752342+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6434","reported_seq":6464,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.263876+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T05:18:23.263876+0000","last_peered":"2024-05-10T05:18:23.263876+0000","last_clean":"2024-05-10T05:18:23.263876+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:23.263876+0000","last_undegraded":"2024-05-10T05:18:23.263876+0000","last_fullsized":"2024-05-10T05:18:23.263876+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6334,"log_dups_size":0,"ondisk_log_size":6334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2034","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.866776+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T05:18:20.866776+0000","last_peered":"2024-05-10T05:18:20.866776+0000","last_clean":"2024-05-10T05:18:20.866776+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:20.866776+0000","last_undegraded":"2024-05-10T05:18:20.866776+0000","last_fullsized":"2024-05-10T05:18:20.866776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7722,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.767261+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T05:18:21.767261+0000","last_peered":"2024-05-10T05:18:21.767261+0000","last_clean":"2024-05-10T05:18:21.767261+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:18:21.767261+0000","last_undegraded":"2024-05-10T05:18:21.767261+0000","last_fullsized":"2024-05-10T05:18:21.767261+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9861","reported_seq":9888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:15.507820+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T05:18:15.507820+0000","last_peered":"2024-05-10T05:18:15.507820+0000","last_clean":"2024-05-10T05:18:15.507820+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:15.507820+0000","last_undegraded":"2024-05-10T05:18:15.507820+0000","last_fullsized":"2024-05-10T05:18:15.507820+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9864,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2085","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.661342+0000","last_change":"2024-05-10T04:52:40.336526+0000","last_active":"2024-05-10T05:18:21.661342+0000","last_peered":"2024-05-10T05:18:21.661342+0000","last_clean":"2024-05-10T05:18:21.661342+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:18:21.661342+0000","last_undegraded":"2024-05-10T05:18:21.661342+0000","last_fullsized":"2024-05-10T05:18:21.661342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:27.704427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.835011+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T05:18:25.835011+0000","last_peered":"2024-05-10T05:18:25.835011+0000","last_clean":"2024-05-10T05:18:25.835011+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:25.835011+0000","last_undegraded":"2024-05-10T05:18:25.835011+0000","last_fullsized":"2024-05-10T05:18:25.835011+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5467","reported_seq":5494,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:41.051134+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T05:17:41.051134+0000","last_peered":"2024-05-10T05:17:41.051134+0000","last_clean":"2024-05-10T05:17:41.051134+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:17:41.051134+0000","last_undegraded":"2024-05-10T05:17:41.051134+0000","last_fullsized":"2024-05-10T05:17:41.051134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5467,"log_dups_size":0,"ondisk_log_size":5467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5467,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2019","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.549021+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T05:18:20.549021+0000","last_peered":"2024-05-10T05:18:20.549021+0000","last_clean":"2024-05-10T05:18:20.549021+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:18:20.549021+0000","last_undegraded":"2024-05-10T05:18:20.549021+0000","last_fullsized":"2024-05-10T05:18:20.549021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7512","reported_seq":7575,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.445358+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T05:18:21.445358+0000","last_peered":"2024-05-10T05:18:21.445358+0000","last_clean":"2024-05-10T05:18:21.445358+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:18:21.445358+0000","last_undegraded":"2024-05-10T05:18:21.445358+0000","last_fullsized":"2024-05-10T05:18:21.445358+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6298,"log_dups_size":0,"ondisk_log_size":6298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5293,"num_write_kb":975875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8788","reported_seq":8815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.292792+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T05:18:23.292792+0000","last_peered":"2024-05-10T05:18:23.292792+0000","last_clean":"2024-05-10T05:18:23.292792+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:23.292792+0000","last_undegraded":"2024-05-10T05:18:23.292792+0000","last_fullsized":"2024-05-10T05:18:23.292792+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.946403+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T05:18:25.946403+0000","last_peered":"2024-05-10T05:18:25.946403+0000","last_clean":"2024-05-10T05:18:25.946403+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:25.946403+0000","last_undegraded":"2024-05-10T05:18:25.946403+0000","last_fullsized":"2024-05-10T05:18:25.946403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7545,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771999+0000","last_change":"2024-05-10T04:52:40.388737+0000","last_active":"2024-05-10T05:18:21.771999+0000","last_peered":"2024-05-10T05:18:21.771999+0000","last_clean":"2024-05-10T05:18:21.771999+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:21.771999+0000","last_undegraded":"2024-05-10T05:18:21.771999+0000","last_fullsized":"2024-05-10T05:18:21.771999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:03:27.377522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9788","reported_seq":9815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.287881+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T05:18:23.287881+0000","last_peered":"2024-05-10T05:18:23.287881+0000","last_clean":"2024-05-10T05:18:23.287881+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:23.287881+0000","last_undegraded":"2024-05-10T05:18:23.287881+0000","last_fullsized":"2024-05-10T05:18:23.287881+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7988,"log_dups_size":0,"ondisk_log_size":7988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2023","reported_seq":2049,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.731928+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T05:18:21.731928+0000","last_peered":"2024-05-10T05:18:21.731928+0000","last_clean":"2024-05-10T05:18:21.731928+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:21.731928+0000","last_undegraded":"2024-05-10T05:18:21.731928+0000","last_fullsized":"2024-05-10T05:18:21.731928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7234","reported_seq":7476,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.453872+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T05:18:21.453872+0000","last_peered":"2024-05-10T05:18:21.453872+0000","last_clean":"2024-05-10T05:18:21.453872+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:18:21.453872+0000","last_undegraded":"2024-05-10T05:18:21.453872+0000","last_fullsized":"2024-05-10T05:18:21.453872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7234,"log_dups_size":0,"ondisk_log_size":7234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5147,"num_write_kb":870087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4833","reported_seq":4860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.260650+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T05:18:23.260650+0000","last_peered":"2024-05-10T05:18:23.260650+0000","last_clean":"2024-05-10T05:18:23.260650+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:23.260650+0000","last_undegraded":"2024-05-10T05:18:23.260650+0000","last_fullsized":"2024-05-10T05:18:23.260650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2098","reported_seq":2124,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.636425+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T05:18:21.636425+0000","last_peered":"2024-05-10T05:18:21.636425+0000","last_clean":"2024-05-10T05:18:21.636425+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:21.636425+0000","last_undegraded":"2024-05-10T05:18:21.636425+0000","last_fullsized":"2024-05-10T05:18:21.636425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.691448+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T05:18:21.691448+0000","last_peered":"2024-05-10T05:18:21.691448+0000","last_clean":"2024-05-10T05:18:21.691448+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:18:21.691448+0000","last_undegraded":"2024-05-10T05:18:21.691448+0000","last_fullsized":"2024-05-10T05:18:21.691448+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9719","reported_seq":9746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:11.532711+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T05:16:11.532711+0000","last_peered":"2024-05-10T05:16:11.532711+0000","last_clean":"2024-05-10T05:16:11.532711+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:16:11.532711+0000","last_undegraded":"2024-05-10T05:16:11.532711+0000","last_fullsized":"2024-05-10T05:16:11.532711+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7519,"log_dups_size":0,"ondisk_log_size":7519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2000","reported_seq":2026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.264771+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T05:18:21.264771+0000","last_peered":"2024-05-10T05:18:21.264771+0000","last_clean":"2024-05-10T05:18:21.264771+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:21.264771+0000","last_undegraded":"2024-05-10T05:18:21.264771+0000","last_fullsized":"2024-05-10T05:18:21.264771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.738124+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T05:18:21.738124+0000","last_peered":"2024-05-10T05:18:21.738124+0000","last_clean":"2024-05-10T05:18:21.738124+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:18:21.738124+0000","last_undegraded":"2024-05-10T05:18:21.738124+0000","last_fullsized":"2024-05-10T05:18:21.738124+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6180","reported_seq":6949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.266389+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T05:18:23.266389+0000","last_peered":"2024-05-10T05:18:23.266389+0000","last_clean":"2024-05-10T05:18:23.266389+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:23.266389+0000","last_undegraded":"2024-05-10T05:18:23.266389+0000","last_fullsized":"2024-05-10T05:18:23.266389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11268527,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6176,"num_write_kb":47861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2036","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.673680+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T05:18:21.673680+0000","last_peered":"2024-05-10T05:18:21.673680+0000","last_clean":"2024-05-10T05:18:21.673680+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:18:21.673680+0000","last_undegraded":"2024-05-10T05:18:21.673680+0000","last_fullsized":"2024-05-10T05:18:21.673680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7404","reported_seq":7465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.352634+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T05:18:21.352634+0000","last_peered":"2024-05-10T05:18:21.352634+0000","last_clean":"2024-05-10T05:18:21.352634+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:18:21.352634+0000","last_undegraded":"2024-05-10T05:18:21.352634+0000","last_fullsized":"2024-05-10T05:18:21.352634+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5300,"num_write_kb":989171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6454","reported_seq":6481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:02.756886+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T05:17:02.756886+0000","last_peered":"2024-05-10T05:17:02.756886+0000","last_clean":"2024-05-10T05:17:02.756886+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:17:02.756886+0000","last_undegraded":"2024-05-10T05:17:02.756886+0000","last_fullsized":"2024-05-10T05:17:02.756886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6454,"log_dups_size":0,"ondisk_log_size":6454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6456,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2049","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.481740+0000","last_change":"2024-05-10T04:52:41.276730+0000","last_active":"2024-05-10T05:18:21.481740+0000","last_peered":"2024-05-10T05:18:21.481740+0000","last_clean":"2024-05-10T05:18:21.481740+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:21.481740+0000","last_undegraded":"2024-05-10T05:18:21.481740+0000","last_fullsized":"2024-05-10T05:18:21.481740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:15:47.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.303883+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T05:18:21.303883+0000","last_peered":"2024-05-10T05:18:21.303883+0000","last_clean":"2024-05-10T05:18:21.303883+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:21.303883+0000","last_undegraded":"2024-05-10T05:18:21.303883+0000","last_fullsized":"2024-05-10T05:18:21.303883+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5954","reported_seq":5982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.792542+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T05:18:21.792542+0000","last_peered":"2024-05-10T05:18:21.792542+0000","last_clean":"2024-05-10T05:18:21.792542+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:21.792542+0000","last_undegraded":"2024-05-10T05:18:21.792542+0000","last_fullsized":"2024-05-10T05:18:21.792542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5954,"log_dups_size":0,"ondisk_log_size":5954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5958,"num_write_kb":37125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2074,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.017985+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T05:18:26.017985+0000","last_peered":"2024-05-10T05:18:26.017985+0000","last_clean":"2024-05-10T05:18:26.017985+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:26.017985+0000","last_undegraded":"2024-05-10T05:18:26.017985+0000","last_fullsized":"2024-05-10T05:18:26.017985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7573","reported_seq":7638,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.663837+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T05:18:21.663837+0000","last_peered":"2024-05-10T05:18:21.663837+0000","last_clean":"2024-05-10T05:18:21.663837+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:18:21.663837+0000","last_undegraded":"2024-05-10T05:18:21.663837+0000","last_fullsized":"2024-05-10T05:18:21.663837+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7373,"log_dups_size":0,"ondisk_log_size":7373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5439,"num_write_kb":922918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9427","reported_seq":10122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.255904+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T05:18:23.255904+0000","last_peered":"2024-05-10T05:18:23.255904+0000","last_clean":"2024-05-10T05:18:23.255904+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:23.255904+0000","last_undegraded":"2024-05-10T05:18:23.255904+0000","last_fullsized":"2024-05-10T05:18:23.255904+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7927,"log_dups_size":0,"ondisk_log_size":7927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9421,"num_write_kb":67820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1986","reported_seq":2012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.527409+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T05:18:21.527409+0000","last_peered":"2024-05-10T05:18:21.527409+0000","last_clean":"2024-05-10T05:18:21.527409+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:18:21.527409+0000","last_undegraded":"2024-05-10T05:18:21.527409+0000","last_fullsized":"2024-05-10T05:18:21.527409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7643,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771899+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T05:18:21.771899+0000","last_peered":"2024-05-10T05:18:21.771899+0000","last_clean":"2024-05-10T05:18:21.771899+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:18:21.771899+0000","last_undegraded":"2024-05-10T05:18:21.771899+0000","last_fullsized":"2024-05-10T05:18:21.771899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4828","reported_seq":4856,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:36.424284+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T05:17:36.424284+0000","last_peered":"2024-05-10T05:17:36.424284+0000","last_clean":"2024-05-10T05:17:36.424284+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:17:36.424284+0000","last_undegraded":"2024-05-10T05:17:36.424284+0000","last_fullsized":"2024-05-10T05:17:36.424284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4830,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2045","reported_seq":2072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.658582+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T05:18:21.658582+0000","last_peered":"2024-05-10T05:18:21.658582+0000","last_clean":"2024-05-10T05:18:21.658582+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:21.658582+0000","last_undegraded":"2024-05-10T05:18:21.658582+0000","last_fullsized":"2024-05-10T05:18:21.658582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.612571+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T05:18:21.612571+0000","last_peered":"2024-05-10T05:18:21.612571+0000","last_clean":"2024-05-10T05:18:21.612571+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:18:21.612571+0000","last_undegraded":"2024-05-10T05:18:21.612571+0000","last_fullsized":"2024-05-10T05:18:21.612571+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2070","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:22.489142+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T05:16:22.489142+0000","last_peered":"2024-05-10T05:16:22.489142+0000","last_clean":"2024-05-10T05:16:22.489142+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:16:22.489142+0000","last_undegraded":"2024-05-10T05:16:22.489142+0000","last_fullsized":"2024-05-10T05:16:22.489142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2085,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.957994+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T05:18:20.957994+0000","last_peered":"2024-05-10T05:18:20.957994+0000","last_clean":"2024-05-10T05:18:20.957994+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:20.957994+0000","last_undegraded":"2024-05-10T05:18:20.957994+0000","last_fullsized":"2024-05-10T05:18:20.957994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.745422+0000","last_change":"2024-05-10T04:52:41.239639+0000","last_active":"2024-05-10T05:18:21.745422+0000","last_peered":"2024-05-10T05:18:21.745422+0000","last_clean":"2024-05-10T05:18:21.745422+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:18:21.745422+0000","last_undegraded":"2024-05-10T05:18:21.745422+0000","last_fullsized":"2024-05-10T05:18:21.745422+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:53.938219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2468,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.256049+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T05:18:23.256049+0000","last_peered":"2024-05-10T05:18:23.256049+0000","last_clean":"2024-05-10T05:18:23.256049+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:23.256049+0000","last_undegraded":"2024-05-10T05:18:23.256049+0000","last_fullsized":"2024-05-10T05:18:23.256049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2002","reported_seq":2029,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.758978+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T05:18:20.758978+0000","last_peered":"2024-05-10T05:18:20.758978+0000","last_clean":"2024-05-10T05:18:20.758978+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:20.758978+0000","last_undegraded":"2024-05-10T05:18:20.758978+0000","last_fullsized":"2024-05-10T05:18:20.758978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.702456+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T05:18:21.702456+0000","last_peered":"2024-05-10T05:18:21.702456+0000","last_clean":"2024-05-10T05:18:21.702456+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:18:21.702456+0000","last_undegraded":"2024-05-10T05:18:21.702456+0000","last_fullsized":"2024-05-10T05:18:21.702456+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3403","reported_seq":3431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.249528+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T05:18:23.249528+0000","last_peered":"2024-05-10T05:18:23.249528+0000","last_clean":"2024-05-10T05:18:23.249528+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:23.249528+0000","last_undegraded":"2024-05-10T05:18:23.249528+0000","last_fullsized":"2024-05-10T05:18:23.249528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3413,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2087","reported_seq":2108,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.226511+0000","last_change":"2024-05-10T04:52:40.334760+0000","last_active":"2024-05-10T05:18:23.226511+0000","last_peered":"2024-05-10T05:18:23.226511+0000","last_clean":"2024-05-10T05:18:23.226511+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:18:23.226511+0000","last_undegraded":"2024-05-10T05:18:23.226511+0000","last_fullsized":"2024-05-10T05:18:23.226511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2087,"log_dups_size":0,"ondisk_log_size":2087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:28.551142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.608166+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T05:18:21.608166+0000","last_peered":"2024-05-10T05:18:21.608166+0000","last_clean":"2024-05-10T05:18:21.608166+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:18:21.608166+0000","last_undegraded":"2024-05-10T05:18:21.608166+0000","last_fullsized":"2024-05-10T05:18:21.608166+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4728","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.283608+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T05:18:23.283608+0000","last_peered":"2024-05-10T05:18:23.283608+0000","last_clean":"2024-05-10T05:18:23.283608+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:23.283608+0000","last_undegraded":"2024-05-10T05:18:23.283608+0000","last_fullsized":"2024-05-10T05:18:23.283608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2042","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.315918+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T05:18:21.315918+0000","last_peered":"2024-05-10T05:18:21.315918+0000","last_clean":"2024-05-10T05:18:21.315918+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:18:21.315918+0000","last_undegraded":"2024-05-10T05:18:21.315918+0000","last_fullsized":"2024-05-10T05:18:21.315918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.703637+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T05:18:21.703637+0000","last_peered":"2024-05-10T05:18:21.703637+0000","last_clean":"2024-05-10T05:18:21.703637+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:18:21.703637+0000","last_undegraded":"2024-05-10T05:18:21.703637+0000","last_fullsized":"2024-05-10T05:18:21.703637+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6057","reported_seq":6086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:01.041726+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T05:18:01.041726+0000","last_peered":"2024-05-10T05:18:01.041726+0000","last_clean":"2024-05-10T05:18:01.041726+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:01.041726+0000","last_undegraded":"2024-05-10T05:18:01.041726+0000","last_fullsized":"2024-05-10T05:18:01.041726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6057,"log_dups_size":0,"ondisk_log_size":6057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6062,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2022","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.725133+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T05:18:21.725133+0000","last_peered":"2024-05-10T05:18:21.725133+0000","last_clean":"2024-05-10T05:18:21.725133+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:18:21.725133+0000","last_undegraded":"2024-05-10T05:18:21.725133+0000","last_fullsized":"2024-05-10T05:18:21.725133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8411,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.766997+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T05:18:21.766997+0000","last_peered":"2024-05-10T05:18:21.766997+0000","last_clean":"2024-05-10T05:18:21.766997+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:18:21.766997+0000","last_undegraded":"2024-05-10T05:18:21.766997+0000","last_fullsized":"2024-05-10T05:18:21.766997+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7061","reported_seq":7090,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:52.704728+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T05:16:52.704728+0000","last_peered":"2024-05-10T05:16:52.704728+0000","last_clean":"2024-05-10T05:16:52.704728+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:16:52.704728+0000","last_undegraded":"2024-05-10T05:16:52.704728+0000","last_fullsized":"2024-05-10T05:16:52.704728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7057,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.967879+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T05:18:25.967879+0000","last_peered":"2024-05-10T05:18:25.967879+0000","last_clean":"2024-05-10T05:18:25.967879+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:25.967879+0000","last_undegraded":"2024-05-10T05:18:25.967879+0000","last_fullsized":"2024-05-10T05:18:25.967879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7588,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.715058+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T05:18:21.715058+0000","last_peered":"2024-05-10T05:18:21.715058+0000","last_clean":"2024-05-10T05:18:21.715058+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:18:21.715058+0000","last_undegraded":"2024-05-10T05:18:21.715058+0000","last_fullsized":"2024-05-10T05:18:21.715058+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2050","reported_seq":2079,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.397473+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T05:18:21.397473+0000","last_peered":"2024-05-10T05:18:21.397473+0000","last_clean":"2024-05-10T05:18:21.397473+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:21.397473+0000","last_undegraded":"2024-05-10T05:18:21.397473+0000","last_fullsized":"2024-05-10T05:18:21.397473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.274962+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T05:18:23.274962+0000","last_peered":"2024-05-10T05:18:23.274962+0000","last_clean":"2024-05-10T05:18:23.274962+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:23.274962+0000","last_undegraded":"2024-05-10T05:18:23.274962+0000","last_fullsized":"2024-05-10T05:18:23.274962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7596,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.759345+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T05:18:21.759345+0000","last_peered":"2024-05-10T05:18:21.759345+0000","last_clean":"2024-05-10T05:18:21.759345+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:18:21.759345+0000","last_undegraded":"2024-05-10T05:18:21.759345+0000","last_fullsized":"2024-05-10T05:18:21.759345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2077","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.685132+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T05:18:21.685132+0000","last_peered":"2024-05-10T05:18:21.685132+0000","last_clean":"2024-05-10T05:18:21.685132+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:18:21.685132+0000","last_undegraded":"2024-05-10T05:18:21.685132+0000","last_fullsized":"2024-05-10T05:18:21.685132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4529","reported_seq":4558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:57.705574+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T05:16:57.705574+0000","last_peered":"2024-05-10T05:16:57.705574+0000","last_clean":"2024-05-10T05:16:57.705574+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:16:57.705574+0000","last_undegraded":"2024-05-10T05:16:57.705574+0000","last_fullsized":"2024-05-10T05:16:57.705574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4530,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:15:56.300717+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T05:15:56.300717+0000","last_peered":"2024-05-10T05:15:56.300717+0000","last_clean":"2024-05-10T05:15:56.300717+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:15:56.300717+0000","last_undegraded":"2024-05-10T05:15:56.300717+0000","last_fullsized":"2024-05-10T05:15:56.300717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.600950+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T05:18:21.600950+0000","last_peered":"2024-05-10T05:18:21.600950+0000","last_clean":"2024-05-10T05:18:21.600950+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:18:21.600950+0000","last_undegraded":"2024-05-10T05:18:21.600950+0000","last_fullsized":"2024-05-10T05:18:21.600950+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1989","reported_seq":2017,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.576508+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T05:18:21.576508+0000","last_peered":"2024-05-10T05:18:21.576508+0000","last_clean":"2024-05-10T05:18:21.576508+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:21.576508+0000","last_undegraded":"2024-05-10T05:18:21.576508+0000","last_fullsized":"2024-05-10T05:18:21.576508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1989,"log_dups_size":0,"ondisk_log_size":1989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6529","reported_seq":6559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:59.156422+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T05:17:59.156422+0000","last_peered":"2024-05-10T05:17:59.156422+0000","last_clean":"2024-05-10T05:17:59.156422+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:17:59.156422+0000","last_undegraded":"2024-05-10T05:17:59.156422+0000","last_fullsized":"2024-05-10T05:17:59.156422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6529,"log_dups_size":0,"ondisk_log_size":6529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6533,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7693,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.682694+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T05:18:21.682694+0000","last_peered":"2024-05-10T05:18:21.682694+0000","last_clean":"2024-05-10T05:18:21.682694+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:18:21.682694+0000","last_undegraded":"2024-05-10T05:18:21.682694+0000","last_fullsized":"2024-05-10T05:18:21.682694+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4963","reported_seq":4992,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:40.979327+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T05:16:40.979327+0000","last_peered":"2024-05-10T05:16:40.979327+0000","last_clean":"2024-05-10T05:16:40.979327+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:16:40.979327+0000","last_undegraded":"2024-05-10T05:16:40.979327+0000","last_fullsized":"2024-05-10T05:16:40.979327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4963,"log_dups_size":0,"ondisk_log_size":4963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4966,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2066","reported_seq":2094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.727974+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T05:18:21.727974+0000","last_peered":"2024-05-10T05:18:21.727974+0000","last_clean":"2024-05-10T05:18:21.727974+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:21.727974+0000","last_undegraded":"2024-05-10T05:18:21.727974+0000","last_fullsized":"2024-05-10T05:18:21.727974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2066,"log_dups_size":0,"ondisk_log_size":2066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7176","reported_seq":7221,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.418812+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T05:18:21.418812+0000","last_peered":"2024-05-10T05:18:21.418812+0000","last_clean":"2024-05-10T05:18:21.418812+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:18:21.418812+0000","last_undegraded":"2024-05-10T05:18:21.418812+0000","last_fullsized":"2024-05-10T05:18:21.418812+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6274,"log_dups_size":0,"ondisk_log_size":6274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5016,"num_write_kb":931826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4510","reported_seq":4787,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:18.117537+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T05:18:18.117537+0000","last_peered":"2024-05-10T05:18:18.117537+0000","last_clean":"2024-05-10T05:18:18.117537+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:18.117537+0000","last_undegraded":"2024-05-10T05:18:18.117537+0000","last_fullsized":"2024-05-10T05:18:18.117537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5693195,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":1630,"num_write":5090,"num_write_kb":38911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1992","reported_seq":2020,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.611609+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T05:18:21.611609+0000","last_peered":"2024-05-10T05:18:21.611609+0000","last_clean":"2024-05-10T05:18:21.611609+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:21.611609+0000","last_undegraded":"2024-05-10T05:18:21.611609+0000","last_fullsized":"2024-05-10T05:18:21.611609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7839,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.561520+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T05:18:21.561520+0000","last_peered":"2024-05-10T05:18:21.561520+0000","last_clean":"2024-05-10T05:18:21.561520+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:21.561520+0000","last_undegraded":"2024-05-10T05:18:21.561520+0000","last_fullsized":"2024-05-10T05:18:21.561520+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2929","reported_seq":2958,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285307+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T05:18:23.285307+0000","last_peered":"2024-05-10T05:18:23.285307+0000","last_clean":"2024-05-10T05:18:23.285307+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:23.285307+0000","last_undegraded":"2024-05-10T05:18:23.285307+0000","last_fullsized":"2024-05-10T05:18:23.285307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2929,"log_dups_size":0,"ondisk_log_size":2929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2034","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.606877+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T05:18:21.606877+0000","last_peered":"2024-05-10T05:18:21.606877+0000","last_clean":"2024-05-10T05:18:21.606877+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:21.606877+0000","last_undegraded":"2024-05-10T05:18:21.606877+0000","last_fullsized":"2024-05-10T05:18:21.606877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7569,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.840121+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T05:18:25.840121+0000","last_peered":"2024-05-10T05:18:25.840121+0000","last_clean":"2024-05-10T05:18:25.840121+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:25.840121+0000","last_undegraded":"2024-05-10T05:18:25.840121+0000","last_fullsized":"2024-05-10T05:18:25.840121+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2703","reported_seq":2732,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:53.864278+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T05:16:53.864278+0000","last_peered":"2024-05-10T05:16:53.864278+0000","last_clean":"2024-05-10T05:16:53.864278+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:16:53.864278+0000","last_undegraded":"2024-05-10T05:16:53.864278+0000","last_fullsized":"2024-05-10T05:16:53.864278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2703,"log_dups_size":0,"ondisk_log_size":2703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2708,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.568724+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T05:18:21.568724+0000","last_peered":"2024-05-10T05:18:21.568724+0000","last_clean":"2024-05-10T05:18:21.568724+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:21.568724+0000","last_undegraded":"2024-05-10T05:18:21.568724+0000","last_fullsized":"2024-05-10T05:18:21.568724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.714933+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T05:18:21.714933+0000","last_peered":"2024-05-10T05:18:21.714933+0000","last_clean":"2024-05-10T05:18:21.714933+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:18:21.714933+0000","last_undegraded":"2024-05-10T05:18:21.714933+0000","last_fullsized":"2024-05-10T05:18:21.714933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3606","reported_seq":3635,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:44.359477+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T05:16:44.359477+0000","last_peered":"2024-05-10T05:16:44.359477+0000","last_clean":"2024-05-10T05:16:44.359477+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:16:44.359477+0000","last_undegraded":"2024-05-10T05:16:44.359477+0000","last_fullsized":"2024-05-10T05:16:44.359477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3624,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2107","reported_seq":2135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.653553+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T05:18:21.653553+0000","last_peered":"2024-05-10T05:18:21.653553+0000","last_clean":"2024-05-10T05:18:21.653553+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:21.653553+0000","last_undegraded":"2024-05-10T05:18:21.653553+0000","last_fullsized":"2024-05-10T05:18:21.653553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7426,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.701576+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T05:18:21.701576+0000","last_peered":"2024-05-10T05:18:21.701576+0000","last_clean":"2024-05-10T05:18:21.701576+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:18:21.701576+0000","last_undegraded":"2024-05-10T05:18:21.701576+0000","last_fullsized":"2024-05-10T05:18:21.701576+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6717","reported_seq":6746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:39.819475+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T05:17:39.819475+0000","last_peered":"2024-05-10T05:17:39.819475+0000","last_clean":"2024-05-10T05:17:39.819475+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:17:39.819475+0000","last_undegraded":"2024-05-10T05:17:39.819475+0000","last_fullsized":"2024-05-10T05:17:39.819475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6717,"log_dups_size":0,"ondisk_log_size":6717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6709,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2071","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.378982+0000","last_change":"2024-05-10T04:52:40.335170+0000","last_active":"2024-05-10T05:18:21.378982+0000","last_peered":"2024-05-10T05:18:21.378982+0000","last_clean":"2024-05-10T05:18:21.378982+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:21.378982+0000","last_undegraded":"2024-05-10T05:18:21.378982+0000","last_fullsized":"2024-05-10T05:18:21.378982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:53.141194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7869,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.850330+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T05:18:25.850330+0000","last_peered":"2024-05-10T05:18:25.850330+0000","last_clean":"2024-05-10T05:18:25.850330+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:18:25.850330+0000","last_undegraded":"2024-05-10T05:18:25.850330+0000","last_fullsized":"2024-05-10T05:18:25.850330+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6906","reported_seq":6934,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:50.952319+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T05:16:50.952319+0000","last_peered":"2024-05-10T05:16:50.952319+0000","last_clean":"2024-05-10T05:16:50.952319+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:16:50.952319+0000","last_undegraded":"2024-05-10T05:16:50.952319+0000","last_fullsized":"2024-05-10T05:16:50.952319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6906,"log_dups_size":0,"ondisk_log_size":6906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6922,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2064","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.656167+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T05:18:21.656167+0000","last_peered":"2024-05-10T05:18:21.656167+0000","last_clean":"2024-05-10T05:18:21.656167+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:18:21.656167+0000","last_undegraded":"2024-05-10T05:18:21.656167+0000","last_fullsized":"2024-05-10T05:18:21.656167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2064,"log_dups_size":0,"ondisk_log_size":2064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.687453+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T05:18:21.687453+0000","last_peered":"2024-05-10T05:18:21.687453+0000","last_clean":"2024-05-10T05:18:21.687453+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:18:21.687453+0000","last_undegraded":"2024-05-10T05:18:21.687453+0000","last_fullsized":"2024-05-10T05:18:21.687453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5970","reported_seq":5998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:16.397485+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T05:17:16.397485+0000","last_peered":"2024-05-10T05:17:16.397485+0000","last_clean":"2024-05-10T05:17:16.397485+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:17:16.397485+0000","last_undegraded":"2024-05-10T05:17:16.397485+0000","last_fullsized":"2024-05-10T05:17:16.397485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5970,"log_dups_size":0,"ondisk_log_size":5970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2036","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.443216+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T05:18:21.443216+0000","last_peered":"2024-05-10T05:18:21.443216+0000","last_clean":"2024-05-10T05:18:21.443216+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:21.443216+0000","last_undegraded":"2024-05-10T05:18:21.443216+0000","last_fullsized":"2024-05-10T05:18:21.443216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7893","reported_seq":7997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.661320+0000","last_change":"2024-05-10T04:52:40.389082+0000","last_active":"2024-05-10T05:18:21.661320+0000","last_peered":"2024-05-10T05:18:21.661320+0000","last_clean":"2024-05-10T05:18:21.661320+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:18:21.661320+0000","last_undegraded":"2024-05-10T05:18:21.661320+0000","last_fullsized":"2024-05-10T05:18:21.661320+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:16.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5698,"num_write_kb":1007687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7938","reported_seq":7966,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:26.096941+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T05:17:26.096941+0000","last_peered":"2024-05-10T05:17:26.096941+0000","last_clean":"2024-05-10T05:17:26.096941+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:17:26.096941+0000","last_undegraded":"2024-05-10T05:17:26.096941+0000","last_fullsized":"2024-05-10T05:17:26.096941+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7338,"log_dups_size":0,"ondisk_log_size":7338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7933,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2028","reported_seq":2055,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.406662+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T05:18:21.406662+0000","last_peered":"2024-05-10T05:18:21.406662+0000","last_clean":"2024-05-10T05:18:21.406662+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:18:21.406662+0000","last_undegraded":"2024-05-10T05:18:21.406662+0000","last_fullsized":"2024-05-10T05:18:21.406662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646424+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T05:18:21.646424+0000","last_peered":"2024-05-10T05:18:21.646424+0000","last_clean":"2024-05-10T05:18:21.646424+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:18:21.646424+0000","last_undegraded":"2024-05-10T05:18:21.646424+0000","last_fullsized":"2024-05-10T05:18:21.646424+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5556","reported_seq":5584,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.259260+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T05:18:23.259260+0000","last_peered":"2024-05-10T05:18:23.259260+0000","last_clean":"2024-05-10T05:18:23.259260+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:23.259260+0000","last_undegraded":"2024-05-10T05:18:23.259260+0000","last_fullsized":"2024-05-10T05:18:23.259260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1952","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.238683+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T05:18:21.238683+0000","last_peered":"2024-05-10T05:18:21.238683+0000","last_clean":"2024-05-10T05:18:21.238683+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:21.238683+0000","last_undegraded":"2024-05-10T05:18:21.238683+0000","last_fullsized":"2024-05-10T05:18:21.238683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1977","reported_seq":2005,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.941235+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T05:18:20.941235+0000","last_peered":"2024-05-10T05:18:20.941235+0000","last_clean":"2024-05-10T05:18:20.941235+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:18:20.941235+0000","last_undegraded":"2024-05-10T05:18:20.941235+0000","last_fullsized":"2024-05-10T05:18:20.941235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1977,"log_dups_size":0,"ondisk_log_size":1977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2079","reported_seq":2107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.146529+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T05:18:21.146529+0000","last_peered":"2024-05-10T05:18:21.146529+0000","last_clean":"2024-05-10T05:18:21.146529+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:21.146529+0000","last_undegraded":"2024-05-10T05:18:21.146529+0000","last_fullsized":"2024-05-10T05:18:21.146529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1982","reported_seq":2010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.466513+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T05:18:21.466513+0000","last_peered":"2024-05-10T05:18:21.466513+0000","last_clean":"2024-05-10T05:18:21.466513+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:18:21.466513+0000","last_undegraded":"2024-05-10T05:18:21.466513+0000","last_fullsized":"2024-05-10T05:18:21.466513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2086","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.698973+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T05:18:21.698973+0000","last_peered":"2024-05-10T05:18:21.698973+0000","last_clean":"2024-05-10T05:18:21.698973+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:21.698973+0000","last_undegraded":"2024-05-10T05:18:21.698973+0000","last_fullsized":"2024-05-10T05:18:21.698973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2059","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.339956+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T05:18:21.339956+0000","last_peered":"2024-05-10T05:18:21.339956+0000","last_clean":"2024-05-10T05:18:21.339956+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:21.339956+0000","last_undegraded":"2024-05-10T05:18:21.339956+0000","last_fullsized":"2024-05-10T05:18:21.339956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1953","reported_seq":1981,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.460991+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T05:18:21.460991+0000","last_peered":"2024-05-10T05:18:21.460991+0000","last_clean":"2024-05-10T05:18:21.460991+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:18:21.460991+0000","last_undegraded":"2024-05-10T05:18:21.460991+0000","last_fullsized":"2024-05-10T05:18:21.460991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2056","reported_seq":2084,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.446402+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T05:18:21.446402+0000","last_peered":"2024-05-10T05:18:21.446402+0000","last_clean":"2024-05-10T05:18:21.446402+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:18:21.446402+0000","last_undegraded":"2024-05-10T05:18:21.446402+0000","last_fullsized":"2024-05-10T05:18:21.446402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2050","reported_seq":2078,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.616737+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T05:18:21.616737+0000","last_peered":"2024-05-10T05:18:21.616737+0000","last_clean":"2024-05-10T05:18:21.616737+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:21.616737+0000","last_undegraded":"2024-05-10T05:18:21.616737+0000","last_fullsized":"2024-05-10T05:18:21.616737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2000","reported_seq":2028,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.322010+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T05:18:21.322010+0000","last_peered":"2024-05-10T05:18:21.322010+0000","last_clean":"2024-05-10T05:18:21.322010+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:21.322010+0000","last_undegraded":"2024-05-10T05:18:21.322010+0000","last_fullsized":"2024-05-10T05:18:21.322010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2035","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.323810+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T05:18:21.323810+0000","last_peered":"2024-05-10T05:18:21.323810+0000","last_clean":"2024-05-10T05:18:21.323810+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:21.323810+0000","last_undegraded":"2024-05-10T05:18:21.323810+0000","last_fullsized":"2024-05-10T05:18:21.323810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2060","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.435357+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T05:18:20.435357+0000","last_peered":"2024-05-10T05:18:20.435357+0000","last_clean":"2024-05-10T05:18:20.435357+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:18:20.435357+0000","last_undegraded":"2024-05-10T05:18:20.435357+0000","last_fullsized":"2024-05-10T05:18:20.435357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.651581+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T05:18:21.651581+0000","last_peered":"2024-05-10T05:18:21.651581+0000","last_clean":"2024-05-10T05:18:21.651581+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:18:21.651581+0000","last_undegraded":"2024-05-10T05:18:21.651581+0000","last_fullsized":"2024-05-10T05:18:21.651581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2043","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.384106+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T05:18:21.384106+0000","last_peered":"2024-05-10T05:18:21.384106+0000","last_clean":"2024-05-10T05:18:21.384106+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:21.384106+0000","last_undegraded":"2024-05-10T05:18:21.384106+0000","last_fullsized":"2024-05-10T05:18:21.384106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3504128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173237,"num_write_kb":29659775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12107776,"data_stored":12107776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225976,"ondisk_log_size":225976,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130287,"ondisk_log_size":130287,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235067000,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2409,"num_read_kb":15302,"num_write":184752,"num_write_kb":1350563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":474402816,"data_stored":474340060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172587,"ondisk_log_size":172587,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542466,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":924928,"kb_used_data":81784,"kb_used_omap":1,"kb_used_meta":843134,"kb_avail":93446912,"statfs":{"total":96636764160,"available":95689637888,"internally_reserved":0,"allocated":83746816,"data_stored":83562425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":863369675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.1080000000000001,"5min":2.2599999999999998,"15min":1.736},"min":{"1min":0.309,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":28.266999999999999,"5min":28.266999999999999,"15min":34.326999999999998},"last":6.4359999999999999},{"interface":"front","average":{"1min":3.6920000000000002,"5min":2.7669999999999999,"15min":1.8069999999999999},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":28.968,"5min":28.968,"15min":28.968},"last":1.1819999999999999}]},{"osd":1,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":4.3120000000000003,"5min":2.4780000000000002,"15min":1.8300000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"max":{"1min":34.805999999999997,"5min":34.805999999999997,"15min":34.805999999999997},"last":6.3819999999999997},{"interface":"front","average":{"1min":2.7269999999999999,"5min":2.7789999999999999,"15min":2.2480000000000002},"min":{"1min":0.47499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":29.222000000000001,"5min":29.222000000000001,"15min":105.375},"last":1.411}]},{"osd":2,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":2.6960000000000002,"5min":3.2959999999999998,"15min":2.0569999999999999},"min":{"1min":0.54000000000000004,"5min":0.40899999999999997,"15min":0.35899999999999999},"max":{"1min":28.913,"5min":52.515999999999998,"15min":52.515999999999998},"last":1.7230000000000001},{"interface":"front","average":{"1min":4.04,"5min":2.5089999999999999,"15min":1.712},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":34.756999999999998,"5min":35.595999999999997,"15min":35.595999999999997},"last":6.476}]},{"osd":3,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":2.843,"5min":3.5030000000000001,"15min":3.6440000000000001},"min":{"1min":0.44800000000000001,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":28.952999999999999,"5min":64.994,"15min":263.32999999999998},"last":1.595},{"interface":"front","average":{"1min":3.5169999999999999,"5min":2.7919999999999998,"15min":2.9119999999999999},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.40500000000000003},"max":{"1min":34.841999999999999,"5min":43.789000000000001,"15min":263.30900000000003},"last":6.5129999999999999}]},{"osd":4,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.9089999999999998,"5min":4.048,"15min":2.6240000000000001},"min":{"1min":0.438,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":30.199000000000002,"5min":52.252000000000002,"15min":52.252000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":2.964,"5min":3.7589999999999999,"15min":3.1120000000000001},"min":{"1min":0.48599999999999999,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":31.914000000000001,"5min":46.792000000000002,"15min":134.07499999999999},"last":2.2469999999999999}]},{"osd":5,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.585,"5min":3.2890000000000001,"15min":2.3410000000000002},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":34.875,"5min":34.875,"15min":34.875},"last":9.2859999999999996},{"interface":"front","average":{"1min":3.254,"5min":3.2029999999999998,"15min":2.2410000000000001},"min":{"1min":0.51400000000000001,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":29.867000000000001,"5min":29.867000000000001,"15min":37.582999999999998},"last":9.0559999999999992}]},{"osd":6,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":5.1719999999999997,"5min":5.056,"15min":3.137},"min":{"1min":0.69199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":29.905000000000001,"5min":65.388999999999996,"15min":65.388999999999996},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.8330000000000002,"5min":5.4059999999999997,"15min":3.3530000000000002},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":31.960999999999999,"5min":84.454999999999998,"15min":84.454999999999998},"last":2.2080000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542465,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":979668,"kb_used_data":92236,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93392172,"statfs":{"total":96636764160,"available":95633584128,"internally_reserved":0,"allocated":94449664,"data_stored":94260377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":2.2069999999999999,"15min":2.899},"min":{"1min":0.313,"5min":0.30399999999999999,"15min":0.30199999999999999},"max":{"1min":9.5470000000000006,"5min":17.158000000000001,"15min":215.636},"last":0.72399999999999998},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.4049999999999998,"15min":2.7040000000000002},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":26.574000000000002,"5min":26.574000000000002,"15min":216.899},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.5030000000000001,"15min":3.6099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":20.341999999999999,"5min":20.341999999999999,"15min":283.584},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.25,"5min":2.1429999999999998,"15min":3.1899999999999999},"min":{"1min":0.39500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":9.5969999999999995,"5min":21.161999999999999,"15min":226.642},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":2.0230000000000001,"15min":2.5129999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38200000000000001},"max":{"1min":13.759,"5min":13.759,"15min":204.20099999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":2.339,"5min":2.806,"15min":2.165},"min":{"1min":0.44,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":15.641999999999999,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":2.3260000000000001,"5min":2.1680000000000001,"15min":2.8330000000000002},"min":{"1min":0.47499999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":9.6289999999999996,"5min":21.224,"15min":211.06999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":2.794,"5min":2.242,"15min":2.7709999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":13.257999999999999,"5min":24.928999999999998,"15min":216.947},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.4209999999999998,"5min":2.6160000000000001,"15min":2.5070000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.151,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":3.4100000000000001,"5min":3.1139999999999999,"15min":2.3069999999999999},"min":{"1min":0.499,"5min":0.438,"15min":0.39600000000000002},"max":{"1min":13.398,"5min":37.195,"15min":37.195},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.012,"5min":2.863,"15min":2.278},"min":{"1min":0.57199999999999995,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":15.685,"5min":46.448999999999998,"15min":46.448999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":4.0999999999999996,"5min":2.839,"15min":2.4769999999999999},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":18.962,"5min":20.692,"15min":35.591999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.23,"5min":2.9849999999999999,"15min":2.2349999999999999},"min":{"1min":0.70999999999999996,"5min":0.437,"15min":0.437},"max":{"1min":13.369999999999999,"5min":58.857999999999997,"15min":58.857999999999997},"last":1},{"interface":"front","average":{"1min":4.2380000000000004,"5min":3.9590000000000001,"15min":2.5979999999999999},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":20.297000000000001,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.88300000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542466,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":777628,"kb_used_data":70740,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93594212,"statfs":{"total":96636764160,"available":95840473088,"internally_reserved":0,"allocated":72437760,"data_stored":72245233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,4,0,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.1709999999999998,"5min":1.46,"15min":1.3959999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":39.710000000000001,"5min":39.710000000000001,"15min":40.371000000000002},"last":8.7910000000000004},{"interface":"front","average":{"1min":4.3259999999999996,"5min":2.1019999999999999,"15min":1.9139999999999999},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":62.222000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":1.569}]},{"osd":2,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3680000000000001,"15min":1.1699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":6.391,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.875,"5min":1.5880000000000001,"15min":1.3959999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":8.391,"5min":17.998000000000001,"15min":37.643999999999998},"last":1.4430000000000001}]},{"osd":3,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.7770000000000001,"5min":1.7150000000000001,"15min":2.0600000000000001},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":51.646999999999998,"5min":51.646999999999998,"15min":108.407},"last":4.7089999999999996},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6699999999999999,"15min":1.466},"min":{"1min":0.51000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.359999999999999,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7249999999999996,"5min":2.6739999999999999,"15min":2.2949999999999999},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":52.307000000000002,"5min":52.307000000000002,"15min":52.307000000000002},"last":4.6619999999999999},{"interface":"front","average":{"1min":3.0339999999999998,"5min":2.4809999999999999,"15min":1.9970000000000001},"min":{"1min":0.47199999999999998,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":13.576000000000001,"5min":19.292999999999999,"15min":32.276000000000003},"last":2.3969999999999998}]},{"osd":5,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5110000000000001,"5min":2.202,"15min":1.8660000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":9.8170000000000002,"5min":18.966000000000001,"15min":37.572000000000003},"last":1.2789999999999999},{"interface":"front","average":{"1min":4.3659999999999997,"5min":2.5840000000000001,"15min":2.2599999999999998},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":7.6829999999999998}]},{"osd":6,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":2.6240000000000001,"15min":2.1459999999999999},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":13.968,"5min":41.270000000000003,"15min":41.270000000000003},"last":0.877},{"interface":"front","average":{"1min":3.6699999999999999,"5min":2.923,"15min":2.258},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":18.013000000000002,"5min":41.043999999999997,"15min":41.043999999999997},"last":1.387}]},{"osd":7,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.6749999999999998,"15min":2.2490000000000001},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":17.946000000000002,"5min":22.251000000000001,"15min":37.850000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":3.927,"5min":2.3809999999999998,"15min":2.359},"min":{"1min":0.622,"5min":0.503,"15min":0.503},"max":{"1min":39.850000000000001,"5min":39.850000000000001,"15min":46.118000000000002},"last":4.7469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":540160,"kb_used_data":21816,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93831680,"statfs":{"total":96636764160,"available":96083640320,"internally_reserved":0,"allocated":22339584,"data_stored":22162259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.556,"15min":1.1779999999999999},"min":{"1min":0.28299999999999997,"5min":0.246,"15min":0.246},"max":{"1min":9.9390000000000001,"5min":24.271000000000001,"15min":24.271000000000001},"last":2.9020000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.4319999999999999,"15min":1.3420000000000001},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.29399999999999998},"max":{"1min":8.2479999999999993,"5min":23.797999999999998,"15min":30.734999999999999},"last":4.681}]},{"osd":1,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.018,"15min":1.397},"min":{"1min":0.34200000000000003,"5min":0.28899999999999998,"15min":0.27700000000000002},"max":{"1min":9.9079999999999995,"5min":12.404999999999999,"15min":105.28},"last":3.2000000000000002},{"interface":"front","average":{"1min":1.885,"5min":2.3759999999999999,"15min":2.472},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":30.760000000000002,"5min":73.775999999999996,"15min":105.255},"last":7.9219999999999997}]},{"osd":3,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.3140000000000001,"15min":1.5389999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":11.765000000000001,"5min":11.765000000000001,"15min":60.387999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.536,"15min":1.3680000000000001},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":9.8339999999999996,"5min":21.029,"15min":22.358000000000001},"last":3.7320000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":5.3300000000000001,"15min":2.6850000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41899999999999998},"max":{"1min":12.801,"5min":249.88,"15min":249.88},"last":0.443},{"interface":"front","average":{"1min":1.3049999999999999,"5min":5.6280000000000001,"15min":3.0059999999999998},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":9.6890000000000001,"5min":249.82300000000001,"15min":249.82300000000001},"last":4.7329999999999997}]},{"osd":5,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":3.8809999999999998,"15min":2.6120000000000001},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":23.582999999999998,"5min":256.38600000000002,"15min":256.38600000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.21,"5min":3.7549999999999999,"15min":2.2749999999999999},"min":{"1min":0.55400000000000005,"5min":0.42899999999999999,"15min":0.42799999999999999},"max":{"1min":9.7970000000000006,"5min":255.04499999999999,"15min":255.04499999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":5.1210000000000004,"15min":2.8900000000000001},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":7.6630000000000003,"5min":255.06999999999999,"15min":255.06999999999999},"last":4.7809999999999997},{"interface":"front","average":{"1min":2.4169999999999998,"5min":4.8220000000000001,"15min":2.9780000000000002},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":38.405000000000001,"5min":253.095,"15min":253.095},"last":1.411}]},{"osd":7,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":4.0599999999999996,"15min":2.7949999999999999},"min":{"1min":0.53700000000000003,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":8.2889999999999997,"5min":249.90799999999999,"15min":249.90799999999999},"last":4.8150000000000004},{"interface":"front","average":{"1min":2.4039999999999999,"5min":4.444,"15min":3.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":23.321999999999999,"5min":256.97699999999998,"15min":256.97699999999998},"last":0.77400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542465,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":968972,"kb_used_data":53572,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93402868,"statfs":{"total":96636764160,"available":95644536832,"internally_reserved":0,"allocated":54857728,"data_stored":54672126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,0,4,7,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":2.2999999999999998,"15min":2.4710000000000001},"min":{"1min":0.25800000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":50.100000000000001,"5min":50.100000000000001,"15min":192.745},"last":12.423},{"interface":"front","average":{"1min":4.3819999999999997,"5min":1.891,"15min":2.206},"min":{"1min":0.38700000000000001,"5min":0.377,"15min":0.30499999999999999},"max":{"1min":50.145000000000003,"5min":50.145000000000003,"15min":192.62799999999999},"last":1.3620000000000001}]},{"osd":2,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3520000000000001,"15min":1.651},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":3.9159999999999999,"5min":14.263999999999999,"15min":71.727999999999994},"last":5.375},{"interface":"front","average":{"1min":1.431,"5min":1.651,"15min":1.9910000000000001},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":5.5410000000000004,"5min":32.435000000000002,"15min":95.793000000000006},"last":5.5449999999999999}]},{"osd":3,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.0249999999999999,"15min":2.1030000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":14.446,"5min":21.994,"15min":125.41200000000001},"last":12.491},{"interface":"front","average":{"1min":3.0030000000000001,"5min":2.0139999999999998,"15min":1.8620000000000001},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":16.498000000000001,"5min":26.085000000000001,"15min":111.134},"last":3.8690000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.7130000000000001,"5min":2.8999999999999999,"15min":2.5099999999999998},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.33300000000000002},"max":{"1min":21.686,"5min":34.137999999999998,"15min":72.697999999999993},"last":0.378},{"interface":"front","average":{"1min":4.7569999999999997,"5min":3.2829999999999999,"15min":3.1150000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":26.440999999999999,"5min":52.764000000000003,"15min":138.74100000000001},"last":5.7279999999999998}]},{"osd":5,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":2.637,"15min":2},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":9.3300000000000001,"5min":41.558,"15min":41.558},"last":3.7909999999999999},{"interface":"front","average":{"1min":4.0279999999999996,"5min":2.7149999999999999,"15min":2.165},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":21.745999999999999,"5min":21.745999999999999,"15min":71.340999999999994},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":5.2930000000000001,"5min":2.7440000000000002,"15min":3.7429999999999999},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":46.985999999999997,"5min":46.985999999999997,"15min":289.625},"last":0.42699999999999999},{"interface":"front","average":{"1min":3.6459999999999999,"5min":2.8900000000000001,"15min":4.1399999999999997},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":14.343999999999999,"5min":23.260999999999999,"15min":289.608},"last":5.8070000000000004}]},{"osd":7,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2450000000000001,"5min":2.0680000000000001,"15min":1.9299999999999999},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":9.3629999999999995,"5min":28.573,"15min":33.892000000000003},"last":3.7519999999999998},{"interface":"front","average":{"1min":3.1560000000000001,"5min":2.7010000000000001,"15min":2.1200000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":13.920999999999999,"5min":19.215,"15min":41.015000000000001},"last":3.8319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542466,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1078144,"kb_used_data":86520,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293696,"statfs":{"total":96636764160,"available":95532744704,"internally_reserved":0,"allocated":88596480,"data_stored":88411635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.556,"15min":1.381},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":14.048,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.325,"15min":1.7569999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":6.827,"5min":22.594000000000001,"15min":119.66200000000001},"last":0.496}]},{"osd":1,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.5509999999999999,"15min":1.3220000000000001},"min":{"1min":0.30599999999999999,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":18.273,"5min":25.995000000000001,"15min":26.573},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.671,"15min":1.6040000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.1,"5min":32.93,"15min":32.93},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.5349999999999999,"15min":1.288},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":6.5730000000000004,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.3180000000000001,"15min":1.262},"min":{"1min":0.45900000000000002,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":14.214,"5min":17.420999999999999,"15min":29.568999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":4.2080000000000002,"5min":4.2729999999999997,"15min":3.948},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":55.142000000000003,"5min":101.81399999999999,"15min":157.47},"last":0.61799999999999999},{"interface":"front","average":{"1min":2.9689999999999999,"5min":4.2169999999999996,"15min":3.4950000000000001},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40500000000000003},"max":{"1min":25.087,"5min":102.501,"15min":189.161},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":3.7050000000000001,"5min":2.4329999999999998,"15min":2.4540000000000002},"min":{"1min":0.51200000000000001,"5min":0.42799999999999999,"15min":0.40799999999999997},"max":{"1min":16.780000000000001,"5min":22.468,"15min":150.14500000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.7770000000000001,"15min":3.141},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":13.538,"5min":50.697000000000003,"15min":165.47},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":2.895,"5min":3.2250000000000001,"15min":2.9510000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":22.823,"5min":43.024999999999999,"15min":179.703},"last":0.88500000000000001},{"interface":"front","average":{"1min":2.8399999999999999,"5min":2.5190000000000001,"15min":2.6240000000000001},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":14.167,"5min":27.515999999999998,"15min":135.15899999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":2.0699999999999998,"15min":3.0369999999999999},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":6.7800000000000002,"5min":15.85,"15min":148.93899999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":3.258,"5min":3.2130000000000001,"15min":3.1549999999999998},"min":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":22.765999999999998,"5min":59.588999999999999,"15min":215.81299999999999},"last":0.82499999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542464,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":932936,"kb_used_data":53888,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93438904,"statfs":{"total":96636764160,"available":95681437696,"internally_reserved":0,"allocated":55181312,"data_stored":54991825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":5.7800000000000002,"15min":5.9690000000000003},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":5.165,"5min":220.36600000000001,"15min":440.25299999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.645,"5min":3.5840000000000001,"15min":3.8069999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.31900000000000001},"max":{"1min":8.4920000000000009,"5min":94.004999999999995,"15min":397.101},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":4.2750000000000004,"15min":4.6559999999999997},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":8.5389999999999997,"5min":101.113,"15min":396.98899999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.752,"5min":2.7229999999999999,"15min":3.0760000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":8.2710000000000008,"5min":32.863,"15min":367.47399999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":5.6289999999999996,"15min":6.3410000000000002},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":9.8780000000000001,"5min":217.352,"15min":440.32400000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.827,"5min":3.3700000000000001,"15min":4.2469999999999999},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":8.5999999999999996,"5min":93.968999999999994,"15min":396.67700000000002},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":3.3929999999999998,"15min":3.5059999999999998},"min":{"1min":0.54500000000000004,"5min":0.44800000000000001,"15min":0.41799999999999998},"max":{"1min":12.919,"5min":32.831000000000003,"15min":367.52499999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":2.895,"5min":6.1520000000000001,"15min":6.0720000000000001},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":10.57,"5min":223.80000000000001,"15min":440.197},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.0579999999999998,"5min":3.5830000000000002,"15min":4.4829999999999997},"min":{"1min":0.61099999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":8.5690000000000008,"5min":94.930999999999997,"15min":396.73599999999999},"last":0.627},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.8100000000000001,"15min":4.4009999999999998},"min":{"1min":0.52000000000000002,"5min":0.439,"15min":0.38},"max":{"1min":12.996,"5min":32.759999999999998,"15min":366.06},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":4.891,"15min":6.5919999999999996},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.32100000000000001},"max":{"1min":30.117999999999999,"5min":132.136,"15min":440.358},"last":0.36699999999999999},{"interface":"front","average":{"1min":3.359,"5min":4.008,"15min":5.2110000000000003},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":11.356999999999999,"5min":95.834999999999994,"15min":400.21199999999999},"last":0.42599999999999999}]},{"osd":7,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":6.649,"5min":4.2000000000000002,"15min":3.3450000000000002},"min":{"1min":0.56899999999999995,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":45.661000000000001,"5min":45.661000000000001,"15min":121.637},"last":0.52600000000000002},{"interface":"front","average":{"1min":7.0890000000000004,"5min":5.1230000000000002,"15min":6.5670000000000002},"min":{"1min":0.56999999999999995,"5min":0.5,"15min":0.40600000000000003},"max":{"1min":60.430999999999997,"5min":132.084,"15min":440.291},"last":0.40000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":829488,"kb_used_data":50344,"kb_used_omap":1,"kb_used_meta":779134,"kb_avail":93542352,"statfs":{"total":96636764160,"available":95787368448,"internally_reserved":0,"allocated":51552256,"data_stored":51367260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":797833670},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":2.915,"15min":1.9750000000000001},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":13.369,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":2.4260000000000002,"5min":2.286,"15min":1.736},"min":{"1min":0.373,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":15.297000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.3599999999999999,"15min":1.7},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":16.277000000000001,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.6240000000000001,"15min":1.861},"min":{"1min":0.45000000000000001,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":16.321999999999999,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":2.4750000000000001,"15min":1.825},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":13.664999999999999,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":2.9119999999999999,"5min":3.266,"15min":2.2549999999999999},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":15.089,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6469999999999998,"5min":2.6589999999999998,"15min":1.9870000000000001},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.41199999999999998},"max":{"1min":16.359000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6459999999999999,"15min":2.0390000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":13.775,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.1579999999999999,"5min":5.8890000000000002,"15min":4.2229999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":13.646000000000001,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.9860000000000002,"5min":3.4940000000000002,"15min":3.1560000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":22.885999999999999,"5min":55.484999999999999,"15min":174.684},"last":0.754}]},{"osd":6,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":3.7639999999999998,"15min":2.8769999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":28.108000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":3.5299999999999998,"5min":4.4050000000000002,"15min":3.4620000000000002},"min":{"1min":0.56100000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":16.550999999999998,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":6.6379999999999999,"5min":3.7829999999999999,"15min":2.6190000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.42999999999999999},"max":{"1min":80.727999999999994,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":8.5060000000000002,"5min":5.069,"15min":3.1259999999999999},"min":{"1min":0.53100000000000003,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":92.790999999999997,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51838976,"data_stored":51830699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49025024,"data_stored":49017353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92483584,"data_stored":92471622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3166208,"data_stored":3166208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1069056,"data_stored":1069056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":208896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2228224,"data_stored":2228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":1667072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:18:26.888 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:18:27.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.190+0000 7fb014800700 1 Processor -- start 2024-05-10T05:18:27.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.190+0000 7fb014800700 1 -- start start 2024-05-10T05:18:27.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb014800700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb00c06c3b0 0x7fb00c0c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb014800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c6560 0x7fb00c15fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb014800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00c159410 con 0x7fb00c0c6020 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb014800700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c06cdf0 con 0x7fb00c06c3b0 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb014800700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb00c06c8b0 con 0x7fb00c0c6560 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb011e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7fb00c06c3b0 0x7fb00c0c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb011400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fb00c0c6020 0x7fb00c0c8850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37240/0 (socket says 172.21.15.47:37240) 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.192+0000 7fb011400700 1 -- 172.21.15.47:0/3219407077 learned_addr learned my addr 172.21.15.47:0/3219407077 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:27.193 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb012800700 1 --2- 172.21.15.47:0/3219407077 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c6560 0x7fb00c15fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb011e00700 1 -- 172.21.15.47:0/3219407077 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c6560 msgr2=0x7fb00c15fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb011e00700 1 --2- 172.21.15.47:0/3219407077 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c6560 0x7fb00c15fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb011e00700 1 -- 172.21.15.47:0/3219407077 >> v1:172.21.15.47:6789/0 conn(0x7fb00c0c6020 legacy=0x7fb00c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb011e00700 1 -- 172.21.15.47:0/3219407077 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c158ae0 con 0x7fb00c06c3b0 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb012800700 1 --2- 172.21.15.47:0/3219407077 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c6560 0x7fb00c15fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb010a00700 1 -- 172.21.15.47:0/3219407077 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049543828 0 0) 0x7fb00c159410 con 0x7fb00c0c6020 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb011e00700 1 --2- 172.21.15.47:0/3219407077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c06c3b0 0x7fb00c0c5ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb00c1565e0 tx=0x7fb000009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5fdb9fdf1b2dbe server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb010a00700 1 -- 172.21.15.47:0/3219407077 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011830 con 0x7fb00c06c3b0 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb010a00700 1 -- 172.21.15.47:0/3219407077 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000011990 con 0x7fb00c06c3b0 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.193+0000 7fb010a00700 1 -- 172.21.15.47:0/3219407077 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb000011d20 con 0x7fb00c06c3b0 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 -- 172.21.15.47:0/3219407077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c06c3b0 msgr2=0x7fb00c0c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.195 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 --2- 172.21.15.47:0/3219407077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c06c3b0 0x7fb00c0c5ae0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb00c1565e0 tx=0x7fb000009b20 comp rx=0 tx=0).stop 2024-05-10T05:18:27.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 -- 172.21.15.47:0/3219407077 shutdown_connections 2024-05-10T05:18:27.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 --2- 172.21.15.47:0/3219407077 >> v2:172.21.15.117:3300/0 conn(0x7fb00c0c6560 0x7fb00c15fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 --2- 172.21.15.47:0/3219407077 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c06c3b0 0x7fb00c0c5ae0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 -- 172.21.15.47:0/3219407077 >> 172.21.15.47:0/3219407077 conn(0x7fb00c0ca950 msgr2=0x7fb00c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:27.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 -- 172.21.15.47:0/3219407077 shutdown_connections 2024-05-10T05:18:27.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.194+0000 7fb014800700 1 -- 172.21.15.47:0/3219407077 wait complete. 2024-05-10T05:18:27.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.197+0000 7fb014800700 1 Processor -- start 2024-05-10T05:18:27.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.197+0000 7fb014800700 1 -- start start 2024-05-10T05:18:27.200 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb014800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c06c3b0 0x7fb00c14dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb014800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 0x7fb00c1ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb014800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c6560 0x7fb00c1418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb014800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c14ec90 con 0x7fb00c0c6020 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb014800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c153670 con 0x7fb00c0c6560 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb014800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00c1ef2c0 con 0x7fb00c06c3b0 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb011400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 0x7fb00c1ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb011400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 0x7fb00c1ee7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55848/0 (socket says 172.21.15.47:55848) 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb011400700 1 -- 172.21.15.47:0/2967600365 learned_addr learned my addr 172.21.15.47:0/2967600365 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb011e00700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c06c3b0 0x7fb00c14dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.199+0000 7fb012800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c6560 0x7fb00c1418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011400700 1 -- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c06c3b0 msgr2=0x7fb00c14dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.201 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011400700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c06c3b0 0x7fb00c14dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011400700 1 -- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c6560 msgr2=0x7fb00c1418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011400700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c6560 0x7fb00c1418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011400700 1 -- 172.21.15.47:0/2967600365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0000094a0 con 0x7fb00c0c6020 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011e00700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c06c3b0 0x7fb00c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb012800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c6560 0x7fb00c1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb011400700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 0x7fb00c1ee7e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c580 tx=0x7faffc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc004c80 con 0x7fb00c0c6020 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faffc004e00 con 0x7fb00c0c6020 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb00c14db60 con 0x7fb00c0c6020 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faffc007310 con 0x7fb00c0c6020 2024-05-10T05:18:27.202 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.200+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb00c155680 con 0x7fb00c0c6020 2024-05-10T05:18:27.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.201+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb00c14d900 con 0x7fb00c0c6020 2024-05-10T05:18:27.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.202+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faffc007470 con 0x7fb00c0c6020 2024-05-10T05:18:27.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.203+0000 7fb006000700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faff006acc0 0x7faff006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.203 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.203+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faffc089500 con 0x7fb00c0c6020 2024-05-10T05:18:27.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.204+0000 7fb011e00700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faff006acc0 0x7faff006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.204 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.204+0000 7fb011e00700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faff006acc0 0x7faff006d1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb0000090b0 tx=0x7fb00001c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:27.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.208+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7faffc054200 con 0x7fb00c0c6020 2024-05-10T05:18:27.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.420+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb00c1598a0 con 0x7faff006acc0 2024-05-10T05:18:27.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.431+0000 7fb006000700 1 -- 172.21.15.47:0/2967600365 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372017 (secure 0 0 0) 0x7fb000011c80 con 0x7faff006acc0 2024-05-10T05:18:27.438 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faff006acc0 msgr2=0x7faff006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faff006acc0 0x7faff006d1d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb0000090b0 tx=0x7fb00001c040 comp rx=0 tx=0).stop 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 msgr2=0x7fb00c1ee7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 0x7fb00c1ee7e0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faffc00c580 tx=0x7faffc00c940 comp rx=0 tx=0).stop 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 shutdown_connections 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fb00c0c6560 0x7fb00c1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7faff006acc0 0x7faff006d1d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fb00c06c3b0 0x7fb00c14dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.441 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 --2- 172.21.15.47:0/2967600365 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fb00c0c6020 0x7fb00c1ee7e0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 >> 172.21.15.47:0/2967600365 conn(0x7fb00c0ca950 msgr2=0x7fb00c0cad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:27.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 shutdown_connections 2024-05-10T05:18:27.442 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.436+0000 7fb014800700 1 -- 172.21.15.47:0/2967600365 wait complete. 2024-05-10T05:18:27.442 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:18:27.465 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":822,"stamp":"2024-05-10T05:18:26.688379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239161496,"num_objects":162,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":4750,"num_read_kb":580552,"num_write":359263,"num_write_kb":31012754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":528967,"ondisk_log_size":528967,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7031924,"kb_used_data":510900,"kb_used_omap":12,"kb_used_meta":6520947,"kb_avail":747942796,"statfs":{"total":773094113280,"available":765893423104,"internally_reserved":0,"allocated":523161600,"data_stored":521673140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6677450296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,5,5,16,13,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-286034677,"num_objects":-2340,"num_object_clones":0,"num_object_copies":-8168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2340,"num_whiteouts":0,"num_read":12,"num_read_kb":252,"num_write":3957,"num_write_kb":51541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.3f","version":"28'1979","reported_seq":2007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.435363+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T05:18:21.435363+0000","last_peered":"2024-05-10T05:18:21.435363+0000","last_clean":"2024-05-10T05:18:21.435363+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:18:21.435363+0000","last_undegraded":"2024-05-10T05:18:21.435363+0000","last_fullsized":"2024-05-10T05:18:21.435363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1976","reported_seq":2004,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.385071+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T05:18:21.385071+0000","last_peered":"2024-05-10T05:18:21.385071+0000","last_clean":"2024-05-10T05:18:21.385071+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:21.385071+0000","last_undegraded":"2024-05-10T05:18:21.385071+0000","last_fullsized":"2024-05-10T05:18:21.385071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2121","reported_seq":2149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.418630+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T05:18:21.418630+0000","last_peered":"2024-05-10T05:18:21.418630+0000","last_clean":"2024-05-10T05:18:21.418630+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:18:21.418630+0000","last_undegraded":"2024-05-10T05:18:21.418630+0000","last_fullsized":"2024-05-10T05:18:21.418630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2096","reported_seq":2125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.615639+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T05:18:21.615639+0000","last_peered":"2024-05-10T05:18:21.615639+0000","last_clean":"2024-05-10T05:18:21.615639+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:18:21.615639+0000","last_undegraded":"2024-05-10T05:18:21.615639+0000","last_fullsized":"2024-05-10T05:18:21.615639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2057","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646797+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T05:18:21.646797+0000","last_peered":"2024-05-10T05:18:21.646797+0000","last_clean":"2024-05-10T05:18:21.646797+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:18:21.646797+0000","last_undegraded":"2024-05-10T05:18:21.646797+0000","last_fullsized":"2024-05-10T05:18:21.646797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1962","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.623718+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T05:18:21.623718+0000","last_peered":"2024-05-10T05:18:21.623718+0000","last_clean":"2024-05-10T05:18:21.623718+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:18:21.623718+0000","last_undegraded":"2024-05-10T05:18:21.623718+0000","last_fullsized":"2024-05-10T05:18:21.623718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1962,"log_dups_size":0,"ondisk_log_size":1962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2001","reported_seq":2027,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.571299+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T05:18:21.571299+0000","last_peered":"2024-05-10T05:18:21.571299+0000","last_clean":"2024-05-10T05:18:21.571299+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:18:21.571299+0000","last_undegraded":"2024-05-10T05:18:21.571299+0000","last_fullsized":"2024-05-10T05:18:21.571299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2001,"log_dups_size":0,"ondisk_log_size":2001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2014","reported_seq":2040,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.692324+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T05:18:21.692324+0000","last_peered":"2024-05-10T05:18:21.692324+0000","last_clean":"2024-05-10T05:18:21.692324+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:18:21.692324+0000","last_undegraded":"2024-05-10T05:18:21.692324+0000","last_fullsized":"2024-05-10T05:18:21.692324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2014,"log_dups_size":0,"ondisk_log_size":2014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2072","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.463408+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T05:18:21.463408+0000","last_peered":"2024-05-10T05:18:21.463408+0000","last_clean":"2024-05-10T05:18:21.463408+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:18:21.463408+0000","last_undegraded":"2024-05-10T05:18:21.463408+0000","last_fullsized":"2024-05-10T05:18:21.463408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2074","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.378924+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T05:18:21.378924+0000","last_peered":"2024-05-10T05:18:21.378924+0000","last_clean":"2024-05-10T05:18:21.378924+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:18:21.378924+0000","last_undegraded":"2024-05-10T05:18:21.378924+0000","last_fullsized":"2024-05-10T05:18:21.378924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1952","reported_seq":1978,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.640372+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T05:18:21.640372+0000","last_peered":"2024-05-10T05:18:21.640372+0000","last_clean":"2024-05-10T05:18:21.640372+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:21.640372+0000","last_undegraded":"2024-05-10T05:18:21.640372+0000","last_fullsized":"2024-05-10T05:18:21.640372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.011781+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T05:18:26.011781+0000","last_peered":"2024-05-10T05:18:26.011781+0000","last_clean":"2024-05-10T05:18:26.011781+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:26.011781+0000","last_undegraded":"2024-05-10T05:18:26.011781+0000","last_fullsized":"2024-05-10T05:18:26.011781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2019","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.180961+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T05:18:21.180961+0000","last_peered":"2024-05-10T05:18:21.180961+0000","last_clean":"2024-05-10T05:18:21.180961+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:21.180961+0000","last_undegraded":"2024-05-10T05:18:21.180961+0000","last_fullsized":"2024-05-10T05:18:21.180961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'1998","reported_seq":2025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.492776+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T05:18:21.492776+0000","last_peered":"2024-05-10T05:18:21.492776+0000","last_clean":"2024-05-10T05:18:21.492776+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:18:21.492776+0000","last_undegraded":"2024-05-10T05:18:21.492776+0000","last_fullsized":"2024-05-10T05:18:21.492776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2101","reported_seq":2128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.391747+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T05:18:21.391747+0000","last_peered":"2024-05-10T05:18:21.391747+0000","last_clean":"2024-05-10T05:18:21.391747+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:21.391747+0000","last_undegraded":"2024-05-10T05:18:21.391747+0000","last_fullsized":"2024-05-10T05:18:21.391747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1983","reported_seq":2010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.329214+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T05:18:21.329214+0000","last_peered":"2024-05-10T05:18:21.329214+0000","last_clean":"2024-05-10T05:18:21.329214+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:18:21.329214+0000","last_undegraded":"2024-05-10T05:18:21.329214+0000","last_fullsized":"2024-05-10T05:18:21.329214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.534366+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T05:18:21.534366+0000","last_peered":"2024-05-10T05:18:21.534366+0000","last_clean":"2024-05-10T05:18:21.534366+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:21.534366+0000","last_undegraded":"2024-05-10T05:18:21.534366+0000","last_fullsized":"2024-05-10T05:18:21.534366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1984","reported_seq":2011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.516969+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T05:18:21.516969+0000","last_peered":"2024-05-10T05:18:21.516969+0000","last_clean":"2024-05-10T05:18:21.516969+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:21.516969+0000","last_undegraded":"2024-05-10T05:18:21.516969+0000","last_fullsized":"2024-05-10T05:18:21.516969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2096","reported_seq":2123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.411806+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T05:18:21.411806+0000","last_peered":"2024-05-10T05:18:21.411806+0000","last_clean":"2024-05-10T05:18:21.411806+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:18:21.411806+0000","last_undegraded":"2024-05-10T05:18:21.411806+0000","last_fullsized":"2024-05-10T05:18:21.411806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.607874+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T05:18:21.607874+0000","last_peered":"2024-05-10T05:18:21.607874+0000","last_clean":"2024-05-10T05:18:21.607874+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:18:21.607874+0000","last_undegraded":"2024-05-10T05:18:21.607874+0000","last_fullsized":"2024-05-10T05:18:21.607874+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1884","reported_seq":1913,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:11.384889+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T05:18:11.384889+0000","last_peered":"2024-05-10T05:18:11.384889+0000","last_clean":"2024-05-10T05:18:11.384889+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:11.384889+0000","last_undegraded":"2024-05-10T05:18:11.384889+0000","last_fullsized":"2024-05-10T05:18:11.384889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1884,"log_dups_size":0,"ondisk_log_size":1884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1908,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2034","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.546869+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T05:18:21.546869+0000","last_peered":"2024-05-10T05:18:21.546869+0000","last_clean":"2024-05-10T05:18:21.546869+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:18:21.546869+0000","last_undegraded":"2024-05-10T05:18:21.546869+0000","last_fullsized":"2024-05-10T05:18:21.546869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7649,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.752342+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T05:18:21.752342+0000","last_peered":"2024-05-10T05:18:21.752342+0000","last_clean":"2024-05-10T05:18:21.752342+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:18:21.752342+0000","last_undegraded":"2024-05-10T05:18:21.752342+0000","last_fullsized":"2024-05-10T05:18:21.752342+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6434","reported_seq":6464,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.263876+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T05:18:23.263876+0000","last_peered":"2024-05-10T05:18:23.263876+0000","last_clean":"2024-05-10T05:18:23.263876+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:23.263876+0000","last_undegraded":"2024-05-10T05:18:23.263876+0000","last_fullsized":"2024-05-10T05:18:23.263876+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6334,"log_dups_size":0,"ondisk_log_size":6334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2034","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.866776+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T05:18:20.866776+0000","last_peered":"2024-05-10T05:18:20.866776+0000","last_clean":"2024-05-10T05:18:20.866776+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:20.866776+0000","last_undegraded":"2024-05-10T05:18:20.866776+0000","last_fullsized":"2024-05-10T05:18:20.866776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7722,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.767261+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T05:18:21.767261+0000","last_peered":"2024-05-10T05:18:21.767261+0000","last_clean":"2024-05-10T05:18:21.767261+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:18:21.767261+0000","last_undegraded":"2024-05-10T05:18:21.767261+0000","last_fullsized":"2024-05-10T05:18:21.767261+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9861","reported_seq":9888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:15.507820+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T05:18:15.507820+0000","last_peered":"2024-05-10T05:18:15.507820+0000","last_clean":"2024-05-10T05:18:15.507820+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:15.507820+0000","last_undegraded":"2024-05-10T05:18:15.507820+0000","last_fullsized":"2024-05-10T05:18:15.507820+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9864,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2085","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.661342+0000","last_change":"2024-05-10T04:52:40.336526+0000","last_active":"2024-05-10T05:18:21.661342+0000","last_peered":"2024-05-10T05:18:21.661342+0000","last_clean":"2024-05-10T05:18:21.661342+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:18:21.661342+0000","last_undegraded":"2024-05-10T05:18:21.661342+0000","last_fullsized":"2024-05-10T05:18:21.661342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:27.704427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.835011+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T05:18:25.835011+0000","last_peered":"2024-05-10T05:18:25.835011+0000","last_clean":"2024-05-10T05:18:25.835011+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:25.835011+0000","last_undegraded":"2024-05-10T05:18:25.835011+0000","last_fullsized":"2024-05-10T05:18:25.835011+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5467","reported_seq":5494,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:41.051134+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T05:17:41.051134+0000","last_peered":"2024-05-10T05:17:41.051134+0000","last_clean":"2024-05-10T05:17:41.051134+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:17:41.051134+0000","last_undegraded":"2024-05-10T05:17:41.051134+0000","last_fullsized":"2024-05-10T05:17:41.051134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5467,"log_dups_size":0,"ondisk_log_size":5467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5467,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2019","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.549021+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T05:18:20.549021+0000","last_peered":"2024-05-10T05:18:20.549021+0000","last_clean":"2024-05-10T05:18:20.549021+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:18:20.549021+0000","last_undegraded":"2024-05-10T05:18:20.549021+0000","last_fullsized":"2024-05-10T05:18:20.549021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7512","reported_seq":7575,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.445358+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T05:18:21.445358+0000","last_peered":"2024-05-10T05:18:21.445358+0000","last_clean":"2024-05-10T05:18:21.445358+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:18:21.445358+0000","last_undegraded":"2024-05-10T05:18:21.445358+0000","last_fullsized":"2024-05-10T05:18:21.445358+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6298,"log_dups_size":0,"ondisk_log_size":6298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5293,"num_write_kb":975875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8788","reported_seq":8815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.292792+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T05:18:23.292792+0000","last_peered":"2024-05-10T05:18:23.292792+0000","last_clean":"2024-05-10T05:18:23.292792+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:23.292792+0000","last_undegraded":"2024-05-10T05:18:23.292792+0000","last_fullsized":"2024-05-10T05:18:23.292792+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.946403+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T05:18:25.946403+0000","last_peered":"2024-05-10T05:18:25.946403+0000","last_clean":"2024-05-10T05:18:25.946403+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:25.946403+0000","last_undegraded":"2024-05-10T05:18:25.946403+0000","last_fullsized":"2024-05-10T05:18:25.946403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7545,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771999+0000","last_change":"2024-05-10T04:52:40.388737+0000","last_active":"2024-05-10T05:18:21.771999+0000","last_peered":"2024-05-10T05:18:21.771999+0000","last_clean":"2024-05-10T05:18:21.771999+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:21.771999+0000","last_undegraded":"2024-05-10T05:18:21.771999+0000","last_fullsized":"2024-05-10T05:18:21.771999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:03:27.377522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9788","reported_seq":9815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.287881+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T05:18:23.287881+0000","last_peered":"2024-05-10T05:18:23.287881+0000","last_clean":"2024-05-10T05:18:23.287881+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:23.287881+0000","last_undegraded":"2024-05-10T05:18:23.287881+0000","last_fullsized":"2024-05-10T05:18:23.287881+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7988,"log_dups_size":0,"ondisk_log_size":7988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2023","reported_seq":2049,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.731928+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T05:18:21.731928+0000","last_peered":"2024-05-10T05:18:21.731928+0000","last_clean":"2024-05-10T05:18:21.731928+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:21.731928+0000","last_undegraded":"2024-05-10T05:18:21.731928+0000","last_fullsized":"2024-05-10T05:18:21.731928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7234","reported_seq":7476,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.453872+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T05:18:21.453872+0000","last_peered":"2024-05-10T05:18:21.453872+0000","last_clean":"2024-05-10T05:18:21.453872+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:18:21.453872+0000","last_undegraded":"2024-05-10T05:18:21.453872+0000","last_fullsized":"2024-05-10T05:18:21.453872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7234,"log_dups_size":0,"ondisk_log_size":7234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5147,"num_write_kb":870087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4833","reported_seq":4860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.260650+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T05:18:23.260650+0000","last_peered":"2024-05-10T05:18:23.260650+0000","last_clean":"2024-05-10T05:18:23.260650+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:23.260650+0000","last_undegraded":"2024-05-10T05:18:23.260650+0000","last_fullsized":"2024-05-10T05:18:23.260650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2098","reported_seq":2124,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.636425+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T05:18:21.636425+0000","last_peered":"2024-05-10T05:18:21.636425+0000","last_clean":"2024-05-10T05:18:21.636425+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:21.636425+0000","last_undegraded":"2024-05-10T05:18:21.636425+0000","last_fullsized":"2024-05-10T05:18:21.636425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.691448+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T05:18:21.691448+0000","last_peered":"2024-05-10T05:18:21.691448+0000","last_clean":"2024-05-10T05:18:21.691448+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:18:21.691448+0000","last_undegraded":"2024-05-10T05:18:21.691448+0000","last_fullsized":"2024-05-10T05:18:21.691448+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9719","reported_seq":9746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:11.532711+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T05:16:11.532711+0000","last_peered":"2024-05-10T05:16:11.532711+0000","last_clean":"2024-05-10T05:16:11.532711+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:16:11.532711+0000","last_undegraded":"2024-05-10T05:16:11.532711+0000","last_fullsized":"2024-05-10T05:16:11.532711+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7519,"log_dups_size":0,"ondisk_log_size":7519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2000","reported_seq":2026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.264771+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T05:18:21.264771+0000","last_peered":"2024-05-10T05:18:21.264771+0000","last_clean":"2024-05-10T05:18:21.264771+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:21.264771+0000","last_undegraded":"2024-05-10T05:18:21.264771+0000","last_fullsized":"2024-05-10T05:18:21.264771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.738124+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T05:18:21.738124+0000","last_peered":"2024-05-10T05:18:21.738124+0000","last_clean":"2024-05-10T05:18:21.738124+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:18:21.738124+0000","last_undegraded":"2024-05-10T05:18:21.738124+0000","last_fullsized":"2024-05-10T05:18:21.738124+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6180","reported_seq":6949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.266389+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T05:18:23.266389+0000","last_peered":"2024-05-10T05:18:23.266389+0000","last_clean":"2024-05-10T05:18:23.266389+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:23.266389+0000","last_undegraded":"2024-05-10T05:18:23.266389+0000","last_fullsized":"2024-05-10T05:18:23.266389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11268527,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6176,"num_write_kb":47861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2036","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.673680+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T05:18:21.673680+0000","last_peered":"2024-05-10T05:18:21.673680+0000","last_clean":"2024-05-10T05:18:21.673680+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:18:21.673680+0000","last_undegraded":"2024-05-10T05:18:21.673680+0000","last_fullsized":"2024-05-10T05:18:21.673680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7404","reported_seq":7465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.352634+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T05:18:21.352634+0000","last_peered":"2024-05-10T05:18:21.352634+0000","last_clean":"2024-05-10T05:18:21.352634+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:18:21.352634+0000","last_undegraded":"2024-05-10T05:18:21.352634+0000","last_fullsized":"2024-05-10T05:18:21.352634+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5300,"num_write_kb":989171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6454","reported_seq":6481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:02.756886+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T05:17:02.756886+0000","last_peered":"2024-05-10T05:17:02.756886+0000","last_clean":"2024-05-10T05:17:02.756886+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:17:02.756886+0000","last_undegraded":"2024-05-10T05:17:02.756886+0000","last_fullsized":"2024-05-10T05:17:02.756886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6454,"log_dups_size":0,"ondisk_log_size":6454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6456,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2049","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.481740+0000","last_change":"2024-05-10T04:52:41.276730+0000","last_active":"2024-05-10T05:18:21.481740+0000","last_peered":"2024-05-10T05:18:21.481740+0000","last_clean":"2024-05-10T05:18:21.481740+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:21.481740+0000","last_undegraded":"2024-05-10T05:18:21.481740+0000","last_fullsized":"2024-05-10T05:18:21.481740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:15:47.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.303883+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T05:18:21.303883+0000","last_peered":"2024-05-10T05:18:21.303883+0000","last_clean":"2024-05-10T05:18:21.303883+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:21.303883+0000","last_undegraded":"2024-05-10T05:18:21.303883+0000","last_fullsized":"2024-05-10T05:18:21.303883+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5954","reported_seq":5982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.792542+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T05:18:21.792542+0000","last_peered":"2024-05-10T05:18:21.792542+0000","last_clean":"2024-05-10T05:18:21.792542+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:21.792542+0000","last_undegraded":"2024-05-10T05:18:21.792542+0000","last_fullsized":"2024-05-10T05:18:21.792542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5954,"log_dups_size":0,"ondisk_log_size":5954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5958,"num_write_kb":37125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2074,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.017985+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T05:18:26.017985+0000","last_peered":"2024-05-10T05:18:26.017985+0000","last_clean":"2024-05-10T05:18:26.017985+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:26.017985+0000","last_undegraded":"2024-05-10T05:18:26.017985+0000","last_fullsized":"2024-05-10T05:18:26.017985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7573","reported_seq":7638,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.663837+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T05:18:21.663837+0000","last_peered":"2024-05-10T05:18:21.663837+0000","last_clean":"2024-05-10T05:18:21.663837+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:18:21.663837+0000","last_undegraded":"2024-05-10T05:18:21.663837+0000","last_fullsized":"2024-05-10T05:18:21.663837+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7373,"log_dups_size":0,"ondisk_log_size":7373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5439,"num_write_kb":922918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9427","reported_seq":10122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.255904+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T05:18:23.255904+0000","last_peered":"2024-05-10T05:18:23.255904+0000","last_clean":"2024-05-10T05:18:23.255904+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:23.255904+0000","last_undegraded":"2024-05-10T05:18:23.255904+0000","last_fullsized":"2024-05-10T05:18:23.255904+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7927,"log_dups_size":0,"ondisk_log_size":7927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9421,"num_write_kb":67820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1986","reported_seq":2012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.527409+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T05:18:21.527409+0000","last_peered":"2024-05-10T05:18:21.527409+0000","last_clean":"2024-05-10T05:18:21.527409+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:18:21.527409+0000","last_undegraded":"2024-05-10T05:18:21.527409+0000","last_fullsized":"2024-05-10T05:18:21.527409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7643,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771899+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T05:18:21.771899+0000","last_peered":"2024-05-10T05:18:21.771899+0000","last_clean":"2024-05-10T05:18:21.771899+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:18:21.771899+0000","last_undegraded":"2024-05-10T05:18:21.771899+0000","last_fullsized":"2024-05-10T05:18:21.771899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4828","reported_seq":4856,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:36.424284+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T05:17:36.424284+0000","last_peered":"2024-05-10T05:17:36.424284+0000","last_clean":"2024-05-10T05:17:36.424284+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:17:36.424284+0000","last_undegraded":"2024-05-10T05:17:36.424284+0000","last_fullsized":"2024-05-10T05:17:36.424284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4830,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2045","reported_seq":2072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.658582+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T05:18:21.658582+0000","last_peered":"2024-05-10T05:18:21.658582+0000","last_clean":"2024-05-10T05:18:21.658582+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:21.658582+0000","last_undegraded":"2024-05-10T05:18:21.658582+0000","last_fullsized":"2024-05-10T05:18:21.658582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.612571+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T05:18:21.612571+0000","last_peered":"2024-05-10T05:18:21.612571+0000","last_clean":"2024-05-10T05:18:21.612571+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:18:21.612571+0000","last_undegraded":"2024-05-10T05:18:21.612571+0000","last_fullsized":"2024-05-10T05:18:21.612571+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2070","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:22.489142+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T05:16:22.489142+0000","last_peered":"2024-05-10T05:16:22.489142+0000","last_clean":"2024-05-10T05:16:22.489142+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:16:22.489142+0000","last_undegraded":"2024-05-10T05:16:22.489142+0000","last_fullsized":"2024-05-10T05:16:22.489142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2085,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.957994+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T05:18:20.957994+0000","last_peered":"2024-05-10T05:18:20.957994+0000","last_clean":"2024-05-10T05:18:20.957994+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:20.957994+0000","last_undegraded":"2024-05-10T05:18:20.957994+0000","last_fullsized":"2024-05-10T05:18:20.957994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.745422+0000","last_change":"2024-05-10T04:52:41.239639+0000","last_active":"2024-05-10T05:18:21.745422+0000","last_peered":"2024-05-10T05:18:21.745422+0000","last_clean":"2024-05-10T05:18:21.745422+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:18:21.745422+0000","last_undegraded":"2024-05-10T05:18:21.745422+0000","last_fullsized":"2024-05-10T05:18:21.745422+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:53.938219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2468,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.256049+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T05:18:23.256049+0000","last_peered":"2024-05-10T05:18:23.256049+0000","last_clean":"2024-05-10T05:18:23.256049+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:23.256049+0000","last_undegraded":"2024-05-10T05:18:23.256049+0000","last_fullsized":"2024-05-10T05:18:23.256049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2002","reported_seq":2029,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.758978+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T05:18:20.758978+0000","last_peered":"2024-05-10T05:18:20.758978+0000","last_clean":"2024-05-10T05:18:20.758978+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:20.758978+0000","last_undegraded":"2024-05-10T05:18:20.758978+0000","last_fullsized":"2024-05-10T05:18:20.758978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.702456+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T05:18:21.702456+0000","last_peered":"2024-05-10T05:18:21.702456+0000","last_clean":"2024-05-10T05:18:21.702456+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:18:21.702456+0000","last_undegraded":"2024-05-10T05:18:21.702456+0000","last_fullsized":"2024-05-10T05:18:21.702456+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3403","reported_seq":3431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.249528+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T05:18:23.249528+0000","last_peered":"2024-05-10T05:18:23.249528+0000","last_clean":"2024-05-10T05:18:23.249528+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:23.249528+0000","last_undegraded":"2024-05-10T05:18:23.249528+0000","last_fullsized":"2024-05-10T05:18:23.249528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3413,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2087","reported_seq":2108,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.226511+0000","last_change":"2024-05-10T04:52:40.334760+0000","last_active":"2024-05-10T05:18:23.226511+0000","last_peered":"2024-05-10T05:18:23.226511+0000","last_clean":"2024-05-10T05:18:23.226511+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:18:23.226511+0000","last_undegraded":"2024-05-10T05:18:23.226511+0000","last_fullsized":"2024-05-10T05:18:23.226511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2087,"log_dups_size":0,"ondisk_log_size":2087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:28.551142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.608166+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T05:18:21.608166+0000","last_peered":"2024-05-10T05:18:21.608166+0000","last_clean":"2024-05-10T05:18:21.608166+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:18:21.608166+0000","last_undegraded":"2024-05-10T05:18:21.608166+0000","last_fullsized":"2024-05-10T05:18:21.608166+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4728","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.283608+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T05:18:23.283608+0000","last_peered":"2024-05-10T05:18:23.283608+0000","last_clean":"2024-05-10T05:18:23.283608+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:23.283608+0000","last_undegraded":"2024-05-10T05:18:23.283608+0000","last_fullsized":"2024-05-10T05:18:23.283608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2042","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.315918+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T05:18:21.315918+0000","last_peered":"2024-05-10T05:18:21.315918+0000","last_clean":"2024-05-10T05:18:21.315918+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:18:21.315918+0000","last_undegraded":"2024-05-10T05:18:21.315918+0000","last_fullsized":"2024-05-10T05:18:21.315918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.703637+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T05:18:21.703637+0000","last_peered":"2024-05-10T05:18:21.703637+0000","last_clean":"2024-05-10T05:18:21.703637+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:18:21.703637+0000","last_undegraded":"2024-05-10T05:18:21.703637+0000","last_fullsized":"2024-05-10T05:18:21.703637+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6057","reported_seq":6086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:01.041726+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T05:18:01.041726+0000","last_peered":"2024-05-10T05:18:01.041726+0000","last_clean":"2024-05-10T05:18:01.041726+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:01.041726+0000","last_undegraded":"2024-05-10T05:18:01.041726+0000","last_fullsized":"2024-05-10T05:18:01.041726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6057,"log_dups_size":0,"ondisk_log_size":6057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6062,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2022","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.725133+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T05:18:21.725133+0000","last_peered":"2024-05-10T05:18:21.725133+0000","last_clean":"2024-05-10T05:18:21.725133+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:18:21.725133+0000","last_undegraded":"2024-05-10T05:18:21.725133+0000","last_fullsized":"2024-05-10T05:18:21.725133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8411,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.766997+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T05:18:21.766997+0000","last_peered":"2024-05-10T05:18:21.766997+0000","last_clean":"2024-05-10T05:18:21.766997+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:18:21.766997+0000","last_undegraded":"2024-05-10T05:18:21.766997+0000","last_fullsized":"2024-05-10T05:18:21.766997+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7061","reported_seq":7090,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:52.704728+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T05:16:52.704728+0000","last_peered":"2024-05-10T05:16:52.704728+0000","last_clean":"2024-05-10T05:16:52.704728+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:16:52.704728+0000","last_undegraded":"2024-05-10T05:16:52.704728+0000","last_fullsized":"2024-05-10T05:16:52.704728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7057,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.967879+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T05:18:25.967879+0000","last_peered":"2024-05-10T05:18:25.967879+0000","last_clean":"2024-05-10T05:18:25.967879+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:25.967879+0000","last_undegraded":"2024-05-10T05:18:25.967879+0000","last_fullsized":"2024-05-10T05:18:25.967879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7588,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.715058+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T05:18:21.715058+0000","last_peered":"2024-05-10T05:18:21.715058+0000","last_clean":"2024-05-10T05:18:21.715058+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:18:21.715058+0000","last_undegraded":"2024-05-10T05:18:21.715058+0000","last_fullsized":"2024-05-10T05:18:21.715058+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2050","reported_seq":2079,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.397473+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T05:18:21.397473+0000","last_peered":"2024-05-10T05:18:21.397473+0000","last_clean":"2024-05-10T05:18:21.397473+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:21.397473+0000","last_undegraded":"2024-05-10T05:18:21.397473+0000","last_fullsized":"2024-05-10T05:18:21.397473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.274962+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T05:18:23.274962+0000","last_peered":"2024-05-10T05:18:23.274962+0000","last_clean":"2024-05-10T05:18:23.274962+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:23.274962+0000","last_undegraded":"2024-05-10T05:18:23.274962+0000","last_fullsized":"2024-05-10T05:18:23.274962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7596,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.759345+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T05:18:21.759345+0000","last_peered":"2024-05-10T05:18:21.759345+0000","last_clean":"2024-05-10T05:18:21.759345+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:18:21.759345+0000","last_undegraded":"2024-05-10T05:18:21.759345+0000","last_fullsized":"2024-05-10T05:18:21.759345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2077","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.685132+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T05:18:21.685132+0000","last_peered":"2024-05-10T05:18:21.685132+0000","last_clean":"2024-05-10T05:18:21.685132+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:18:21.685132+0000","last_undegraded":"2024-05-10T05:18:21.685132+0000","last_fullsized":"2024-05-10T05:18:21.685132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4529","reported_seq":4558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:57.705574+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T05:16:57.705574+0000","last_peered":"2024-05-10T05:16:57.705574+0000","last_clean":"2024-05-10T05:16:57.705574+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:16:57.705574+0000","last_undegraded":"2024-05-10T05:16:57.705574+0000","last_fullsized":"2024-05-10T05:16:57.705574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4530,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:15:56.300717+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T05:15:56.300717+0000","last_peered":"2024-05-10T05:15:56.300717+0000","last_clean":"2024-05-10T05:15:56.300717+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:15:56.300717+0000","last_undegraded":"2024-05-10T05:15:56.300717+0000","last_fullsized":"2024-05-10T05:15:56.300717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.600950+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T05:18:21.600950+0000","last_peered":"2024-05-10T05:18:21.600950+0000","last_clean":"2024-05-10T05:18:21.600950+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:18:21.600950+0000","last_undegraded":"2024-05-10T05:18:21.600950+0000","last_fullsized":"2024-05-10T05:18:21.600950+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1989","reported_seq":2017,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.576508+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T05:18:21.576508+0000","last_peered":"2024-05-10T05:18:21.576508+0000","last_clean":"2024-05-10T05:18:21.576508+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:21.576508+0000","last_undegraded":"2024-05-10T05:18:21.576508+0000","last_fullsized":"2024-05-10T05:18:21.576508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1989,"log_dups_size":0,"ondisk_log_size":1989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6529","reported_seq":6559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:59.156422+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T05:17:59.156422+0000","last_peered":"2024-05-10T05:17:59.156422+0000","last_clean":"2024-05-10T05:17:59.156422+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:17:59.156422+0000","last_undegraded":"2024-05-10T05:17:59.156422+0000","last_fullsized":"2024-05-10T05:17:59.156422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6529,"log_dups_size":0,"ondisk_log_size":6529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6533,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7693,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.682694+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T05:18:21.682694+0000","last_peered":"2024-05-10T05:18:21.682694+0000","last_clean":"2024-05-10T05:18:21.682694+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:18:21.682694+0000","last_undegraded":"2024-05-10T05:18:21.682694+0000","last_fullsized":"2024-05-10T05:18:21.682694+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4963","reported_seq":4992,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:40.979327+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T05:16:40.979327+0000","last_peered":"2024-05-10T05:16:40.979327+0000","last_clean":"2024-05-10T05:16:40.979327+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:16:40.979327+0000","last_undegraded":"2024-05-10T05:16:40.979327+0000","last_fullsized":"2024-05-10T05:16:40.979327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4963,"log_dups_size":0,"ondisk_log_size":4963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4966,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2066","reported_seq":2094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.727974+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T05:18:21.727974+0000","last_peered":"2024-05-10T05:18:21.727974+0000","last_clean":"2024-05-10T05:18:21.727974+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:21.727974+0000","last_undegraded":"2024-05-10T05:18:21.727974+0000","last_fullsized":"2024-05-10T05:18:21.727974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2066,"log_dups_size":0,"ondisk_log_size":2066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7176","reported_seq":7221,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.418812+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T05:18:21.418812+0000","last_peered":"2024-05-10T05:18:21.418812+0000","last_clean":"2024-05-10T05:18:21.418812+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:18:21.418812+0000","last_undegraded":"2024-05-10T05:18:21.418812+0000","last_fullsized":"2024-05-10T05:18:21.418812+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6274,"log_dups_size":0,"ondisk_log_size":6274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5016,"num_write_kb":931826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4510","reported_seq":4787,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:18.117537+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T05:18:18.117537+0000","last_peered":"2024-05-10T05:18:18.117537+0000","last_clean":"2024-05-10T05:18:18.117537+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:18.117537+0000","last_undegraded":"2024-05-10T05:18:18.117537+0000","last_fullsized":"2024-05-10T05:18:18.117537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5693195,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":1630,"num_write":5090,"num_write_kb":38911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1992","reported_seq":2020,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.611609+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T05:18:21.611609+0000","last_peered":"2024-05-10T05:18:21.611609+0000","last_clean":"2024-05-10T05:18:21.611609+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:21.611609+0000","last_undegraded":"2024-05-10T05:18:21.611609+0000","last_fullsized":"2024-05-10T05:18:21.611609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7839,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.561520+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T05:18:21.561520+0000","last_peered":"2024-05-10T05:18:21.561520+0000","last_clean":"2024-05-10T05:18:21.561520+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:21.561520+0000","last_undegraded":"2024-05-10T05:18:21.561520+0000","last_fullsized":"2024-05-10T05:18:21.561520+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2929","reported_seq":2958,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285307+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T05:18:23.285307+0000","last_peered":"2024-05-10T05:18:23.285307+0000","last_clean":"2024-05-10T05:18:23.285307+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:23.285307+0000","last_undegraded":"2024-05-10T05:18:23.285307+0000","last_fullsized":"2024-05-10T05:18:23.285307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2929,"log_dups_size":0,"ondisk_log_size":2929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2034","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.606877+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T05:18:21.606877+0000","last_peered":"2024-05-10T05:18:21.606877+0000","last_clean":"2024-05-10T05:18:21.606877+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:21.606877+0000","last_undegraded":"2024-05-10T05:18:21.606877+0000","last_fullsized":"2024-05-10T05:18:21.606877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7569,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.840121+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T05:18:25.840121+0000","last_peered":"2024-05-10T05:18:25.840121+0000","last_clean":"2024-05-10T05:18:25.840121+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:25.840121+0000","last_undegraded":"2024-05-10T05:18:25.840121+0000","last_fullsized":"2024-05-10T05:18:25.840121+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2703","reported_seq":2732,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:53.864278+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T05:16:53.864278+0000","last_peered":"2024-05-10T05:16:53.864278+0000","last_clean":"2024-05-10T05:16:53.864278+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:16:53.864278+0000","last_undegraded":"2024-05-10T05:16:53.864278+0000","last_fullsized":"2024-05-10T05:16:53.864278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2703,"log_dups_size":0,"ondisk_log_size":2703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2708,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.568724+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T05:18:21.568724+0000","last_peered":"2024-05-10T05:18:21.568724+0000","last_clean":"2024-05-10T05:18:21.568724+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:21.568724+0000","last_undegraded":"2024-05-10T05:18:21.568724+0000","last_fullsized":"2024-05-10T05:18:21.568724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.714933+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T05:18:21.714933+0000","last_peered":"2024-05-10T05:18:21.714933+0000","last_clean":"2024-05-10T05:18:21.714933+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:18:21.714933+0000","last_undegraded":"2024-05-10T05:18:21.714933+0000","last_fullsized":"2024-05-10T05:18:21.714933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3606","reported_seq":3635,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:44.359477+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T05:16:44.359477+0000","last_peered":"2024-05-10T05:16:44.359477+0000","last_clean":"2024-05-10T05:16:44.359477+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:16:44.359477+0000","last_undegraded":"2024-05-10T05:16:44.359477+0000","last_fullsized":"2024-05-10T05:16:44.359477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3624,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2107","reported_seq":2135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.653553+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T05:18:21.653553+0000","last_peered":"2024-05-10T05:18:21.653553+0000","last_clean":"2024-05-10T05:18:21.653553+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:21.653553+0000","last_undegraded":"2024-05-10T05:18:21.653553+0000","last_fullsized":"2024-05-10T05:18:21.653553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7426,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.701576+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T05:18:21.701576+0000","last_peered":"2024-05-10T05:18:21.701576+0000","last_clean":"2024-05-10T05:18:21.701576+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:18:21.701576+0000","last_undegraded":"2024-05-10T05:18:21.701576+0000","last_fullsized":"2024-05-10T05:18:21.701576+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6717","reported_seq":6746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:39.819475+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T05:17:39.819475+0000","last_peered":"2024-05-10T05:17:39.819475+0000","last_clean":"2024-05-10T05:17:39.819475+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:17:39.819475+0000","last_undegraded":"2024-05-10T05:17:39.819475+0000","last_fullsized":"2024-05-10T05:17:39.819475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6717,"log_dups_size":0,"ondisk_log_size":6717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6709,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2071","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.378982+0000","last_change":"2024-05-10T04:52:40.335170+0000","last_active":"2024-05-10T05:18:21.378982+0000","last_peered":"2024-05-10T05:18:21.378982+0000","last_clean":"2024-05-10T05:18:21.378982+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:21.378982+0000","last_undegraded":"2024-05-10T05:18:21.378982+0000","last_fullsized":"2024-05-10T05:18:21.378982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:53.141194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7869,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.850330+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T05:18:25.850330+0000","last_peered":"2024-05-10T05:18:25.850330+0000","last_clean":"2024-05-10T05:18:25.850330+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:18:25.850330+0000","last_undegraded":"2024-05-10T05:18:25.850330+0000","last_fullsized":"2024-05-10T05:18:25.850330+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6906","reported_seq":6934,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:50.952319+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T05:16:50.952319+0000","last_peered":"2024-05-10T05:16:50.952319+0000","last_clean":"2024-05-10T05:16:50.952319+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:16:50.952319+0000","last_undegraded":"2024-05-10T05:16:50.952319+0000","last_fullsized":"2024-05-10T05:16:50.952319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6906,"log_dups_size":0,"ondisk_log_size":6906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6922,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2064","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.656167+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T05:18:21.656167+0000","last_peered":"2024-05-10T05:18:21.656167+0000","last_clean":"2024-05-10T05:18:21.656167+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:18:21.656167+0000","last_undegraded":"2024-05-10T05:18:21.656167+0000","last_fullsized":"2024-05-10T05:18:21.656167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2064,"log_dups_size":0,"ondisk_log_size":2064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.687453+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T05:18:21.687453+0000","last_peered":"2024-05-10T05:18:21.687453+0000","last_clean":"2024-05-10T05:18:21.687453+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:18:21.687453+0000","last_undegraded":"2024-05-10T05:18:21.687453+0000","last_fullsized":"2024-05-10T05:18:21.687453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5970","reported_seq":5998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:16.397485+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T05:17:16.397485+0000","last_peered":"2024-05-10T05:17:16.397485+0000","last_clean":"2024-05-10T05:17:16.397485+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:17:16.397485+0000","last_undegraded":"2024-05-10T05:17:16.397485+0000","last_fullsized":"2024-05-10T05:17:16.397485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5970,"log_dups_size":0,"ondisk_log_size":5970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2036","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.443216+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T05:18:21.443216+0000","last_peered":"2024-05-10T05:18:21.443216+0000","last_clean":"2024-05-10T05:18:21.443216+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:21.443216+0000","last_undegraded":"2024-05-10T05:18:21.443216+0000","last_fullsized":"2024-05-10T05:18:21.443216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7893","reported_seq":7997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.661320+0000","last_change":"2024-05-10T04:52:40.389082+0000","last_active":"2024-05-10T05:18:21.661320+0000","last_peered":"2024-05-10T05:18:21.661320+0000","last_clean":"2024-05-10T05:18:21.661320+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:18:21.661320+0000","last_undegraded":"2024-05-10T05:18:21.661320+0000","last_fullsized":"2024-05-10T05:18:21.661320+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:16.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5698,"num_write_kb":1007687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7938","reported_seq":7966,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:26.096941+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T05:17:26.096941+0000","last_peered":"2024-05-10T05:17:26.096941+0000","last_clean":"2024-05-10T05:17:26.096941+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:17:26.096941+0000","last_undegraded":"2024-05-10T05:17:26.096941+0000","last_fullsized":"2024-05-10T05:17:26.096941+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7338,"log_dups_size":0,"ondisk_log_size":7338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7933,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2028","reported_seq":2055,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.406662+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T05:18:21.406662+0000","last_peered":"2024-05-10T05:18:21.406662+0000","last_clean":"2024-05-10T05:18:21.406662+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:18:21.406662+0000","last_undegraded":"2024-05-10T05:18:21.406662+0000","last_fullsized":"2024-05-10T05:18:21.406662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646424+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T05:18:21.646424+0000","last_peered":"2024-05-10T05:18:21.646424+0000","last_clean":"2024-05-10T05:18:21.646424+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:18:21.646424+0000","last_undegraded":"2024-05-10T05:18:21.646424+0000","last_fullsized":"2024-05-10T05:18:21.646424+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5556","reported_seq":5584,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.259260+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T05:18:23.259260+0000","last_peered":"2024-05-10T05:18:23.259260+0000","last_clean":"2024-05-10T05:18:23.259260+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:23.259260+0000","last_undegraded":"2024-05-10T05:18:23.259260+0000","last_fullsized":"2024-05-10T05:18:23.259260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1952","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.238683+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T05:18:21.238683+0000","last_peered":"2024-05-10T05:18:21.238683+0000","last_clean":"2024-05-10T05:18:21.238683+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:21.238683+0000","last_undegraded":"2024-05-10T05:18:21.238683+0000","last_fullsized":"2024-05-10T05:18:21.238683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1977","reported_seq":2005,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.941235+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T05:18:20.941235+0000","last_peered":"2024-05-10T05:18:20.941235+0000","last_clean":"2024-05-10T05:18:20.941235+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:18:20.941235+0000","last_undegraded":"2024-05-10T05:18:20.941235+0000","last_fullsized":"2024-05-10T05:18:20.941235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1977,"log_dups_size":0,"ondisk_log_size":1977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2079","reported_seq":2107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.146529+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T05:18:21.146529+0000","last_peered":"2024-05-10T05:18:21.146529+0000","last_clean":"2024-05-10T05:18:21.146529+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:21.146529+0000","last_undegraded":"2024-05-10T05:18:21.146529+0000","last_fullsized":"2024-05-10T05:18:21.146529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1982","reported_seq":2010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.466513+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T05:18:21.466513+0000","last_peered":"2024-05-10T05:18:21.466513+0000","last_clean":"2024-05-10T05:18:21.466513+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:18:21.466513+0000","last_undegraded":"2024-05-10T05:18:21.466513+0000","last_fullsized":"2024-05-10T05:18:21.466513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2086","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.698973+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T05:18:21.698973+0000","last_peered":"2024-05-10T05:18:21.698973+0000","last_clean":"2024-05-10T05:18:21.698973+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:21.698973+0000","last_undegraded":"2024-05-10T05:18:21.698973+0000","last_fullsized":"2024-05-10T05:18:21.698973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2059","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.339956+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T05:18:21.339956+0000","last_peered":"2024-05-10T05:18:21.339956+0000","last_clean":"2024-05-10T05:18:21.339956+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:21.339956+0000","last_undegraded":"2024-05-10T05:18:21.339956+0000","last_fullsized":"2024-05-10T05:18:21.339956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1953","reported_seq":1981,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.460991+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T05:18:21.460991+0000","last_peered":"2024-05-10T05:18:21.460991+0000","last_clean":"2024-05-10T05:18:21.460991+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:18:21.460991+0000","last_undegraded":"2024-05-10T05:18:21.460991+0000","last_fullsized":"2024-05-10T05:18:21.460991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2056","reported_seq":2084,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.446402+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T05:18:21.446402+0000","last_peered":"2024-05-10T05:18:21.446402+0000","last_clean":"2024-05-10T05:18:21.446402+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:18:21.446402+0000","last_undegraded":"2024-05-10T05:18:21.446402+0000","last_fullsized":"2024-05-10T05:18:21.446402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2050","reported_seq":2078,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.616737+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T05:18:21.616737+0000","last_peered":"2024-05-10T05:18:21.616737+0000","last_clean":"2024-05-10T05:18:21.616737+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:21.616737+0000","last_undegraded":"2024-05-10T05:18:21.616737+0000","last_fullsized":"2024-05-10T05:18:21.616737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2000","reported_seq":2028,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.322010+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T05:18:21.322010+0000","last_peered":"2024-05-10T05:18:21.322010+0000","last_clean":"2024-05-10T05:18:21.322010+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:21.322010+0000","last_undegraded":"2024-05-10T05:18:21.322010+0000","last_fullsized":"2024-05-10T05:18:21.322010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2035","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.323810+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T05:18:21.323810+0000","last_peered":"2024-05-10T05:18:21.323810+0000","last_clean":"2024-05-10T05:18:21.323810+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:21.323810+0000","last_undegraded":"2024-05-10T05:18:21.323810+0000","last_fullsized":"2024-05-10T05:18:21.323810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2060","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.435357+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T05:18:20.435357+0000","last_peered":"2024-05-10T05:18:20.435357+0000","last_clean":"2024-05-10T05:18:20.435357+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:18:20.435357+0000","last_undegraded":"2024-05-10T05:18:20.435357+0000","last_fullsized":"2024-05-10T05:18:20.435357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.651581+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T05:18:21.651581+0000","last_peered":"2024-05-10T05:18:21.651581+0000","last_clean":"2024-05-10T05:18:21.651581+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:18:21.651581+0000","last_undegraded":"2024-05-10T05:18:21.651581+0000","last_fullsized":"2024-05-10T05:18:21.651581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2043","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.384106+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T05:18:21.384106+0000","last_peered":"2024-05-10T05:18:21.384106+0000","last_clean":"2024-05-10T05:18:21.384106+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:21.384106+0000","last_undegraded":"2024-05-10T05:18:21.384106+0000","last_fullsized":"2024-05-10T05:18:21.384106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3504128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173237,"num_write_kb":29659775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12107776,"data_stored":12107776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225976,"ondisk_log_size":225976,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130287,"ondisk_log_size":130287,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235067000,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2409,"num_read_kb":15302,"num_write":184752,"num_write_kb":1350563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":474402816,"data_stored":474340060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172587,"ondisk_log_size":172587,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542466,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":924928,"kb_used_data":81784,"kb_used_omap":1,"kb_used_meta":843134,"kb_avail":93446912,"statfs":{"total":96636764160,"available":95689637888,"internally_reserved":0,"allocated":83746816,"data_stored":83562425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":863369675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.1080000000000001,"5min":2.2599999999999998,"15min":1.736},"min":{"1min":0.309,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":28.266999999999999,"5min":28.266999999999999,"15min":34.326999999999998},"last":6.4359999999999999},{"interface":"front","average":{"1min":3.6920000000000002,"5min":2.7669999999999999,"15min":1.8069999999999999},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":28.968,"5min":28.968,"15min":28.968},"last":1.1819999999999999}]},{"osd":1,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":4.3120000000000003,"5min":2.4780000000000002,"15min":1.8300000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"max":{"1min":34.805999999999997,"5min":34.805999999999997,"15min":34.805999999999997},"last":6.3819999999999997},{"interface":"front","average":{"1min":2.7269999999999999,"5min":2.7789999999999999,"15min":2.2480000000000002},"min":{"1min":0.47499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":29.222000000000001,"5min":29.222000000000001,"15min":105.375},"last":1.411}]},{"osd":2,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":2.6960000000000002,"5min":3.2959999999999998,"15min":2.0569999999999999},"min":{"1min":0.54000000000000004,"5min":0.40899999999999997,"15min":0.35899999999999999},"max":{"1min":28.913,"5min":52.515999999999998,"15min":52.515999999999998},"last":1.7230000000000001},{"interface":"front","average":{"1min":4.04,"5min":2.5089999999999999,"15min":1.712},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":34.756999999999998,"5min":35.595999999999997,"15min":35.595999999999997},"last":6.476}]},{"osd":3,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":2.843,"5min":3.5030000000000001,"15min":3.6440000000000001},"min":{"1min":0.44800000000000001,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":28.952999999999999,"5min":64.994,"15min":263.32999999999998},"last":1.595},{"interface":"front","average":{"1min":3.5169999999999999,"5min":2.7919999999999998,"15min":2.9119999999999999},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.40500000000000003},"max":{"1min":34.841999999999999,"5min":43.789000000000001,"15min":263.30900000000003},"last":6.5129999999999999}]},{"osd":4,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.9089999999999998,"5min":4.048,"15min":2.6240000000000001},"min":{"1min":0.438,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":30.199000000000002,"5min":52.252000000000002,"15min":52.252000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":2.964,"5min":3.7589999999999999,"15min":3.1120000000000001},"min":{"1min":0.48599999999999999,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":31.914000000000001,"5min":46.792000000000002,"15min":134.07499999999999},"last":2.2469999999999999}]},{"osd":5,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.585,"5min":3.2890000000000001,"15min":2.3410000000000002},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":34.875,"5min":34.875,"15min":34.875},"last":9.2859999999999996},{"interface":"front","average":{"1min":3.254,"5min":3.2029999999999998,"15min":2.2410000000000001},"min":{"1min":0.51400000000000001,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":29.867000000000001,"5min":29.867000000000001,"15min":37.582999999999998},"last":9.0559999999999992}]},{"osd":6,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":5.1719999999999997,"5min":5.056,"15min":3.137},"min":{"1min":0.69199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":29.905000000000001,"5min":65.388999999999996,"15min":65.388999999999996},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.8330000000000002,"5min":5.4059999999999997,"15min":3.3530000000000002},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":31.960999999999999,"5min":84.454999999999998,"15min":84.454999999999998},"last":2.2080000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542465,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":979668,"kb_used_data":92236,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93392172,"statfs":{"total":96636764160,"available":95633584128,"internally_reserved":0,"allocated":94449664,"data_stored":94260377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":2.2069999999999999,"15min":2.899},"min":{"1min":0.313,"5min":0.30399999999999999,"15min":0.30199999999999999},"max":{"1min":9.5470000000000006,"5min":17.158000000000001,"15min":215.636},"last":0.72399999999999998},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.4049999999999998,"15min":2.7040000000000002},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":26.574000000000002,"5min":26.574000000000002,"15min":216.899},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.5030000000000001,"15min":3.6099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":20.341999999999999,"5min":20.341999999999999,"15min":283.584},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.25,"5min":2.1429999999999998,"15min":3.1899999999999999},"min":{"1min":0.39500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":9.5969999999999995,"5min":21.161999999999999,"15min":226.642},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":2.0230000000000001,"15min":2.5129999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38200000000000001},"max":{"1min":13.759,"5min":13.759,"15min":204.20099999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":2.339,"5min":2.806,"15min":2.165},"min":{"1min":0.44,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":15.641999999999999,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":2.3260000000000001,"5min":2.1680000000000001,"15min":2.8330000000000002},"min":{"1min":0.47499999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":9.6289999999999996,"5min":21.224,"15min":211.06999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":2.794,"5min":2.242,"15min":2.7709999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":13.257999999999999,"5min":24.928999999999998,"15min":216.947},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.4209999999999998,"5min":2.6160000000000001,"15min":2.5070000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.151,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":3.4100000000000001,"5min":3.1139999999999999,"15min":2.3069999999999999},"min":{"1min":0.499,"5min":0.438,"15min":0.39600000000000002},"max":{"1min":13.398,"5min":37.195,"15min":37.195},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.012,"5min":2.863,"15min":2.278},"min":{"1min":0.57199999999999995,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":15.685,"5min":46.448999999999998,"15min":46.448999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":4.0999999999999996,"5min":2.839,"15min":2.4769999999999999},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":18.962,"5min":20.692,"15min":35.591999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.23,"5min":2.9849999999999999,"15min":2.2349999999999999},"min":{"1min":0.70999999999999996,"5min":0.437,"15min":0.437},"max":{"1min":13.369999999999999,"5min":58.857999999999997,"15min":58.857999999999997},"last":1},{"interface":"front","average":{"1min":4.2380000000000004,"5min":3.9590000000000001,"15min":2.5979999999999999},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":20.297000000000001,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.88300000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542466,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":777628,"kb_used_data":70740,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93594212,"statfs":{"total":96636764160,"available":95840473088,"internally_reserved":0,"allocated":72437760,"data_stored":72245233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,4,0,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.1709999999999998,"5min":1.46,"15min":1.3959999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":39.710000000000001,"5min":39.710000000000001,"15min":40.371000000000002},"last":8.7910000000000004},{"interface":"front","average":{"1min":4.3259999999999996,"5min":2.1019999999999999,"15min":1.9139999999999999},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":62.222000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":1.569}]},{"osd":2,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3680000000000001,"15min":1.1699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":6.391,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.875,"5min":1.5880000000000001,"15min":1.3959999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":8.391,"5min":17.998000000000001,"15min":37.643999999999998},"last":1.4430000000000001}]},{"osd":3,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.7770000000000001,"5min":1.7150000000000001,"15min":2.0600000000000001},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":51.646999999999998,"5min":51.646999999999998,"15min":108.407},"last":4.7089999999999996},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6699999999999999,"15min":1.466},"min":{"1min":0.51000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.359999999999999,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7249999999999996,"5min":2.6739999999999999,"15min":2.2949999999999999},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":52.307000000000002,"5min":52.307000000000002,"15min":52.307000000000002},"last":4.6619999999999999},{"interface":"front","average":{"1min":3.0339999999999998,"5min":2.4809999999999999,"15min":1.9970000000000001},"min":{"1min":0.47199999999999998,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":13.576000000000001,"5min":19.292999999999999,"15min":32.276000000000003},"last":2.3969999999999998}]},{"osd":5,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5110000000000001,"5min":2.202,"15min":1.8660000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":9.8170000000000002,"5min":18.966000000000001,"15min":37.572000000000003},"last":1.2789999999999999},{"interface":"front","average":{"1min":4.3659999999999997,"5min":2.5840000000000001,"15min":2.2599999999999998},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":7.6829999999999998}]},{"osd":6,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":2.6240000000000001,"15min":2.1459999999999999},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":13.968,"5min":41.270000000000003,"15min":41.270000000000003},"last":0.877},{"interface":"front","average":{"1min":3.6699999999999999,"5min":2.923,"15min":2.258},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":18.013000000000002,"5min":41.043999999999997,"15min":41.043999999999997},"last":1.387}]},{"osd":7,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.6749999999999998,"15min":2.2490000000000001},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":17.946000000000002,"5min":22.251000000000001,"15min":37.850000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":3.927,"5min":2.3809999999999998,"15min":2.359},"min":{"1min":0.622,"5min":0.503,"15min":0.503},"max":{"1min":39.850000000000001,"5min":39.850000000000001,"15min":46.118000000000002},"last":4.7469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":540160,"kb_used_data":21816,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93831680,"statfs":{"total":96636764160,"available":96083640320,"internally_reserved":0,"allocated":22339584,"data_stored":22162259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.556,"15min":1.1779999999999999},"min":{"1min":0.28299999999999997,"5min":0.246,"15min":0.246},"max":{"1min":9.9390000000000001,"5min":24.271000000000001,"15min":24.271000000000001},"last":2.9020000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.4319999999999999,"15min":1.3420000000000001},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.29399999999999998},"max":{"1min":8.2479999999999993,"5min":23.797999999999998,"15min":30.734999999999999},"last":4.681}]},{"osd":1,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.018,"15min":1.397},"min":{"1min":0.34200000000000003,"5min":0.28899999999999998,"15min":0.27700000000000002},"max":{"1min":9.9079999999999995,"5min":12.404999999999999,"15min":105.28},"last":3.2000000000000002},{"interface":"front","average":{"1min":1.885,"5min":2.3759999999999999,"15min":2.472},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":30.760000000000002,"5min":73.775999999999996,"15min":105.255},"last":7.9219999999999997}]},{"osd":3,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.3140000000000001,"15min":1.5389999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":11.765000000000001,"5min":11.765000000000001,"15min":60.387999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.536,"15min":1.3680000000000001},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":9.8339999999999996,"5min":21.029,"15min":22.358000000000001},"last":3.7320000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":5.3300000000000001,"15min":2.6850000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41899999999999998},"max":{"1min":12.801,"5min":249.88,"15min":249.88},"last":0.443},{"interface":"front","average":{"1min":1.3049999999999999,"5min":5.6280000000000001,"15min":3.0059999999999998},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":9.6890000000000001,"5min":249.82300000000001,"15min":249.82300000000001},"last":4.7329999999999997}]},{"osd":5,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":3.8809999999999998,"15min":2.6120000000000001},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":23.582999999999998,"5min":256.38600000000002,"15min":256.38600000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.21,"5min":3.7549999999999999,"15min":2.2749999999999999},"min":{"1min":0.55400000000000005,"5min":0.42899999999999999,"15min":0.42799999999999999},"max":{"1min":9.7970000000000006,"5min":255.04499999999999,"15min":255.04499999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":5.1210000000000004,"15min":2.8900000000000001},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":7.6630000000000003,"5min":255.06999999999999,"15min":255.06999999999999},"last":4.7809999999999997},{"interface":"front","average":{"1min":2.4169999999999998,"5min":4.8220000000000001,"15min":2.9780000000000002},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":38.405000000000001,"5min":253.095,"15min":253.095},"last":1.411}]},{"osd":7,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":4.0599999999999996,"15min":2.7949999999999999},"min":{"1min":0.53700000000000003,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":8.2889999999999997,"5min":249.90799999999999,"15min":249.90799999999999},"last":4.8150000000000004},{"interface":"front","average":{"1min":2.4039999999999999,"5min":4.444,"15min":3.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":23.321999999999999,"5min":256.97699999999998,"15min":256.97699999999998},"last":0.77400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542465,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":968972,"kb_used_data":53572,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93402868,"statfs":{"total":96636764160,"available":95644536832,"internally_reserved":0,"allocated":54857728,"data_stored":54672126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,0,4,7,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":2.2999999999999998,"15min":2.4710000000000001},"min":{"1min":0.25800000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":50.100000000000001,"5min":50.100000000000001,"15min":192.745},"last":12.423},{"interface":"front","average":{"1min":4.3819999999999997,"5min":1.891,"15min":2.206},"min":{"1min":0.38700000000000001,"5min":0.377,"15min":0.30499999999999999},"max":{"1min":50.145000000000003,"5min":50.145000000000003,"15min":192.62799999999999},"last":1.3620000000000001}]},{"osd":2,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3520000000000001,"15min":1.651},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":3.9159999999999999,"5min":14.263999999999999,"15min":71.727999999999994},"last":5.375},{"interface":"front","average":{"1min":1.431,"5min":1.651,"15min":1.9910000000000001},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":5.5410000000000004,"5min":32.435000000000002,"15min":95.793000000000006},"last":5.5449999999999999}]},{"osd":3,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.0249999999999999,"15min":2.1030000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":14.446,"5min":21.994,"15min":125.41200000000001},"last":12.491},{"interface":"front","average":{"1min":3.0030000000000001,"5min":2.0139999999999998,"15min":1.8620000000000001},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":16.498000000000001,"5min":26.085000000000001,"15min":111.134},"last":3.8690000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.7130000000000001,"5min":2.8999999999999999,"15min":2.5099999999999998},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.33300000000000002},"max":{"1min":21.686,"5min":34.137999999999998,"15min":72.697999999999993},"last":0.378},{"interface":"front","average":{"1min":4.7569999999999997,"5min":3.2829999999999999,"15min":3.1150000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":26.440999999999999,"5min":52.764000000000003,"15min":138.74100000000001},"last":5.7279999999999998}]},{"osd":5,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":2.637,"15min":2},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":9.3300000000000001,"5min":41.558,"15min":41.558},"last":3.7909999999999999},{"interface":"front","average":{"1min":4.0279999999999996,"5min":2.7149999999999999,"15min":2.165},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":21.745999999999999,"5min":21.745999999999999,"15min":71.340999999999994},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":5.2930000000000001,"5min":2.7440000000000002,"15min":3.7429999999999999},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":46.985999999999997,"5min":46.985999999999997,"15min":289.625},"last":0.42699999999999999},{"interface":"front","average":{"1min":3.6459999999999999,"5min":2.8900000000000001,"15min":4.1399999999999997},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":14.343999999999999,"5min":23.260999999999999,"15min":289.608},"last":5.8070000000000004}]},{"osd":7,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2450000000000001,"5min":2.0680000000000001,"15min":1.9299999999999999},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":9.3629999999999995,"5min":28.573,"15min":33.892000000000003},"last":3.7519999999999998},{"interface":"front","average":{"1min":3.1560000000000001,"5min":2.7010000000000001,"15min":2.1200000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":13.920999999999999,"5min":19.215,"15min":41.015000000000001},"last":3.8319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542466,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1078144,"kb_used_data":86520,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293696,"statfs":{"total":96636764160,"available":95532744704,"internally_reserved":0,"allocated":88596480,"data_stored":88411635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.556,"15min":1.381},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":14.048,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.325,"15min":1.7569999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":6.827,"5min":22.594000000000001,"15min":119.66200000000001},"last":0.496}]},{"osd":1,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.5509999999999999,"15min":1.3220000000000001},"min":{"1min":0.30599999999999999,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":18.273,"5min":25.995000000000001,"15min":26.573},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.671,"15min":1.6040000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.1,"5min":32.93,"15min":32.93},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.5349999999999999,"15min":1.288},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":6.5730000000000004,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.3180000000000001,"15min":1.262},"min":{"1min":0.45900000000000002,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":14.214,"5min":17.420999999999999,"15min":29.568999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":4.2080000000000002,"5min":4.2729999999999997,"15min":3.948},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":55.142000000000003,"5min":101.81399999999999,"15min":157.47},"last":0.61799999999999999},{"interface":"front","average":{"1min":2.9689999999999999,"5min":4.2169999999999996,"15min":3.4950000000000001},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40500000000000003},"max":{"1min":25.087,"5min":102.501,"15min":189.161},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":3.7050000000000001,"5min":2.4329999999999998,"15min":2.4540000000000002},"min":{"1min":0.51200000000000001,"5min":0.42799999999999999,"15min":0.40799999999999997},"max":{"1min":16.780000000000001,"5min":22.468,"15min":150.14500000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.7770000000000001,"15min":3.141},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":13.538,"5min":50.697000000000003,"15min":165.47},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":2.895,"5min":3.2250000000000001,"15min":2.9510000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":22.823,"5min":43.024999999999999,"15min":179.703},"last":0.88500000000000001},{"interface":"front","average":{"1min":2.8399999999999999,"5min":2.5190000000000001,"15min":2.6240000000000001},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":14.167,"5min":27.515999999999998,"15min":135.15899999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":2.0699999999999998,"15min":3.0369999999999999},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":6.7800000000000002,"5min":15.85,"15min":148.93899999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":3.258,"5min":3.2130000000000001,"15min":3.1549999999999998},"min":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":22.765999999999998,"5min":59.588999999999999,"15min":215.81299999999999},"last":0.82499999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542464,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":932936,"kb_used_data":53888,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93438904,"statfs":{"total":96636764160,"available":95681437696,"internally_reserved":0,"allocated":55181312,"data_stored":54991825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":5.7800000000000002,"15min":5.9690000000000003},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":5.165,"5min":220.36600000000001,"15min":440.25299999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.645,"5min":3.5840000000000001,"15min":3.8069999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.31900000000000001},"max":{"1min":8.4920000000000009,"5min":94.004999999999995,"15min":397.101},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":4.2750000000000004,"15min":4.6559999999999997},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":8.5389999999999997,"5min":101.113,"15min":396.98899999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.752,"5min":2.7229999999999999,"15min":3.0760000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":8.2710000000000008,"5min":32.863,"15min":367.47399999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":5.6289999999999996,"15min":6.3410000000000002},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":9.8780000000000001,"5min":217.352,"15min":440.32400000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.827,"5min":3.3700000000000001,"15min":4.2469999999999999},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":8.5999999999999996,"5min":93.968999999999994,"15min":396.67700000000002},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":3.3929999999999998,"15min":3.5059999999999998},"min":{"1min":0.54500000000000004,"5min":0.44800000000000001,"15min":0.41799999999999998},"max":{"1min":12.919,"5min":32.831000000000003,"15min":367.52499999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":2.895,"5min":6.1520000000000001,"15min":6.0720000000000001},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":10.57,"5min":223.80000000000001,"15min":440.197},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.0579999999999998,"5min":3.5830000000000002,"15min":4.4829999999999997},"min":{"1min":0.61099999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":8.5690000000000008,"5min":94.930999999999997,"15min":396.73599999999999},"last":0.627},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.8100000000000001,"15min":4.4009999999999998},"min":{"1min":0.52000000000000002,"5min":0.439,"15min":0.38},"max":{"1min":12.996,"5min":32.759999999999998,"15min":366.06},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":4.891,"15min":6.5919999999999996},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.32100000000000001},"max":{"1min":30.117999999999999,"5min":132.136,"15min":440.358},"last":0.36699999999999999},{"interface":"front","average":{"1min":3.359,"5min":4.008,"15min":5.2110000000000003},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":11.356999999999999,"5min":95.834999999999994,"15min":400.21199999999999},"last":0.42599999999999999}]},{"osd":7,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":6.649,"5min":4.2000000000000002,"15min":3.3450000000000002},"min":{"1min":0.56899999999999995,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":45.661000000000001,"5min":45.661000000000001,"15min":121.637},"last":0.52600000000000002},{"interface":"front","average":{"1min":7.0890000000000004,"5min":5.1230000000000002,"15min":6.5670000000000002},"min":{"1min":0.56999999999999995,"5min":0.5,"15min":0.40600000000000003},"max":{"1min":60.430999999999997,"5min":132.084,"15min":440.291},"last":0.40000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":829488,"kb_used_data":50344,"kb_used_omap":1,"kb_used_meta":779134,"kb_avail":93542352,"statfs":{"total":96636764160,"available":95787368448,"internally_reserved":0,"allocated":51552256,"data_stored":51367260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":797833670},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":2.915,"15min":1.9750000000000001},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":13.369,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":2.4260000000000002,"5min":2.286,"15min":1.736},"min":{"1min":0.373,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":15.297000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.3599999999999999,"15min":1.7},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":16.277000000000001,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.6240000000000001,"15min":1.861},"min":{"1min":0.45000000000000001,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":16.321999999999999,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":2.4750000000000001,"15min":1.825},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":13.664999999999999,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":2.9119999999999999,"5min":3.266,"15min":2.2549999999999999},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":15.089,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6469999999999998,"5min":2.6589999999999998,"15min":1.9870000000000001},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.41199999999999998},"max":{"1min":16.359000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6459999999999999,"15min":2.0390000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":13.775,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.1579999999999999,"5min":5.8890000000000002,"15min":4.2229999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":13.646000000000001,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.9860000000000002,"5min":3.4940000000000002,"15min":3.1560000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":22.885999999999999,"5min":55.484999999999999,"15min":174.684},"last":0.754}]},{"osd":6,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":3.7639999999999998,"15min":2.8769999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":28.108000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":3.5299999999999998,"5min":4.4050000000000002,"15min":3.4620000000000002},"min":{"1min":0.56100000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":16.550999999999998,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":6.6379999999999999,"5min":3.7829999999999999,"15min":2.6190000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.42999999999999999},"max":{"1min":80.727999999999994,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":8.5060000000000002,"5min":5.069,"15min":3.1259999999999999},"min":{"1min":0.53100000000000003,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":92.790999999999997,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51838976,"data_stored":51830699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49025024,"data_stored":49017353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92483584,"data_stored":92471622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3166208,"data_stored":3166208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1069056,"data_stored":1069056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":208896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2228224,"data_stored":2228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":1667072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:18:27.472 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-10T05:18:27.472 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:18:27.777 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.777+0000 7f46cd200700 1 Processor -- start 2024-05-10T05:18:27.778 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.777+0000 7f46cd200700 1 -- start start 2024-05-10T05:18:27.779 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46cd200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 0x7f46c8158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46cd200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46c8159050 0x7f46c815fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46cd200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46c806c7c0 con 0x7f46c80c5c40 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46cd200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46c806d060 con 0x7f46c8159050 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46cd200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8159890 con 0x7f46c80c9440 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46c5400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 0x7f46c8158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46c6800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f46c8159050 0x7f46c815fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46c5400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 0x7f46c8158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:36592/0 (socket says 172.21.15.47:36592) 2024-05-10T05:18:27.780 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.779+0000 7f46c5400700 1 -- 172.21.15.47:0/693355618 learned_addr learned my addr 172.21.15.47:0/693355618 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.780+0000 7f46c5400700 1 -- 172.21.15.47:0/693355618 >> v2:172.21.15.117:3300/0 conn(0x7f46c8159050 msgr2=0x7f46c815fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.780+0000 7f46c5400700 1 --2- 172.21.15.47:0/693355618 >> v2:172.21.15.117:3300/0 conn(0x7f46c8159050 0x7f46c815fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.780+0000 7f46c5400700 1 -- 172.21.15.47:0/693355618 >> v1:172.21.15.117:6789/0 conn(0x7f46c80c5c40 legacy=0x7f46c80c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.780+0000 7f46c5400700 1 -- 172.21.15.47:0/693355618 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c806ca10 con 0x7f46c80c9440 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.780+0000 7f46c5400700 1 --2- 172.21.15.47:0/693355618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 0x7f46c8158b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46b40098f0 tx=0x7f46b4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb1675311279c6da server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.780+0000 7f46c4a00700 1 -- 172.21.15.47:0/693355618 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011830 con 0x7f46c80c9440 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.781+0000 7f46c4a00700 1 -- 172.21.15.47:0/693355618 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4011990 con 0x7f46c80c9440 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.781+0000 7f46c4a00700 1 -- 172.21.15.47:0/693355618 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4011d20 con 0x7f46c80c9440 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.781+0000 7f46cd200700 1 -- 172.21.15.47:0/693355618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 msgr2=0x7f46c8158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.782 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.781+0000 7f46cd200700 1 --2- 172.21.15.47:0/693355618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 0x7f46c8158b10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f46b40098f0 tx=0x7f46b4009c00 comp rx=0 tx=0).stop 2024-05-10T05:18:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.782+0000 7f46cd200700 1 -- 172.21.15.47:0/693355618 shutdown_connections 2024-05-10T05:18:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.782+0000 7f46cd200700 1 --2- 172.21.15.47:0/693355618 >> v2:172.21.15.117:3300/0 conn(0x7f46c8159050 0x7f46c815fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.782+0000 7f46cd200700 1 --2- 172.21.15.47:0/693355618 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c9440 0x7f46c8158b10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.782+0000 7f46cd200700 1 -- 172.21.15.47:0/693355618 >> 172.21.15.47:0/693355618 conn(0x7f46c80ca940 msgr2=0x7f46c80cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.782+0000 7f46cd200700 1 -- 172.21.15.47:0/693355618 shutdown_connections 2024-05-10T05:18:27.783 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.782+0000 7f46cd200700 1 -- 172.21.15.47:0/693355618 wait complete. 2024-05-10T05:18:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.784+0000 7f46cd200700 1 Processor -- start 2024-05-10T05:18:27.784 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.784+0000 7f46cd200700 1 -- start start 2024-05-10T05:18:27.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.785+0000 7f46cd200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c5c40 0x7f46c80af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.785+0000 7f46cd200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 0x7f46c81eb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.785+0000 7f46cd200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c8159050 0x7f46c814dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46cd200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c81555c0 con 0x7f46c80c9440 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46cd200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80c1a30 con 0x7f46c8159050 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46cd200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46c8154f70 con 0x7f46c80c5c40 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 0x7f46c81eb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 0x7f46c81eb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55862/0 (socket says 172.21.15.47:55862) 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 -- 172.21.15.47:0/1757489753 learned_addr learned my addr 172.21.15.47:0/1757489753 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c6800700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c8159050 0x7f46c814dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5e00700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c5c40 0x7f46c80af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 -- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c5c40 msgr2=0x7f46c80af500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c5c40 0x7f46c80af500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.787 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 -- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c8159050 msgr2=0x7f46c814dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c8159050 0x7f46c814dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.786+0000 7f46c5400700 1 -- 172.21.15.47:0/1757489753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b4009550 con 0x7f46c80c9440 2024-05-10T05:18:27.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.787+0000 7f46c5400700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 0x7f46c81eb990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009c40 tx=0x7f46b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.788+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4004510 con 0x7f46c80c9440 2024-05-10T05:18:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.789+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b401e070 con 0x7f46c80c9440 2024-05-10T05:18:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.789+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b40038e0 con 0x7f46c80c9440 2024-05-10T05:18:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.789+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c8155250 con 0x7f46c80c9440 2024-05-10T05:18:27.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.789+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c8154160 con 0x7f46c80c9440 2024-05-10T05:18:27.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.790+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c8155410 con 0x7f46c80c9440 2024-05-10T05:18:27.791 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.791+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f46b4003a40 con 0x7f46c80c9440 2024-05-10T05:18:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.792+0000 7f46be000700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f46a806ace0 0x7f46a806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.792+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f46b408a570 con 0x7f46c80c9440 2024-05-10T05:18:27.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.792+0000 7f46c5e00700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f46a806ace0 0x7f46a806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:27.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.793+0000 7f46c5e00700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f46a806ace0 0x7f46a806d1f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f46b8007fd0 tx=0x7f46b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:27.796 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:27.796+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f46b4055380 con 0x7f46c80c9440 2024-05-10T05:18:28.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.008+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f46c8154df0 con 0x7f46a806ace0 2024-05-10T05:18:28.020 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.020+0000 7f46be000700 1 -- 172.21.15.47:0/1757489753 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+372017 (secure 0 0 0) 0x7f46b8001cc0 con 0x7f46a806ace0 2024-05-10T05:18:28.025 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:28.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f46a806ace0 msgr2=0x7f46a806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.028 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f46a806ace0 0x7f46a806d1f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f46b8007fd0 tx=0x7f46b8009040 comp rx=0 tx=0).stop 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 msgr2=0x7f46c81eb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 0x7f46c81eb990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009c40 tx=0x7f46b4004750 comp rx=0 tx=0).stop 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 shutdown_connections 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f46c8159050 0x7f46c814dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f46a806ace0 0x7f46a806d1f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f46c80c5c40 0x7f46c80af500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 --2- 172.21.15.47:0/1757489753 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f46c80c9440 0x7f46c81eb990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 >> 172.21.15.47:0/1757489753 conn(0x7f46c80ca940 msgr2=0x7f46c80c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 shutdown_connections 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.024+0000 7f46cd200700 1 -- 172.21.15.47:0/1757489753 wait complete. 2024-05-10T05:18:28.029 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:18:28.053 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":822,"stamp":"2024-05-10T05:18:26.688379+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":239161496,"num_objects":162,"num_object_clones":0,"num_object_copies":332,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":162,"num_whiteouts":0,"num_read":4750,"num_read_kb":580552,"num_write":359263,"num_write_kb":31012754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":528967,"ondisk_log_size":528967,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7031924,"kb_used_data":510900,"kb_used_omap":12,"kb_used_meta":6520947,"kb_avail":747942796,"statfs":{"total":773094113280,"available":765893423104,"internally_reserved":0,"allocated":523161600,"data_stored":521673140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6677450296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,5,5,16,13,8],"upper_bound":128},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-286034677,"num_objects":-2340,"num_object_clones":0,"num_object_copies":-8168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2340,"num_whiteouts":0,"num_read":12,"num_read_kb":252,"num_write":3957,"num_write_kb":51541,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004019"},"pg_stats":[{"pgid":"3.3f","version":"28'1979","reported_seq":2007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.435363+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T05:18:21.435363+0000","last_peered":"2024-05-10T05:18:21.435363+0000","last_clean":"2024-05-10T05:18:21.435363+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:18:21.435363+0000","last_undegraded":"2024-05-10T05:18:21.435363+0000","last_fullsized":"2024-05-10T05:18:21.435363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1979,"log_dups_size":0,"ondisk_log_size":1979,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1976","reported_seq":2004,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.385071+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T05:18:21.385071+0000","last_peered":"2024-05-10T05:18:21.385071+0000","last_clean":"2024-05-10T05:18:21.385071+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:21.385071+0000","last_undegraded":"2024-05-10T05:18:21.385071+0000","last_fullsized":"2024-05-10T05:18:21.385071+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1976,"log_dups_size":0,"ondisk_log_size":1976,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2121","reported_seq":2149,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.418630+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T05:18:21.418630+0000","last_peered":"2024-05-10T05:18:21.418630+0000","last_clean":"2024-05-10T05:18:21.418630+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:18:21.418630+0000","last_undegraded":"2024-05-10T05:18:21.418630+0000","last_fullsized":"2024-05-10T05:18:21.418630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2121,"log_dups_size":0,"ondisk_log_size":2121,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2096","reported_seq":2125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.615639+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T05:18:21.615639+0000","last_peered":"2024-05-10T05:18:21.615639+0000","last_clean":"2024-05-10T05:18:21.615639+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:18:21.615639+0000","last_undegraded":"2024-05-10T05:18:21.615639+0000","last_fullsized":"2024-05-10T05:18:21.615639+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2057","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646797+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T05:18:21.646797+0000","last_peered":"2024-05-10T05:18:21.646797+0000","last_clean":"2024-05-10T05:18:21.646797+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:18:21.646797+0000","last_undegraded":"2024-05-10T05:18:21.646797+0000","last_fullsized":"2024-05-10T05:18:21.646797+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2057,"log_dups_size":0,"ondisk_log_size":2057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1962","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.623718+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T05:18:21.623718+0000","last_peered":"2024-05-10T05:18:21.623718+0000","last_clean":"2024-05-10T05:18:21.623718+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:18:21.623718+0000","last_undegraded":"2024-05-10T05:18:21.623718+0000","last_fullsized":"2024-05-10T05:18:21.623718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1962,"log_dups_size":0,"ondisk_log_size":1962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2001","reported_seq":2027,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.571299+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T05:18:21.571299+0000","last_peered":"2024-05-10T05:18:21.571299+0000","last_clean":"2024-05-10T05:18:21.571299+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:18:21.571299+0000","last_undegraded":"2024-05-10T05:18:21.571299+0000","last_fullsized":"2024-05-10T05:18:21.571299+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2001,"log_dups_size":0,"ondisk_log_size":2001,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2014","reported_seq":2040,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.692324+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T05:18:21.692324+0000","last_peered":"2024-05-10T05:18:21.692324+0000","last_clean":"2024-05-10T05:18:21.692324+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:18:21.692324+0000","last_undegraded":"2024-05-10T05:18:21.692324+0000","last_fullsized":"2024-05-10T05:18:21.692324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2014,"log_dups_size":0,"ondisk_log_size":2014,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2072","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.463408+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T05:18:21.463408+0000","last_peered":"2024-05-10T05:18:21.463408+0000","last_clean":"2024-05-10T05:18:21.463408+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:18:21.463408+0000","last_undegraded":"2024-05-10T05:18:21.463408+0000","last_fullsized":"2024-05-10T05:18:21.463408+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2074","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.378924+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T05:18:21.378924+0000","last_peered":"2024-05-10T05:18:21.378924+0000","last_clean":"2024-05-10T05:18:21.378924+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:18:21.378924+0000","last_undegraded":"2024-05-10T05:18:21.378924+0000","last_fullsized":"2024-05-10T05:18:21.378924+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1952","reported_seq":1978,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.640372+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T05:18:21.640372+0000","last_peered":"2024-05-10T05:18:21.640372+0000","last_clean":"2024-05-10T05:18:21.640372+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:21.640372+0000","last_undegraded":"2024-05-10T05:18:21.640372+0000","last_fullsized":"2024-05-10T05:18:21.640372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1975,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.011781+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T05:18:26.011781+0000","last_peered":"2024-05-10T05:18:26.011781+0000","last_clean":"2024-05-10T05:18:26.011781+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:26.011781+0000","last_undegraded":"2024-05-10T05:18:26.011781+0000","last_fullsized":"2024-05-10T05:18:26.011781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:03:04.620850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2019","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.180961+0000","last_change":"2024-05-10T04:51:52.755562+0000","last_active":"2024-05-10T05:18:21.180961+0000","last_peered":"2024-05-10T05:18:21.180961+0000","last_clean":"2024-05-10T05:18:21.180961+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:21.180961+0000","last_undegraded":"2024-05-10T05:18:21.180961+0000","last_fullsized":"2024-05-10T05:18:21.180961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'1998","reported_seq":2025,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.492776+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T05:18:21.492776+0000","last_peered":"2024-05-10T05:18:21.492776+0000","last_clean":"2024-05-10T05:18:21.492776+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:18:21.492776+0000","last_undegraded":"2024-05-10T05:18:21.492776+0000","last_fullsized":"2024-05-10T05:18:21.492776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1998,"log_dups_size":0,"ondisk_log_size":1998,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2101","reported_seq":2128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.391747+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T05:18:21.391747+0000","last_peered":"2024-05-10T05:18:21.391747+0000","last_clean":"2024-05-10T05:18:21.391747+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:21.391747+0000","last_undegraded":"2024-05-10T05:18:21.391747+0000","last_fullsized":"2024-05-10T05:18:21.391747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2101,"log_dups_size":0,"ondisk_log_size":2101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1983","reported_seq":2010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.329214+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T05:18:21.329214+0000","last_peered":"2024-05-10T05:18:21.329214+0000","last_clean":"2024-05-10T05:18:21.329214+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:18:21.329214+0000","last_undegraded":"2024-05-10T05:18:21.329214+0000","last_fullsized":"2024-05-10T05:18:21.329214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1983,"log_dups_size":0,"ondisk_log_size":1983,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.534366+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T05:18:21.534366+0000","last_peered":"2024-05-10T05:18:21.534366+0000","last_clean":"2024-05-10T05:18:21.534366+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:21.534366+0000","last_undegraded":"2024-05-10T05:18:21.534366+0000","last_fullsized":"2024-05-10T05:18:21.534366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1984","reported_seq":2011,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.516969+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T05:18:21.516969+0000","last_peered":"2024-05-10T05:18:21.516969+0000","last_clean":"2024-05-10T05:18:21.516969+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:21.516969+0000","last_undegraded":"2024-05-10T05:18:21.516969+0000","last_fullsized":"2024-05-10T05:18:21.516969+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1984,"log_dups_size":0,"ondisk_log_size":1984,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:11:54.155544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2096","reported_seq":2123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.411806+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T05:18:21.411806+0000","last_peered":"2024-05-10T05:18:21.411806+0000","last_clean":"2024-05-10T05:18:21.411806+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:18:21.411806+0000","last_undegraded":"2024-05-10T05:18:21.411806+0000","last_fullsized":"2024-05-10T05:18:21.411806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2096,"log_dups_size":0,"ondisk_log_size":2096,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7881,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.607874+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T05:18:21.607874+0000","last_peered":"2024-05-10T05:18:21.607874+0000","last_clean":"2024-05-10T05:18:21.607874+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:18:21.607874+0000","last_undegraded":"2024-05-10T05:18:21.607874+0000","last_fullsized":"2024-05-10T05:18:21.607874+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:40:17.672327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1884","reported_seq":1913,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:11.384889+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T05:18:11.384889+0000","last_peered":"2024-05-10T05:18:11.384889+0000","last_clean":"2024-05-10T05:18:11.384889+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:11.384889+0000","last_undegraded":"2024-05-10T05:18:11.384889+0000","last_fullsized":"2024-05-10T05:18:11.384889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1884,"log_dups_size":0,"ondisk_log_size":1884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1908,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2034","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.546869+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T05:18:21.546869+0000","last_peered":"2024-05-10T05:18:21.546869+0000","last_clean":"2024-05-10T05:18:21.546869+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:18:21.546869+0000","last_undegraded":"2024-05-10T05:18:21.546869+0000","last_fullsized":"2024-05-10T05:18:21.546869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7649,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.752342+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T05:18:21.752342+0000","last_peered":"2024-05-10T05:18:21.752342+0000","last_clean":"2024-05-10T05:18:21.752342+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:18:21.752342+0000","last_undegraded":"2024-05-10T05:18:21.752342+0000","last_fullsized":"2024-05-10T05:18:21.752342+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:12:28.397546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6434","reported_seq":6464,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.263876+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T05:18:23.263876+0000","last_peered":"2024-05-10T05:18:23.263876+0000","last_clean":"2024-05-10T05:18:23.263876+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:23.263876+0000","last_undegraded":"2024-05-10T05:18:23.263876+0000","last_fullsized":"2024-05-10T05:18:23.263876+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6334,"log_dups_size":0,"ondisk_log_size":6334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2034","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.866776+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T05:18:20.866776+0000","last_peered":"2024-05-10T05:18:20.866776+0000","last_clean":"2024-05-10T05:18:20.866776+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:20.866776+0000","last_undegraded":"2024-05-10T05:18:20.866776+0000","last_fullsized":"2024-05-10T05:18:20.866776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7722,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.767261+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T05:18:21.767261+0000","last_peered":"2024-05-10T05:18:21.767261+0000","last_clean":"2024-05-10T05:18:21.767261+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:18:21.767261+0000","last_undegraded":"2024-05-10T05:18:21.767261+0000","last_fullsized":"2024-05-10T05:18:21.767261+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:43:48.565633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9861","reported_seq":9888,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:15.507820+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T05:18:15.507820+0000","last_peered":"2024-05-10T05:18:15.507820+0000","last_clean":"2024-05-10T05:18:15.507820+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:15.507820+0000","last_undegraded":"2024-05-10T05:18:15.507820+0000","last_fullsized":"2024-05-10T05:18:15.507820+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9864,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2085","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.661342+0000","last_change":"2024-05-10T04:52:40.336526+0000","last_active":"2024-05-10T05:18:21.661342+0000","last_peered":"2024-05-10T05:18:21.661342+0000","last_clean":"2024-05-10T05:18:21.661342+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:18:21.661342+0000","last_undegraded":"2024-05-10T05:18:21.661342+0000","last_fullsized":"2024-05-10T05:18:21.661342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:10:27.704427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.835011+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T05:18:25.835011+0000","last_peered":"2024-05-10T05:18:25.835011+0000","last_clean":"2024-05-10T05:18:25.835011+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:25.835011+0000","last_undegraded":"2024-05-10T05:18:25.835011+0000","last_fullsized":"2024-05-10T05:18:25.835011+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:24:47.171956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5467","reported_seq":5494,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:41.051134+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T05:17:41.051134+0000","last_peered":"2024-05-10T05:17:41.051134+0000","last_clean":"2024-05-10T05:17:41.051134+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:17:41.051134+0000","last_undegraded":"2024-05-10T05:17:41.051134+0000","last_fullsized":"2024-05-10T05:17:41.051134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5467,"log_dups_size":0,"ondisk_log_size":5467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5467,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2019","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.549021+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T05:18:20.549021+0000","last_peered":"2024-05-10T05:18:20.549021+0000","last_clean":"2024-05-10T05:18:20.549021+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:18:20.549021+0000","last_undegraded":"2024-05-10T05:18:20.549021+0000","last_fullsized":"2024-05-10T05:18:20.549021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2019,"log_dups_size":0,"ondisk_log_size":2019,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7512","reported_seq":7575,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.445358+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T05:18:21.445358+0000","last_peered":"2024-05-10T05:18:21.445358+0000","last_clean":"2024-05-10T05:18:21.445358+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:18:21.445358+0000","last_undegraded":"2024-05-10T05:18:21.445358+0000","last_fullsized":"2024-05-10T05:18:21.445358+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6298,"log_dups_size":0,"ondisk_log_size":6298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5293,"num_write_kb":975875,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8788","reported_seq":8815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.292792+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T05:18:23.292792+0000","last_peered":"2024-05-10T05:18:23.292792+0000","last_clean":"2024-05-10T05:18:23.292792+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:23.292792+0000","last_undegraded":"2024-05-10T05:18:23.292792+0000","last_fullsized":"2024-05-10T05:18:23.292792+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:16:57.165377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.946403+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T05:18:25.946403+0000","last_peered":"2024-05-10T05:18:25.946403+0000","last_clean":"2024-05-10T05:18:25.946403+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:25.946403+0000","last_undegraded":"2024-05-10T05:18:25.946403+0000","last_fullsized":"2024-05-10T05:18:25.946403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:33.442695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7545,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771999+0000","last_change":"2024-05-10T04:52:40.388737+0000","last_active":"2024-05-10T05:18:21.771999+0000","last_peered":"2024-05-10T05:18:21.771999+0000","last_clean":"2024-05-10T05:18:21.771999+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:21.771999+0000","last_undegraded":"2024-05-10T05:18:21.771999+0000","last_fullsized":"2024-05-10T05:18:21.771999+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:03:27.377522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9788","reported_seq":9815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.287881+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T05:18:23.287881+0000","last_peered":"2024-05-10T05:18:23.287881+0000","last_clean":"2024-05-10T05:18:23.287881+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:23.287881+0000","last_undegraded":"2024-05-10T05:18:23.287881+0000","last_fullsized":"2024-05-10T05:18:23.287881+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7988,"log_dups_size":0,"ondisk_log_size":7988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2023","reported_seq":2049,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.731928+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T05:18:21.731928+0000","last_peered":"2024-05-10T05:18:21.731928+0000","last_clean":"2024-05-10T05:18:21.731928+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:21.731928+0000","last_undegraded":"2024-05-10T05:18:21.731928+0000","last_fullsized":"2024-05-10T05:18:21.731928+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7234","reported_seq":7476,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.453872+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T05:18:21.453872+0000","last_peered":"2024-05-10T05:18:21.453872+0000","last_clean":"2024-05-10T05:18:21.453872+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:18:21.453872+0000","last_undegraded":"2024-05-10T05:18:21.453872+0000","last_fullsized":"2024-05-10T05:18:21.453872+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7234,"log_dups_size":0,"ondisk_log_size":7234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5147,"num_write_kb":870087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4833","reported_seq":4860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.260650+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T05:18:23.260650+0000","last_peered":"2024-05-10T05:18:23.260650+0000","last_clean":"2024-05-10T05:18:23.260650+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:23.260650+0000","last_undegraded":"2024-05-10T05:18:23.260650+0000","last_fullsized":"2024-05-10T05:18:23.260650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2098","reported_seq":2124,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.636425+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T05:18:21.636425+0000","last_peered":"2024-05-10T05:18:21.636425+0000","last_clean":"2024-05-10T05:18:21.636425+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:21.636425+0000","last_undegraded":"2024-05-10T05:18:21.636425+0000","last_fullsized":"2024-05-10T05:18:21.636425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2098,"log_dups_size":0,"ondisk_log_size":2098,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7810,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.691448+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T05:18:21.691448+0000","last_peered":"2024-05-10T05:18:21.691448+0000","last_clean":"2024-05-10T05:18:21.691448+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:18:21.691448+0000","last_undegraded":"2024-05-10T05:18:21.691448+0000","last_fullsized":"2024-05-10T05:18:21.691448+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:08:51.328126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9719","reported_seq":9746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:11.532711+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T05:16:11.532711+0000","last_peered":"2024-05-10T05:16:11.532711+0000","last_clean":"2024-05-10T05:16:11.532711+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:16:11.532711+0000","last_undegraded":"2024-05-10T05:16:11.532711+0000","last_fullsized":"2024-05-10T05:16:11.532711+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7519,"log_dups_size":0,"ondisk_log_size":7519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2000","reported_seq":2026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.264771+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T05:18:21.264771+0000","last_peered":"2024-05-10T05:18:21.264771+0000","last_clean":"2024-05-10T05:18:21.264771+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:21.264771+0000","last_undegraded":"2024-05-10T05:18:21.264771+0000","last_fullsized":"2024-05-10T05:18:21.264771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7745,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.738124+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T05:18:21.738124+0000","last_peered":"2024-05-10T05:18:21.738124+0000","last_clean":"2024-05-10T05:18:21.738124+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:18:21.738124+0000","last_undegraded":"2024-05-10T05:18:21.738124+0000","last_fullsized":"2024-05-10T05:18:21.738124+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:56:17.960915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6180","reported_seq":6949,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.266389+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T05:18:23.266389+0000","last_peered":"2024-05-10T05:18:23.266389+0000","last_clean":"2024-05-10T05:18:23.266389+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:23.266389+0000","last_undegraded":"2024-05-10T05:18:23.266389+0000","last_fullsized":"2024-05-10T05:18:23.266389+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6180,"log_dups_size":0,"ondisk_log_size":6180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11268527,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6176,"num_write_kb":47861,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2036","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.673680+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T05:18:21.673680+0000","last_peered":"2024-05-10T05:18:21.673680+0000","last_clean":"2024-05-10T05:18:21.673680+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:18:21.673680+0000","last_undegraded":"2024-05-10T05:18:21.673680+0000","last_fullsized":"2024-05-10T05:18:21.673680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7404","reported_seq":7465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.352634+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T05:18:21.352634+0000","last_peered":"2024-05-10T05:18:21.352634+0000","last_clean":"2024-05-10T05:18:21.352634+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:18:21.352634+0000","last_undegraded":"2024-05-10T05:18:21.352634+0000","last_fullsized":"2024-05-10T05:18:21.352634+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327680,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5300,"num_write_kb":989171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6454","reported_seq":6481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:02.756886+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T05:17:02.756886+0000","last_peered":"2024-05-10T05:17:02.756886+0000","last_clean":"2024-05-10T05:17:02.756886+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:17:02.756886+0000","last_undegraded":"2024-05-10T05:17:02.756886+0000","last_fullsized":"2024-05-10T05:17:02.756886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6454,"log_dups_size":0,"ondisk_log_size":6454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6456,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2049","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.481740+0000","last_change":"2024-05-10T04:52:41.276730+0000","last_active":"2024-05-10T05:18:21.481740+0000","last_peered":"2024-05-10T05:18:21.481740+0000","last_clean":"2024-05-10T05:18:21.481740+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:21.481740+0000","last_undegraded":"2024-05-10T05:18:21.481740+0000","last_fullsized":"2024-05-10T05:18:21.481740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2049,"log_dups_size":0,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:15:47.752217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.303883+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T05:18:21.303883+0000","last_peered":"2024-05-10T05:18:21.303883+0000","last_clean":"2024-05-10T05:18:21.303883+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:21.303883+0000","last_undegraded":"2024-05-10T05:18:21.303883+0000","last_fullsized":"2024-05-10T05:18:21.303883+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5954","reported_seq":5982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.792542+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T05:18:21.792542+0000","last_peered":"2024-05-10T05:18:21.792542+0000","last_clean":"2024-05-10T05:18:21.792542+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:21.792542+0000","last_undegraded":"2024-05-10T05:18:21.792542+0000","last_fullsized":"2024-05-10T05:18:21.792542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5954,"log_dups_size":0,"ondisk_log_size":5954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5958,"num_write_kb":37125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2074,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.017985+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T05:18:26.017985+0000","last_peered":"2024-05-10T05:18:26.017985+0000","last_clean":"2024-05-10T05:18:26.017985+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:26.017985+0000","last_undegraded":"2024-05-10T05:18:26.017985+0000","last_fullsized":"2024-05-10T05:18:26.017985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:30.045712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7573","reported_seq":7638,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.663837+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T05:18:21.663837+0000","last_peered":"2024-05-10T05:18:21.663837+0000","last_clean":"2024-05-10T05:18:21.663837+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:18:21.663837+0000","last_undegraded":"2024-05-10T05:18:21.663837+0000","last_fullsized":"2024-05-10T05:18:21.663837+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7373,"log_dups_size":0,"ondisk_log_size":7373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:18:45.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1867776,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5439,"num_write_kb":922918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9427","reported_seq":10122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.255904+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T05:18:23.255904+0000","last_peered":"2024-05-10T05:18:23.255904+0000","last_clean":"2024-05-10T05:18:23.255904+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:23.255904+0000","last_undegraded":"2024-05-10T05:18:23.255904+0000","last_fullsized":"2024-05-10T05:18:23.255904+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7927,"log_dups_size":0,"ondisk_log_size":7927,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9421,"num_write_kb":67820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1986","reported_seq":2012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.527409+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T05:18:21.527409+0000","last_peered":"2024-05-10T05:18:21.527409+0000","last_clean":"2024-05-10T05:18:21.527409+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:18:21.527409+0000","last_undegraded":"2024-05-10T05:18:21.527409+0000","last_fullsized":"2024-05-10T05:18:21.527409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7643,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771899+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T05:18:21.771899+0000","last_peered":"2024-05-10T05:18:21.771899+0000","last_clean":"2024-05-10T05:18:21.771899+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:18:21.771899+0000","last_undegraded":"2024-05-10T05:18:21.771899+0000","last_fullsized":"2024-05-10T05:18:21.771899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4828","reported_seq":4856,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:36.424284+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T05:17:36.424284+0000","last_peered":"2024-05-10T05:17:36.424284+0000","last_clean":"2024-05-10T05:17:36.424284+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:17:36.424284+0000","last_undegraded":"2024-05-10T05:17:36.424284+0000","last_fullsized":"2024-05-10T05:17:36.424284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4828,"log_dups_size":0,"ondisk_log_size":4828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:35:17.142743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4830,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2045","reported_seq":2072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.658582+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T05:18:21.658582+0000","last_peered":"2024-05-10T05:18:21.658582+0000","last_clean":"2024-05-10T05:18:21.658582+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:21.658582+0000","last_undegraded":"2024-05-10T05:18:21.658582+0000","last_fullsized":"2024-05-10T05:18:21.658582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2045,"log_dups_size":0,"ondisk_log_size":2045,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.612571+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T05:18:21.612571+0000","last_peered":"2024-05-10T05:18:21.612571+0000","last_clean":"2024-05-10T05:18:21.612571+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:18:21.612571+0000","last_undegraded":"2024-05-10T05:18:21.612571+0000","last_fullsized":"2024-05-10T05:18:21.612571+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:15:15.975238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2070","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:22.489142+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T05:16:22.489142+0000","last_peered":"2024-05-10T05:16:22.489142+0000","last_clean":"2024-05-10T05:16:22.489142+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:16:22.489142+0000","last_undegraded":"2024-05-10T05:16:22.489142+0000","last_fullsized":"2024-05-10T05:16:22.489142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2085,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.957994+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T05:18:20.957994+0000","last_peered":"2024-05-10T05:18:20.957994+0000","last_clean":"2024-05-10T05:18:20.957994+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:20.957994+0000","last_undegraded":"2024-05-10T05:18:20.957994+0000","last_fullsized":"2024-05-10T05:18:20.957994+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.745422+0000","last_change":"2024-05-10T04:52:41.239639+0000","last_active":"2024-05-10T05:18:21.745422+0000","last_peered":"2024-05-10T05:18:21.745422+0000","last_clean":"2024-05-10T05:18:21.745422+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:18:21.745422+0000","last_undegraded":"2024-05-10T05:18:21.745422+0000","last_fullsized":"2024-05-10T05:18:21.745422+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:53.938219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2468,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.256049+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T05:18:23.256049+0000","last_peered":"2024-05-10T05:18:23.256049+0000","last_clean":"2024-05-10T05:18:23.256049+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:23.256049+0000","last_undegraded":"2024-05-10T05:18:23.256049+0000","last_fullsized":"2024-05-10T05:18:23.256049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2002","reported_seq":2029,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.758978+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T05:18:20.758978+0000","last_peered":"2024-05-10T05:18:20.758978+0000","last_clean":"2024-05-10T05:18:20.758978+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:20.758978+0000","last_undegraded":"2024-05-10T05:18:20.758978+0000","last_fullsized":"2024-05-10T05:18:20.758978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2002,"log_dups_size":0,"ondisk_log_size":2002,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.702456+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T05:18:21.702456+0000","last_peered":"2024-05-10T05:18:21.702456+0000","last_clean":"2024-05-10T05:18:21.702456+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:18:21.702456+0000","last_undegraded":"2024-05-10T05:18:21.702456+0000","last_fullsized":"2024-05-10T05:18:21.702456+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:25.052141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3403","reported_seq":3431,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.249528+0000","last_change":"2024-05-10T04:51:52.131616+0000","last_active":"2024-05-10T05:18:23.249528+0000","last_peered":"2024-05-10T05:18:23.249528+0000","last_clean":"2024-05-10T05:18:23.249528+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:23.249528+0000","last_undegraded":"2024-05-10T05:18:23.249528+0000","last_fullsized":"2024-05-10T05:18:23.249528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3403,"log_dups_size":0,"ondisk_log_size":3403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3413,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2087","reported_seq":2108,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.226511+0000","last_change":"2024-05-10T04:52:40.334760+0000","last_active":"2024-05-10T05:18:23.226511+0000","last_peered":"2024-05-10T05:18:23.226511+0000","last_clean":"2024-05-10T05:18:23.226511+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:18:23.226511+0000","last_undegraded":"2024-05-10T05:18:23.226511+0000","last_fullsized":"2024-05-10T05:18:23.226511+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2087,"log_dups_size":0,"ondisk_log_size":2087,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:51:28.551142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.608166+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T05:18:21.608166+0000","last_peered":"2024-05-10T05:18:21.608166+0000","last_clean":"2024-05-10T05:18:21.608166+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:18:21.608166+0000","last_undegraded":"2024-05-10T05:18:21.608166+0000","last_fullsized":"2024-05-10T05:18:21.608166+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:57:28.135935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4728","reported_seq":4756,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.283608+0000","last_change":"2024-05-10T04:51:52.143194+0000","last_active":"2024-05-10T05:18:23.283608+0000","last_peered":"2024-05-10T05:18:23.283608+0000","last_clean":"2024-05-10T05:18:23.283608+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:23.283608+0000","last_undegraded":"2024-05-10T05:18:23.283608+0000","last_fullsized":"2024-05-10T05:18:23.283608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4728,"log_dups_size":0,"ondisk_log_size":4728,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:03:42.815432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2042","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.315918+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T05:18:21.315918+0000","last_peered":"2024-05-10T05:18:21.315918+0000","last_clean":"2024-05-10T05:18:21.315918+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:18:21.315918+0000","last_undegraded":"2024-05-10T05:18:21.315918+0000","last_fullsized":"2024-05-10T05:18:21.315918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2042,"log_dups_size":0,"ondisk_log_size":2042,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7928,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.703637+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T05:18:21.703637+0000","last_peered":"2024-05-10T05:18:21.703637+0000","last_clean":"2024-05-10T05:18:21.703637+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:18:21.703637+0000","last_undegraded":"2024-05-10T05:18:21.703637+0000","last_fullsized":"2024-05-10T05:18:21.703637+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6057","reported_seq":6086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:01.041726+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T05:18:01.041726+0000","last_peered":"2024-05-10T05:18:01.041726+0000","last_clean":"2024-05-10T05:18:01.041726+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:01.041726+0000","last_undegraded":"2024-05-10T05:18:01.041726+0000","last_fullsized":"2024-05-10T05:18:01.041726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6057,"log_dups_size":0,"ondisk_log_size":6057,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6062,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2022","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.725133+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T05:18:21.725133+0000","last_peered":"2024-05-10T05:18:21.725133+0000","last_clean":"2024-05-10T05:18:21.725133+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:18:21.725133+0000","last_undegraded":"2024-05-10T05:18:21.725133+0000","last_fullsized":"2024-05-10T05:18:21.725133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2022,"log_dups_size":0,"ondisk_log_size":2022,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8411,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.766997+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T05:18:21.766997+0000","last_peered":"2024-05-10T05:18:21.766997+0000","last_clean":"2024-05-10T05:18:21.766997+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:18:21.766997+0000","last_undegraded":"2024-05-10T05:18:21.766997+0000","last_fullsized":"2024-05-10T05:18:21.766997+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:27:05.451522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7061","reported_seq":7090,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:52.704728+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T05:16:52.704728+0000","last_peered":"2024-05-10T05:16:52.704728+0000","last_clean":"2024-05-10T05:16:52.704728+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:16:52.704728+0000","last_undegraded":"2024-05-10T05:16:52.704728+0000","last_fullsized":"2024-05-10T05:16:52.704728+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7061,"log_dups_size":0,"ondisk_log_size":7061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7057,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.967879+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T05:18:25.967879+0000","last_peered":"2024-05-10T05:18:25.967879+0000","last_clean":"2024-05-10T05:18:25.967879+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:25.967879+0000","last_undegraded":"2024-05-10T05:18:25.967879+0000","last_fullsized":"2024-05-10T05:18:25.967879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7588,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.715058+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T05:18:21.715058+0000","last_peered":"2024-05-10T05:18:21.715058+0000","last_clean":"2024-05-10T05:18:21.715058+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:18:21.715058+0000","last_undegraded":"2024-05-10T05:18:21.715058+0000","last_fullsized":"2024-05-10T05:18:21.715058+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2050","reported_seq":2079,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.397473+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T05:18:21.397473+0000","last_peered":"2024-05-10T05:18:21.397473+0000","last_clean":"2024-05-10T05:18:21.397473+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:21.397473+0000","last_undegraded":"2024-05-10T05:18:21.397473+0000","last_fullsized":"2024-05-10T05:18:21.397473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6608,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.274962+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T05:18:23.274962+0000","last_peered":"2024-05-10T05:18:23.274962+0000","last_clean":"2024-05-10T05:18:23.274962+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:23.274962+0000","last_undegraded":"2024-05-10T05:18:23.274962+0000","last_fullsized":"2024-05-10T05:18:23.274962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7596,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.759345+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T05:18:21.759345+0000","last_peered":"2024-05-10T05:18:21.759345+0000","last_clean":"2024-05-10T05:18:21.759345+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:18:21.759345+0000","last_undegraded":"2024-05-10T05:18:21.759345+0000","last_fullsized":"2024-05-10T05:18:21.759345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2077","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.685132+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T05:18:21.685132+0000","last_peered":"2024-05-10T05:18:21.685132+0000","last_clean":"2024-05-10T05:18:21.685132+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:18:21.685132+0000","last_undegraded":"2024-05-10T05:18:21.685132+0000","last_fullsized":"2024-05-10T05:18:21.685132+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4529","reported_seq":4558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:57.705574+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T05:16:57.705574+0000","last_peered":"2024-05-10T05:16:57.705574+0000","last_clean":"2024-05-10T05:16:57.705574+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:16:57.705574+0000","last_undegraded":"2024-05-10T05:16:57.705574+0000","last_fullsized":"2024-05-10T05:16:57.705574+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4529,"log_dups_size":0,"ondisk_log_size":4529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4530,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:15:56.300717+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T05:15:56.300717+0000","last_peered":"2024-05-10T05:15:56.300717+0000","last_clean":"2024-05-10T05:15:56.300717+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:15:56.300717+0000","last_undegraded":"2024-05-10T05:15:56.300717+0000","last_fullsized":"2024-05-10T05:15:56.300717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.600950+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T05:18:21.600950+0000","last_peered":"2024-05-10T05:18:21.600950+0000","last_clean":"2024-05-10T05:18:21.600950+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:18:21.600950+0000","last_undegraded":"2024-05-10T05:18:21.600950+0000","last_fullsized":"2024-05-10T05:18:21.600950+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:56:53.752786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1989","reported_seq":2017,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.576508+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T05:18:21.576508+0000","last_peered":"2024-05-10T05:18:21.576508+0000","last_clean":"2024-05-10T05:18:21.576508+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:21.576508+0000","last_undegraded":"2024-05-10T05:18:21.576508+0000","last_fullsized":"2024-05-10T05:18:21.576508+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1989,"log_dups_size":0,"ondisk_log_size":1989,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:26:33.456272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6529","reported_seq":6559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:59.156422+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T05:17:59.156422+0000","last_peered":"2024-05-10T05:17:59.156422+0000","last_clean":"2024-05-10T05:17:59.156422+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:17:59.156422+0000","last_undegraded":"2024-05-10T05:17:59.156422+0000","last_fullsized":"2024-05-10T05:17:59.156422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6529,"log_dups_size":0,"ondisk_log_size":6529,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6533,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7693,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.682694+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T05:18:21.682694+0000","last_peered":"2024-05-10T05:18:21.682694+0000","last_clean":"2024-05-10T05:18:21.682694+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:18:21.682694+0000","last_undegraded":"2024-05-10T05:18:21.682694+0000","last_fullsized":"2024-05-10T05:18:21.682694+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:01:46.802714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4963","reported_seq":4992,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:40.979327+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T05:16:40.979327+0000","last_peered":"2024-05-10T05:16:40.979327+0000","last_clean":"2024-05-10T05:16:40.979327+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:16:40.979327+0000","last_undegraded":"2024-05-10T05:16:40.979327+0000","last_fullsized":"2024-05-10T05:16:40.979327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4963,"log_dups_size":0,"ondisk_log_size":4963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4966,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2066","reported_seq":2094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.727974+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T05:18:21.727974+0000","last_peered":"2024-05-10T05:18:21.727974+0000","last_clean":"2024-05-10T05:18:21.727974+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:21.727974+0000","last_undegraded":"2024-05-10T05:18:21.727974+0000","last_fullsized":"2024-05-10T05:18:21.727974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2066,"log_dups_size":0,"ondisk_log_size":2066,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7176","reported_seq":7221,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.418812+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T05:18:21.418812+0000","last_peered":"2024-05-10T05:18:21.418812+0000","last_clean":"2024-05-10T05:18:21.418812+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:18:21.418812+0000","last_undegraded":"2024-05-10T05:18:21.418812+0000","last_fullsized":"2024-05-10T05:18:21.418812+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6274,"log_dups_size":0,"ondisk_log_size":6274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:01.042748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5016,"num_write_kb":931826,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4510","reported_seq":4787,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:18.117537+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T05:18:18.117537+0000","last_peered":"2024-05-10T05:18:18.117537+0000","last_clean":"2024-05-10T05:18:18.117537+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:18.117537+0000","last_undegraded":"2024-05-10T05:18:18.117537+0000","last_fullsized":"2024-05-10T05:18:18.117537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4510,"log_dups_size":0,"ondisk_log_size":4510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5693195,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":248,"num_read_kb":1630,"num_write":5090,"num_write_kb":38911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1992","reported_seq":2020,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.611609+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T05:18:21.611609+0000","last_peered":"2024-05-10T05:18:21.611609+0000","last_clean":"2024-05-10T05:18:21.611609+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:21.611609+0000","last_undegraded":"2024-05-10T05:18:21.611609+0000","last_fullsized":"2024-05-10T05:18:21.611609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7839,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.561520+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T05:18:21.561520+0000","last_peered":"2024-05-10T05:18:21.561520+0000","last_clean":"2024-05-10T05:18:21.561520+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:21.561520+0000","last_undegraded":"2024-05-10T05:18:21.561520+0000","last_fullsized":"2024-05-10T05:18:21.561520+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:12:44.112334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2929","reported_seq":2958,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285307+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T05:18:23.285307+0000","last_peered":"2024-05-10T05:18:23.285307+0000","last_clean":"2024-05-10T05:18:23.285307+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:23.285307+0000","last_undegraded":"2024-05-10T05:18:23.285307+0000","last_fullsized":"2024-05-10T05:18:23.285307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2929,"log_dups_size":0,"ondisk_log_size":2929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2034","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.606877+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T05:18:21.606877+0000","last_peered":"2024-05-10T05:18:21.606877+0000","last_clean":"2024-05-10T05:18:21.606877+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:21.606877+0000","last_undegraded":"2024-05-10T05:18:21.606877+0000","last_fullsized":"2024-05-10T05:18:21.606877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7569,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.840121+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T05:18:25.840121+0000","last_peered":"2024-05-10T05:18:25.840121+0000","last_clean":"2024-05-10T05:18:25.840121+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:25.840121+0000","last_undegraded":"2024-05-10T05:18:25.840121+0000","last_fullsized":"2024-05-10T05:18:25.840121+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:35:59.687706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2703","reported_seq":2732,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:53.864278+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T05:16:53.864278+0000","last_peered":"2024-05-10T05:16:53.864278+0000","last_clean":"2024-05-10T05:16:53.864278+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:16:53.864278+0000","last_undegraded":"2024-05-10T05:16:53.864278+0000","last_fullsized":"2024-05-10T05:16:53.864278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2703,"log_dups_size":0,"ondisk_log_size":2703,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2708,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.568724+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T05:18:21.568724+0000","last_peered":"2024-05-10T05:18:21.568724+0000","last_clean":"2024-05-10T05:18:21.568724+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:21.568724+0000","last_undegraded":"2024-05-10T05:18:21.568724+0000","last_fullsized":"2024-05-10T05:18:21.568724+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:28:34.360703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.714933+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T05:18:21.714933+0000","last_peered":"2024-05-10T05:18:21.714933+0000","last_clean":"2024-05-10T05:18:21.714933+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:18:21.714933+0000","last_undegraded":"2024-05-10T05:18:21.714933+0000","last_fullsized":"2024-05-10T05:18:21.714933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:24:02.360702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3606","reported_seq":3635,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:44.359477+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T05:16:44.359477+0000","last_peered":"2024-05-10T05:16:44.359477+0000","last_clean":"2024-05-10T05:16:44.359477+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:16:44.359477+0000","last_undegraded":"2024-05-10T05:16:44.359477+0000","last_fullsized":"2024-05-10T05:16:44.359477+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3606,"log_dups_size":0,"ondisk_log_size":3606,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:19:14.366826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3624,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2107","reported_seq":2135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.653553+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T05:18:21.653553+0000","last_peered":"2024-05-10T05:18:21.653553+0000","last_clean":"2024-05-10T05:18:21.653553+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:21.653553+0000","last_undegraded":"2024-05-10T05:18:21.653553+0000","last_fullsized":"2024-05-10T05:18:21.653553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2107,"log_dups_size":0,"ondisk_log_size":2107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7426,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.701576+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T05:18:21.701576+0000","last_peered":"2024-05-10T05:18:21.701576+0000","last_clean":"2024-05-10T05:18:21.701576+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:18:21.701576+0000","last_undegraded":"2024-05-10T05:18:21.701576+0000","last_fullsized":"2024-05-10T05:18:21.701576+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:29:26.581667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6717","reported_seq":6746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:39.819475+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T05:17:39.819475+0000","last_peered":"2024-05-10T05:17:39.819475+0000","last_clean":"2024-05-10T05:17:39.819475+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:17:39.819475+0000","last_undegraded":"2024-05-10T05:17:39.819475+0000","last_fullsized":"2024-05-10T05:17:39.819475+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6717,"log_dups_size":0,"ondisk_log_size":6717,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6709,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2071","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.378982+0000","last_change":"2024-05-10T04:52:40.335170+0000","last_active":"2024-05-10T05:18:21.378982+0000","last_peered":"2024-05-10T05:18:21.378982+0000","last_clean":"2024-05-10T05:18:21.378982+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:21.378982+0000","last_undegraded":"2024-05-10T05:18:21.378982+0000","last_fullsized":"2024-05-10T05:18:21.378982+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:07:53.141194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7869,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.850330+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T05:18:25.850330+0000","last_peered":"2024-05-10T05:18:25.850330+0000","last_clean":"2024-05-10T05:18:25.850330+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:18:25.850330+0000","last_undegraded":"2024-05-10T05:18:25.850330+0000","last_fullsized":"2024-05-10T05:18:25.850330+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:23:13.092125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6906","reported_seq":6934,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:50.952319+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T05:16:50.952319+0000","last_peered":"2024-05-10T05:16:50.952319+0000","last_clean":"2024-05-10T05:16:50.952319+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:16:50.952319+0000","last_undegraded":"2024-05-10T05:16:50.952319+0000","last_fullsized":"2024-05-10T05:16:50.952319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6906,"log_dups_size":0,"ondisk_log_size":6906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6922,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2064","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.656167+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T05:18:21.656167+0000","last_peered":"2024-05-10T05:18:21.656167+0000","last_clean":"2024-05-10T05:18:21.656167+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:18:21.656167+0000","last_undegraded":"2024-05-10T05:18:21.656167+0000","last_fullsized":"2024-05-10T05:18:21.656167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2064,"log_dups_size":0,"ondisk_log_size":2064,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.687453+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T05:18:21.687453+0000","last_peered":"2024-05-10T05:18:21.687453+0000","last_clean":"2024-05-10T05:18:21.687453+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:18:21.687453+0000","last_undegraded":"2024-05-10T05:18:21.687453+0000","last_fullsized":"2024-05-10T05:18:21.687453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5970","reported_seq":5998,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:16.397485+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T05:17:16.397485+0000","last_peered":"2024-05-10T05:17:16.397485+0000","last_clean":"2024-05-10T05:17:16.397485+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:17:16.397485+0000","last_undegraded":"2024-05-10T05:17:16.397485+0000","last_fullsized":"2024-05-10T05:17:16.397485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5970,"log_dups_size":0,"ondisk_log_size":5970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2036","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.443216+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T05:18:21.443216+0000","last_peered":"2024-05-10T05:18:21.443216+0000","last_clean":"2024-05-10T05:18:21.443216+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:21.443216+0000","last_undegraded":"2024-05-10T05:18:21.443216+0000","last_fullsized":"2024-05-10T05:18:21.443216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2036,"log_dups_size":0,"ondisk_log_size":2036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7893","reported_seq":7997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.661320+0000","last_change":"2024-05-10T04:52:40.389082+0000","last_active":"2024-05-10T05:18:21.661320+0000","last_peered":"2024-05-10T05:18:21.661320+0000","last_clean":"2024-05-10T05:18:21.661320+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:18:21.661320+0000","last_undegraded":"2024-05-10T05:18:21.661320+0000","last_fullsized":"2024-05-10T05:18:21.661320+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7187,"log_dups_size":0,"ondisk_log_size":7187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:16.764694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":260096,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5698,"num_write_kb":1007687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7938","reported_seq":7966,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:17:26.096941+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T05:17:26.096941+0000","last_peered":"2024-05-10T05:17:26.096941+0000","last_clean":"2024-05-10T05:17:26.096941+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:17:26.096941+0000","last_undegraded":"2024-05-10T05:17:26.096941+0000","last_fullsized":"2024-05-10T05:17:26.096941+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7338,"log_dups_size":0,"ondisk_log_size":7338,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7933,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2028","reported_seq":2055,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.406662+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T05:18:21.406662+0000","last_peered":"2024-05-10T05:18:21.406662+0000","last_clean":"2024-05-10T05:18:21.406662+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:18:21.406662+0000","last_undegraded":"2024-05-10T05:18:21.406662+0000","last_fullsized":"2024-05-10T05:18:21.406662+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2028,"log_dups_size":0,"ondisk_log_size":2028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646424+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T05:18:21.646424+0000","last_peered":"2024-05-10T05:18:21.646424+0000","last_clean":"2024-05-10T05:18:21.646424+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:18:21.646424+0000","last_undegraded":"2024-05-10T05:18:21.646424+0000","last_fullsized":"2024-05-10T05:18:21.646424+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5556","reported_seq":5584,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.259260+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T05:18:23.259260+0000","last_peered":"2024-05-10T05:18:23.259260+0000","last_clean":"2024-05-10T05:18:23.259260+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:23.259260+0000","last_undegraded":"2024-05-10T05:18:23.259260+0000","last_fullsized":"2024-05-10T05:18:23.259260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1952","reported_seq":1979,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.238683+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T05:18:21.238683+0000","last_peered":"2024-05-10T05:18:21.238683+0000","last_clean":"2024-05-10T05:18:21.238683+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:21.238683+0000","last_undegraded":"2024-05-10T05:18:21.238683+0000","last_fullsized":"2024-05-10T05:18:21.238683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1952,"log_dups_size":0,"ondisk_log_size":1952,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1977","reported_seq":2005,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.941235+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T05:18:20.941235+0000","last_peered":"2024-05-10T05:18:20.941235+0000","last_clean":"2024-05-10T05:18:20.941235+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:18:20.941235+0000","last_undegraded":"2024-05-10T05:18:20.941235+0000","last_fullsized":"2024-05-10T05:18:20.941235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1977,"log_dups_size":0,"ondisk_log_size":1977,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2079","reported_seq":2107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.146529+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T05:18:21.146529+0000","last_peered":"2024-05-10T05:18:21.146529+0000","last_clean":"2024-05-10T05:18:21.146529+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:21.146529+0000","last_undegraded":"2024-05-10T05:18:21.146529+0000","last_fullsized":"2024-05-10T05:18:21.146529+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:52:32.515326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1982","reported_seq":2010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.466513+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T05:18:21.466513+0000","last_peered":"2024-05-10T05:18:21.466513+0000","last_clean":"2024-05-10T05:18:21.466513+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:18:21.466513+0000","last_undegraded":"2024-05-10T05:18:21.466513+0000","last_fullsized":"2024-05-10T05:18:21.466513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1982,"log_dups_size":0,"ondisk_log_size":1982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2086","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.698973+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T05:18:21.698973+0000","last_peered":"2024-05-10T05:18:21.698973+0000","last_clean":"2024-05-10T05:18:21.698973+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:21.698973+0000","last_undegraded":"2024-05-10T05:18:21.698973+0000","last_fullsized":"2024-05-10T05:18:21.698973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2086,"log_dups_size":0,"ondisk_log_size":2086,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2059","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.339956+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T05:18:21.339956+0000","last_peered":"2024-05-10T05:18:21.339956+0000","last_clean":"2024-05-10T05:18:21.339956+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:21.339956+0000","last_undegraded":"2024-05-10T05:18:21.339956+0000","last_fullsized":"2024-05-10T05:18:21.339956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:44.764637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1953","reported_seq":1981,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.460991+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T05:18:21.460991+0000","last_peered":"2024-05-10T05:18:21.460991+0000","last_clean":"2024-05-10T05:18:21.460991+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:18:21.460991+0000","last_undegraded":"2024-05-10T05:18:21.460991+0000","last_fullsized":"2024-05-10T05:18:21.460991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1953,"log_dups_size":0,"ondisk_log_size":1953,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2056","reported_seq":2084,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.446402+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T05:18:21.446402+0000","last_peered":"2024-05-10T05:18:21.446402+0000","last_clean":"2024-05-10T05:18:21.446402+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:18:21.446402+0000","last_undegraded":"2024-05-10T05:18:21.446402+0000","last_fullsized":"2024-05-10T05:18:21.446402+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2056,"log_dups_size":0,"ondisk_log_size":2056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2050","reported_seq":2078,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.616737+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T05:18:21.616737+0000","last_peered":"2024-05-10T05:18:21.616737+0000","last_clean":"2024-05-10T05:18:21.616737+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:21.616737+0000","last_undegraded":"2024-05-10T05:18:21.616737+0000","last_fullsized":"2024-05-10T05:18:21.616737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2050,"log_dups_size":0,"ondisk_log_size":2050,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:30:00.129342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2000","reported_seq":2028,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.322010+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T05:18:21.322010+0000","last_peered":"2024-05-10T05:18:21.322010+0000","last_clean":"2024-05-10T05:18:21.322010+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:21.322010+0000","last_undegraded":"2024-05-10T05:18:21.322010+0000","last_fullsized":"2024-05-10T05:18:21.322010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2000,"log_dups_size":0,"ondisk_log_size":2000,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2035","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.323810+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T05:18:21.323810+0000","last_peered":"2024-05-10T05:18:21.323810+0000","last_clean":"2024-05-10T05:18:21.323810+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:21.323810+0000","last_undegraded":"2024-05-10T05:18:21.323810+0000","last_fullsized":"2024-05-10T05:18:21.323810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2035,"log_dups_size":0,"ondisk_log_size":2035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:39.351411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2060","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:20.435357+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T05:18:20.435357+0000","last_peered":"2024-05-10T05:18:20.435357+0000","last_clean":"2024-05-10T05:18:20.435357+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:18:20.435357+0000","last_undegraded":"2024-05-10T05:18:20.435357+0000","last_fullsized":"2024-05-10T05:18:20.435357+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2060,"log_dups_size":0,"ondisk_log_size":2060,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2062","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.651581+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T05:18:21.651581+0000","last_peered":"2024-05-10T05:18:21.651581+0000","last_clean":"2024-05-10T05:18:21.651581+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:18:21.651581+0000","last_undegraded":"2024-05-10T05:18:21.651581+0000","last_fullsized":"2024-05-10T05:18:21.651581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2062,"log_dups_size":0,"ondisk_log_size":2062,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2043","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.384106+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T05:18:21.384106+0000","last_peered":"2024-05-10T05:18:21.384106+0000","last_clean":"2024-05-10T05:18:21.384106+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:21.384106+0000","last_undegraded":"2024-05-10T05:18:21.384106+0000","last_fullsized":"2024-05-10T05:18:21.384106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3504128,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173237,"num_write_kb":29659775,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12107776,"data_stored":12107776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225976,"ondisk_log_size":225976,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1115,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130287,"ondisk_log_size":130287,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235067000,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":2409,"num_read_kb":15302,"num_write":184752,"num_write_kb":1350563,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":87,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":474402816,"data_stored":474340060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172587,"ondisk_log_size":172587,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542466,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":924928,"kb_used_data":81784,"kb_used_omap":1,"kb_used_meta":843134,"kb_avail":93446912,"statfs":{"total":96636764160,"available":95689637888,"internally_reserved":0,"allocated":83746816,"data_stored":83562425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":863369675},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,0,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.1080000000000001,"5min":2.2599999999999998,"15min":1.736},"min":{"1min":0.309,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":28.266999999999999,"5min":28.266999999999999,"15min":34.326999999999998},"last":6.4359999999999999},{"interface":"front","average":{"1min":3.6920000000000002,"5min":2.7669999999999999,"15min":1.8069999999999999},"min":{"1min":0.39300000000000002,"5min":0.317,"15min":0.31},"max":{"1min":28.968,"5min":28.968,"15min":28.968},"last":1.1819999999999999}]},{"osd":1,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":4.3120000000000003,"5min":2.4780000000000002,"15min":1.8300000000000001},"min":{"1min":0.35599999999999998,"5min":0.33000000000000002,"15min":0.32900000000000001},"max":{"1min":34.805999999999997,"5min":34.805999999999997,"15min":34.805999999999997},"last":6.3819999999999997},{"interface":"front","average":{"1min":2.7269999999999999,"5min":2.7789999999999999,"15min":2.2480000000000002},"min":{"1min":0.47499999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":29.222000000000001,"5min":29.222000000000001,"15min":105.375},"last":1.411}]},{"osd":2,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":2.6960000000000002,"5min":3.2959999999999998,"15min":2.0569999999999999},"min":{"1min":0.54000000000000004,"5min":0.40899999999999997,"15min":0.35899999999999999},"max":{"1min":28.913,"5min":52.515999999999998,"15min":52.515999999999998},"last":1.7230000000000001},{"interface":"front","average":{"1min":4.04,"5min":2.5089999999999999,"15min":1.712},"min":{"1min":0.41599999999999998,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":34.756999999999998,"5min":35.595999999999997,"15min":35.595999999999997},"last":6.476}]},{"osd":3,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":2.843,"5min":3.5030000000000001,"15min":3.6440000000000001},"min":{"1min":0.44800000000000001,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":28.952999999999999,"5min":64.994,"15min":263.32999999999998},"last":1.595},{"interface":"front","average":{"1min":3.5169999999999999,"5min":2.7919999999999998,"15min":2.9119999999999999},"min":{"1min":0.53200000000000003,"5min":0.42399999999999999,"15min":0.40500000000000003},"max":{"1min":34.841999999999999,"5min":43.789000000000001,"15min":263.30900000000003},"last":6.5129999999999999}]},{"osd":4,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.9089999999999998,"5min":4.048,"15min":2.6240000000000001},"min":{"1min":0.438,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":30.199000000000002,"5min":52.252000000000002,"15min":52.252000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":2.964,"5min":3.7589999999999999,"15min":3.1120000000000001},"min":{"1min":0.48599999999999999,"5min":0.41599999999999998,"15min":0.36499999999999999},"max":{"1min":31.914000000000001,"5min":46.792000000000002,"15min":134.07499999999999},"last":2.2469999999999999}]},{"osd":5,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":3.585,"5min":3.2890000000000001,"15min":2.3410000000000002},"min":{"1min":0.497,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":34.875,"5min":34.875,"15min":34.875},"last":9.2859999999999996},{"interface":"front","average":{"1min":3.254,"5min":3.2029999999999998,"15min":2.2410000000000001},"min":{"1min":0.51400000000000001,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":29.867000000000001,"5min":29.867000000000001,"15min":37.582999999999998},"last":9.0559999999999992}]},{"osd":6,"last update":"Fri May 10 05:17:20 2024","interfaces":[{"interface":"back","average":{"1min":5.1719999999999997,"5min":5.056,"15min":3.137},"min":{"1min":0.69199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":29.905000000000001,"5min":65.388999999999996,"15min":65.388999999999996},"last":2.6720000000000002},{"interface":"front","average":{"1min":3.8330000000000002,"5min":5.4059999999999997,"15min":3.3530000000000002},"min":{"1min":0.50600000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":31.960999999999999,"5min":84.454999999999998,"15min":84.454999999999998},"last":2.2080000000000002}]}]},{"osd":6,"up_from":14,"seq":60129542465,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":979668,"kb_used_data":92236,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93392172,"statfs":{"total":96636764160,"available":95633584128,"internally_reserved":0,"allocated":94449664,"data_stored":94260377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":2.2069999999999999,"15min":2.899},"min":{"1min":0.313,"5min":0.30399999999999999,"15min":0.30199999999999999},"max":{"1min":9.5470000000000006,"5min":17.158000000000001,"15min":215.636},"last":0.72399999999999998},{"interface":"front","average":{"1min":3.7170000000000001,"5min":2.4049999999999998,"15min":2.7040000000000002},"min":{"1min":0.35999999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":26.574000000000002,"5min":26.574000000000002,"15min":216.899},"last":0.59199999999999997}]},{"osd":1,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.4540000000000002,"5min":2.5030000000000001,"15min":3.6099999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":20.341999999999999,"5min":20.341999999999999,"15min":283.584},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.25,"5min":2.1429999999999998,"15min":3.1899999999999999},"min":{"1min":0.39500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":9.5969999999999995,"5min":21.161999999999999,"15min":226.642},"last":0.64900000000000002}]},{"osd":2,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.0049999999999999,"5min":2.0230000000000001,"15min":2.5129999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.38200000000000001},"max":{"1min":13.759,"5min":13.759,"15min":204.20099999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":2.339,"5min":2.806,"15min":2.165},"min":{"1min":0.44,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":15.641999999999999,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.67200000000000004}]},{"osd":3,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":2.3260000000000001,"5min":2.1680000000000001,"15min":2.8330000000000002},"min":{"1min":0.47499999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":9.6289999999999996,"5min":21.224,"15min":211.06999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":2.794,"5min":2.242,"15min":2.7709999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":13.257999999999999,"5min":24.928999999999998,"15min":216.947},"last":0.90800000000000003}]},{"osd":4,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.4209999999999998,"5min":2.6160000000000001,"15min":2.5070000000000001},"min":{"1min":0.441,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.151,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":3.4100000000000001,"5min":3.1139999999999999,"15min":2.3069999999999999},"min":{"1min":0.499,"5min":0.438,"15min":0.39600000000000002},"max":{"1min":13.398,"5min":37.195,"15min":37.195},"last":0.95899999999999996}]},{"osd":5,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.012,"5min":2.863,"15min":2.278},"min":{"1min":0.57199999999999995,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":15.685,"5min":46.448999999999998,"15min":46.448999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":4.0999999999999996,"5min":2.839,"15min":2.4769999999999999},"min":{"1min":0.58499999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":18.962,"5min":20.692,"15min":35.591999999999999},"last":0.83699999999999997}]},{"osd":7,"last update":"Fri May 10 05:17:31 2024","interfaces":[{"interface":"back","average":{"1min":3.23,"5min":2.9849999999999999,"15min":2.2349999999999999},"min":{"1min":0.70999999999999996,"5min":0.437,"15min":0.437},"max":{"1min":13.369999999999999,"5min":58.857999999999997,"15min":58.857999999999997},"last":1},{"interface":"front","average":{"1min":4.2380000000000004,"5min":3.9590000000000001,"15min":2.5979999999999999},"min":{"1min":0.58099999999999996,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":20.297000000000001,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.88300000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542466,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":777628,"kb_used_data":70740,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93594212,"statfs":{"total":96636764160,"available":95840473088,"internally_reserved":0,"allocated":72437760,"data_stored":72245233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,2,4,0,3],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.1709999999999998,"5min":1.46,"15min":1.3959999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":39.710000000000001,"5min":39.710000000000001,"15min":40.371000000000002},"last":8.7910000000000004},{"interface":"front","average":{"1min":4.3259999999999996,"5min":2.1019999999999999,"15min":1.9139999999999999},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":62.222000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":1.569}]},{"osd":2,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3680000000000001,"15min":1.1699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":6.391,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.66300000000000003},{"interface":"front","average":{"1min":1.875,"5min":1.5880000000000001,"15min":1.3959999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":8.391,"5min":17.998000000000001,"15min":37.643999999999998},"last":1.4430000000000001}]},{"osd":3,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.7770000000000001,"5min":1.7150000000000001,"15min":2.0600000000000001},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":51.646999999999998,"5min":51.646999999999998,"15min":108.407},"last":4.7089999999999996},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6699999999999999,"15min":1.466},"min":{"1min":0.51000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.359999999999999,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.70999999999999996}]},{"osd":4,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7249999999999996,"5min":2.6739999999999999,"15min":2.2949999999999999},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":52.307000000000002,"5min":52.307000000000002,"15min":52.307000000000002},"last":4.6619999999999999},{"interface":"front","average":{"1min":3.0339999999999998,"5min":2.4809999999999999,"15min":1.9970000000000001},"min":{"1min":0.47199999999999998,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":13.576000000000001,"5min":19.292999999999999,"15min":32.276000000000003},"last":2.3969999999999998}]},{"osd":5,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5110000000000001,"5min":2.202,"15min":1.8660000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":9.8170000000000002,"5min":18.966000000000001,"15min":37.572000000000003},"last":1.2789999999999999},{"interface":"front","average":{"1min":4.3659999999999997,"5min":2.5840000000000001,"15min":2.2599999999999998},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":7.6829999999999998}]},{"osd":6,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":2.6240000000000001,"15min":2.1459999999999999},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":13.968,"5min":41.270000000000003,"15min":41.270000000000003},"last":0.877},{"interface":"front","average":{"1min":3.6699999999999999,"5min":2.923,"15min":2.258},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":18.013000000000002,"5min":41.043999999999997,"15min":41.043999999999997},"last":1.387}]},{"osd":7,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.6749999999999998,"15min":2.2490000000000001},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":17.946000000000002,"5min":22.251000000000001,"15min":37.850000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":3.927,"5min":2.3809999999999998,"15min":2.359},"min":{"1min":0.622,"5min":0.503,"15min":0.503},"max":{"1min":39.850000000000001,"5min":39.850000000000001,"15min":46.118000000000002},"last":4.7469999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575172,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":540160,"kb_used_data":21816,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93831680,"statfs":{"total":96636764160,"available":96083640320,"internally_reserved":0,"allocated":22339584,"data_stored":22162259,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":1.556,"15min":1.1779999999999999},"min":{"1min":0.28299999999999997,"5min":0.246,"15min":0.246},"max":{"1min":9.9390000000000001,"5min":24.271000000000001,"15min":24.271000000000001},"last":2.9020000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.4319999999999999,"15min":1.3420000000000001},"min":{"1min":0.314,"5min":0.30299999999999999,"15min":0.29399999999999998},"max":{"1min":8.2479999999999993,"5min":23.797999999999998,"15min":30.734999999999999},"last":4.681}]},{"osd":1,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.018,"15min":1.397},"min":{"1min":0.34200000000000003,"5min":0.28899999999999998,"15min":0.27700000000000002},"max":{"1min":9.9079999999999995,"5min":12.404999999999999,"15min":105.28},"last":3.2000000000000002},{"interface":"front","average":{"1min":1.885,"5min":2.3759999999999999,"15min":2.472},"min":{"1min":0.34300000000000003,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":30.760000000000002,"5min":73.775999999999996,"15min":105.255},"last":7.9219999999999997}]},{"osd":3,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.3140000000000001,"15min":1.5389999999999999},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":11.765000000000001,"5min":11.765000000000001,"15min":60.387999999999998},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.536,"15min":1.3680000000000001},"min":{"1min":0.34000000000000002,"5min":0.315,"15min":0.315},"max":{"1min":9.8339999999999996,"5min":21.029,"15min":22.358000000000001},"last":3.7320000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":5.3300000000000001,"15min":2.6850000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41899999999999998},"max":{"1min":12.801,"5min":249.88,"15min":249.88},"last":0.443},{"interface":"front","average":{"1min":1.3049999999999999,"5min":5.6280000000000001,"15min":3.0059999999999998},"min":{"1min":0.46600000000000003,"5min":0.44600000000000001,"15min":0.435},"max":{"1min":9.6890000000000001,"5min":249.82300000000001,"15min":249.82300000000001},"last":4.7329999999999997}]},{"osd":5,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.7170000000000001,"5min":3.8809999999999998,"15min":2.6120000000000001},"min":{"1min":0.45200000000000001,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":23.582999999999998,"5min":256.38600000000002,"15min":256.38600000000002},"last":0.72499999999999998},{"interface":"front","average":{"1min":1.21,"5min":3.7549999999999999,"15min":2.2749999999999999},"min":{"1min":0.55400000000000005,"5min":0.42899999999999999,"15min":0.42799999999999999},"max":{"1min":9.7970000000000006,"5min":255.04499999999999,"15min":255.04499999999999},"last":0.59099999999999997}]},{"osd":6,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":5.1210000000000004,"15min":2.8900000000000001},"min":{"1min":0.57599999999999996,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":7.6630000000000003,"5min":255.06999999999999,"15min":255.06999999999999},"last":4.7809999999999997},{"interface":"front","average":{"1min":2.4169999999999998,"5min":4.8220000000000001,"15min":2.9780000000000002},"min":{"1min":0.54000000000000004,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":38.405000000000001,"5min":253.095,"15min":253.095},"last":1.411}]},{"osd":7,"last update":"Fri May 10 05:17:22 2024","interfaces":[{"interface":"back","average":{"1min":1.3779999999999999,"5min":4.0599999999999996,"15min":2.7949999999999999},"min":{"1min":0.53700000000000003,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":8.2889999999999997,"5min":249.90799999999999,"15min":249.90799999999999},"last":4.8150000000000004},{"interface":"front","average":{"1min":2.4039999999999999,"5min":4.444,"15min":3.1240000000000001},"min":{"1min":0.59199999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":23.321999999999999,"5min":256.97699999999998,"15min":256.97699999999998},"last":0.77400000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542465,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":968972,"kb_used_data":53572,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93402868,"statfs":{"total":96636764160,"available":95644536832,"internally_reserved":0,"allocated":54857728,"data_stored":54672126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,4,0,4,7,5],"upper_bound":128},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":2.2999999999999998,"15min":2.4710000000000001},"min":{"1min":0.25800000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":50.100000000000001,"5min":50.100000000000001,"15min":192.745},"last":12.423},{"interface":"front","average":{"1min":4.3819999999999997,"5min":1.891,"15min":2.206},"min":{"1min":0.38700000000000001,"5min":0.377,"15min":0.30499999999999999},"max":{"1min":50.145000000000003,"5min":50.145000000000003,"15min":192.62799999999999},"last":1.3620000000000001}]},{"osd":2,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3520000000000001,"15min":1.651},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":3.9159999999999999,"5min":14.263999999999999,"15min":71.727999999999994},"last":5.375},{"interface":"front","average":{"1min":1.431,"5min":1.651,"15min":1.9910000000000001},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":5.5410000000000004,"5min":32.435000000000002,"15min":95.793000000000006},"last":5.5449999999999999}]},{"osd":3,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.0249999999999999,"15min":2.1030000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":14.446,"5min":21.994,"15min":125.41200000000001},"last":12.491},{"interface":"front","average":{"1min":3.0030000000000001,"5min":2.0139999999999998,"15min":1.8620000000000001},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":16.498000000000001,"5min":26.085000000000001,"15min":111.134},"last":3.8690000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.7130000000000001,"5min":2.8999999999999999,"15min":2.5099999999999998},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.33300000000000002},"max":{"1min":21.686,"5min":34.137999999999998,"15min":72.697999999999993},"last":0.378},{"interface":"front","average":{"1min":4.7569999999999997,"5min":3.2829999999999999,"15min":3.1150000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":26.440999999999999,"5min":52.764000000000003,"15min":138.74100000000001},"last":5.7279999999999998}]},{"osd":5,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":2.637,"15min":2},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":9.3300000000000001,"5min":41.558,"15min":41.558},"last":3.7909999999999999},{"interface":"front","average":{"1min":4.0279999999999996,"5min":2.7149999999999999,"15min":2.165},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":21.745999999999999,"5min":21.745999999999999,"15min":71.340999999999994},"last":0.46100000000000002}]},{"osd":6,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":5.2930000000000001,"5min":2.7440000000000002,"15min":3.7429999999999999},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":46.985999999999997,"5min":46.985999999999997,"15min":289.625},"last":0.42699999999999999},{"interface":"front","average":{"1min":3.6459999999999999,"5min":2.8900000000000001,"15min":4.1399999999999997},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":14.343999999999999,"5min":23.260999999999999,"15min":289.608},"last":5.8070000000000004}]},{"osd":7,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2450000000000001,"5min":2.0680000000000001,"15min":1.9299999999999999},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":9.3629999999999995,"5min":28.573,"15min":33.892000000000003},"last":3.7519999999999998},{"interface":"front","average":{"1min":3.1560000000000001,"5min":2.7010000000000001,"15min":2.1200000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":13.920999999999999,"5min":19.215,"15min":41.015000000000001},"last":3.8319999999999999}]}]},{"osd":3,"up_from":14,"seq":60129542466,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1078144,"kb_used_data":86520,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293696,"statfs":{"total":96636764160,"available":95532744704,"internally_reserved":0,"allocated":88596480,"data_stored":88411635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.556,"15min":1.381},"min":{"1min":0.27000000000000002,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":14.048,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":1.0149999999999999,"5min":1.325,"15min":1.7569999999999999},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":6.827,"5min":22.594000000000001,"15min":119.66200000000001},"last":0.496}]},{"osd":1,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.7350000000000001,"5min":1.5509999999999999,"15min":1.3220000000000001},"min":{"1min":0.30599999999999999,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":18.273,"5min":25.995000000000001,"15min":26.573},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.671,"15min":1.6040000000000001},"min":{"1min":0.35399999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":14.1,"5min":32.93,"15min":32.93},"last":0.59399999999999997}]},{"osd":2,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.2090000000000001,"5min":1.5349999999999999,"15min":1.288},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":6.5730000000000004,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.325,"5min":1.3180000000000001,"15min":1.262},"min":{"1min":0.45900000000000002,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":14.214,"5min":17.420999999999999,"15min":29.568999999999999},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":4.2080000000000002,"5min":4.2729999999999997,"15min":3.948},"min":{"1min":0.40000000000000002,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":55.142000000000003,"5min":101.81399999999999,"15min":157.47},"last":0.61799999999999999},{"interface":"front","average":{"1min":2.9689999999999999,"5min":4.2169999999999996,"15min":3.4950000000000001},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40500000000000003},"max":{"1min":25.087,"5min":102.501,"15min":189.161},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":3.7050000000000001,"5min":2.4329999999999998,"15min":2.4540000000000002},"min":{"1min":0.51200000000000001,"5min":0.42799999999999999,"15min":0.40799999999999997},"max":{"1min":16.780000000000001,"5min":22.468,"15min":150.14500000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.7770000000000001,"15min":3.141},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":13.538,"5min":50.697000000000003,"15min":165.47},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":2.895,"5min":3.2250000000000001,"15min":2.9510000000000001},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.435},"max":{"1min":22.823,"5min":43.024999999999999,"15min":179.703},"last":0.88500000000000001},{"interface":"front","average":{"1min":2.8399999999999999,"5min":2.5190000000000001,"15min":2.6240000000000001},"min":{"1min":0.57199999999999995,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":14.167,"5min":27.515999999999998,"15min":135.15899999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri May 10 05:17:28 2024","interfaces":[{"interface":"back","average":{"1min":1.3069999999999999,"5min":2.0699999999999998,"15min":3.0369999999999999},"min":{"1min":0.54700000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":6.7800000000000002,"5min":15.85,"15min":148.93899999999999},"last":0.90300000000000002},{"interface":"front","average":{"1min":3.258,"5min":3.2130000000000001,"15min":3.1549999999999998},"min":{"1min":0.60899999999999999,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":22.765999999999998,"5min":59.588999999999999,"15min":215.81299999999999},"last":0.82499999999999996}]}]},{"osd":4,"up_from":14,"seq":60129542464,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":932936,"kb_used_data":53888,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93438904,"statfs":{"total":96636764160,"available":95681437696,"internally_reserved":0,"allocated":55181312,"data_stored":54991825,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":5.7800000000000002,"15min":5.9690000000000003},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":5.165,"5min":220.36600000000001,"15min":440.25299999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.645,"5min":3.5840000000000001,"15min":3.8069999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.31900000000000001},"max":{"1min":8.4920000000000009,"5min":94.004999999999995,"15min":397.101},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":4.2750000000000004,"15min":4.6559999999999997},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":8.5389999999999997,"5min":101.113,"15min":396.98899999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.752,"5min":2.7229999999999999,"15min":3.0760000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":8.2710000000000008,"5min":32.863,"15min":367.47399999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":5.6289999999999996,"15min":6.3410000000000002},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":9.8780000000000001,"5min":217.352,"15min":440.32400000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":1.827,"5min":3.3700000000000001,"15min":4.2469999999999999},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":8.5999999999999996,"5min":93.968999999999994,"15min":396.67700000000002},"last":0.78500000000000003}]},{"osd":3,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":3.3929999999999998,"15min":3.5059999999999998},"min":{"1min":0.54500000000000004,"5min":0.44800000000000001,"15min":0.41799999999999998},"max":{"1min":12.919,"5min":32.831000000000003,"15min":367.52499999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":2.895,"5min":6.1520000000000001,"15min":6.0720000000000001},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":10.57,"5min":223.80000000000001,"15min":440.197},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.0579999999999998,"5min":3.5830000000000002,"15min":4.4829999999999997},"min":{"1min":0.61099999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":8.5690000000000008,"5min":94.930999999999997,"15min":396.73599999999999},"last":0.627},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.8100000000000001,"15min":4.4009999999999998},"min":{"1min":0.52000000000000002,"5min":0.439,"15min":0.38},"max":{"1min":12.996,"5min":32.759999999999998,"15min":366.06},"last":0.60199999999999998}]},{"osd":6,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":4.891,"15min":6.5919999999999996},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.32100000000000001},"max":{"1min":30.117999999999999,"5min":132.136,"15min":440.358},"last":0.36699999999999999},{"interface":"front","average":{"1min":3.359,"5min":4.008,"15min":5.2110000000000003},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":11.356999999999999,"5min":95.834999999999994,"15min":400.21199999999999},"last":0.42599999999999999}]},{"osd":7,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":6.649,"5min":4.2000000000000002,"15min":3.3450000000000002},"min":{"1min":0.56899999999999995,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":45.661000000000001,"5min":45.661000000000001,"15min":121.637},"last":0.52600000000000002},{"interface":"front","average":{"1min":7.0890000000000004,"5min":5.1230000000000002,"15min":6.5670000000000002},"min":{"1min":0.56999999999999995,"5min":0.5,"15min":0.40600000000000003},"max":{"1min":60.430999999999997,"5min":132.084,"15min":440.291},"last":0.40000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542465,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":829488,"kb_used_data":50344,"kb_used_omap":1,"kb_used_meta":779134,"kb_avail":93542352,"statfs":{"total":96636764160,"available":95787368448,"internally_reserved":0,"allocated":51552256,"data_stored":51367260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":797833670},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":2.915,"15min":1.9750000000000001},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":13.369,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.73999999999999999},{"interface":"front","average":{"1min":2.4260000000000002,"5min":2.286,"15min":1.736},"min":{"1min":0.373,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":15.297000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.67000000000000004}]},{"osd":1,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.3599999999999999,"15min":1.7},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":16.277000000000001,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.6240000000000001,"15min":1.861},"min":{"1min":0.45000000000000001,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":16.321999999999999,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":2.4750000000000001,"15min":1.825},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":13.664999999999999,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":2.9119999999999999,"5min":3.266,"15min":2.2549999999999999},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":15.089,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6469999999999998,"5min":2.6589999999999998,"15min":1.9870000000000001},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.41199999999999998},"max":{"1min":16.359000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.71199999999999997},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6459999999999999,"15min":2.0390000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":13.775,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.77200000000000002}]},{"osd":4,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.1579999999999999,"5min":5.8890000000000002,"15min":4.2229999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":13.646000000000001,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.9860000000000002,"5min":3.4940000000000002,"15min":3.1560000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":22.885999999999999,"5min":55.484999999999999,"15min":174.684},"last":0.754}]},{"osd":6,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":3.7639999999999998,"15min":2.8769999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":28.108000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.58899999999999997},{"interface":"front","average":{"1min":3.5299999999999998,"5min":4.4050000000000002,"15min":3.4620000000000002},"min":{"1min":0.56100000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":16.550999999999998,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":6.6379999999999999,"5min":3.7829999999999999,"15min":2.6190000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.42999999999999999},"max":{"1min":80.727999999999994,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.64000000000000001},{"interface":"front","average":{"1min":8.5060000000000002,"5min":5.069,"15min":3.1259999999999999},"min":{"1min":0.53100000000000003,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":92.790999999999997,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.81999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332286,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51838976,"data_stored":51830699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49025024,"data_stored":49017353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92483584,"data_stored":92471622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3166208,"data_stored":3166208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2719744,"data_stored":2719744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1069056,"data_stored":1069056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":208896,"data_stored":208896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2228224,"data_stored":2228224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1667072,"data_stored":1667072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:18:28.059 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T05:18:28.363 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.363+0000 7f6f85400700 1 Processor -- start 2024-05-10T05:18:28.364 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.363+0000 7f6f85400700 1 -- start start 2024-05-10T05:18:28.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f85400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f6f80156d70 0x7f6f80157180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:28.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f85400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f801538c0 con 0x7f6f8014d430 2024-05-10T05:18:28.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f85400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f80153ba0 con 0x7f6f801533c0 2024-05-10T05:18:28.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f85400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800aa8c0 con 0x7f6f80156d70 2024-05-10T05:18:28.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f7de00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f6f8014d430 0x7f6f800c3350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37250/0 (socket says 172.21.15.47:37250) 2024-05-10T05:18:28.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f7de00700 1 -- 172.21.15.47:0/2079720938 learned_addr learned my addr 172.21.15.47:0/2079720938 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:28.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.365+0000 7f6f7f200700 1 --2- 172.21.15.47:0/2079720938 >> v2:172.21.15.47:3300/0 conn(0x7f6f80156d70 0x7f6f80157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:28.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7d400700 1 -- 172.21.15.47:0/2079720938 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765345654 0 0) 0x7f6f801538c0 con 0x7f6f8014d430 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7d400700 1 -- 172.21.15.47:0/2079720938 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f640035b0 con 0x7f6f8014d430 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7f200700 1 -- 172.21.15.47:0/2079720938 >> v1:172.21.15.117:6789/0 conn(0x7f6f801533c0 legacy=0x7f6f800aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7f200700 1 -- 172.21.15.47:0/2079720938 >> v1:172.21.15.47:6789/0 conn(0x7f6f8014d430 legacy=0x7f6f800c3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7f200700 1 -- 172.21.15.47:0/2079720938 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80153e80 con 0x7f6f80156d70 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7f200700 1 --2- 172.21.15.47:0/2079720938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f80156d70 0x7f6f80157180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009d90 tx=0x7f6f7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99563e0674adaa35 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7d400700 1 -- 172.21.15.47:0/2079720938 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800e070 con 0x7f6f80156d70 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7d400700 1 -- 172.21.15.47:0/2079720938 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800bb20 con 0x7f6f80156d70 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.366+0000 7f6f7d400700 1 -- 172.21.15.47:0/2079720938 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78012430 con 0x7f6f80156d70 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 -- 172.21.15.47:0/2079720938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f80156d70 msgr2=0x7f6f80157180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 --2- 172.21.15.47:0/2079720938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f80156d70 0x7f6f80157180 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009d90 tx=0x7f6f7800b330 comp rx=0 tx=0).stop 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 -- 172.21.15.47:0/2079720938 shutdown_connections 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 --2- 172.21.15.47:0/2079720938 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f80156d70 0x7f6f80157180 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 -- 172.21.15.47:0/2079720938 >> 172.21.15.47:0/2079720938 conn(0x7f6f8006ae30 msgr2=0x7f6f8006b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:28.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 -- 172.21.15.47:0/2079720938 shutdown_connections 2024-05-10T05:18:28.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.367+0000 7f6f85400700 1 -- 172.21.15.47:0/2079720938 wait complete. 2024-05-10T05:18:28.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.369+0000 7f6f85400700 1 Processor -- start 2024-05-10T05:18:28.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.369+0000 7f6f85400700 1 -- start start 2024-05-10T05:18:28.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f85400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f8014d430 0x7f6f80154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:28.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f85400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 0x7f6f80142de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:28.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f85400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f80156d70 0x7f6f80143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f85400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80149030 con 0x7f6f801533c0 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f85400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80143860 con 0x7f6f8014d430 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f85400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80148b60 con 0x7f6f80156d70 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 0x7f6f80142de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 0x7f6f80142de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55890/0 (socket says 172.21.15.47:55890) 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 -- 172.21.15.47:0/2456741624 learned_addr learned my addr 172.21.15.47:0/2456741624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7e800700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f8014d430 0x7f6f80154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7f200700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f80156d70 0x7f6f80143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 -- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f80156d70 msgr2=0x7f6f80143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f80156d70 0x7f6f80143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 -- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f8014d430 msgr2=0x7f6f80154ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f8014d430 0x7f6f80154ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7de00700 1 -- 172.21.15.47:0/2456741624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f78009a70 con 0x7f6f801533c0 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.371+0000 7f6f7f200700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f80156d70 0x7f6f80143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T05:18:28.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f7e800700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f8014d430 0x7f6f80154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f7de00700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 0x7f6f80142de0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c001eb0 tx=0x7f6f6c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c005d70 con 0x7f6f801533c0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c0070d0 con 0x7f6f801533c0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c007460 con 0x7f6f801533c0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f800721b0 con 0x7f6f801533c0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.372+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f80072450 con 0x7f6f801533c0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.373+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f80074720 con 0x7f6f801533c0 2024-05-10T05:18:28.374 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.374+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f6c0075c0 con 0x7f6f801533c0 2024-05-10T05:18:28.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.376+0000 7f6f76a00700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6f6006ac90 0x7f6f6006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:28.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.376+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f6c088cc0 con 0x7f6f801533c0 2024-05-10T05:18:28.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.376+0000 7f6f7e800700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6f6006ac90 0x7f6f6006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:28.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.377+0000 7f6f7e800700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6f6006ac90 0x7f6f6006d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000f60 tx=0x7f6f70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:28.381 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.381+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f6f6c08f080 con 0x7f6f801533c0 2024-05-10T05:18:28.599 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.599+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f800c1580 con 0x7f6f801533c0 2024-05-10T05:18:28.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.600+0000 7f6f76a00700 1 -- 172.21.15.47:0/2456741624 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f6f6c017090 con 0x7f6f801533c0 2024-05-10T05:18:28.601 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:28.601 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:52:40.317170+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6f6006ac90 msgr2=0x7f6f6006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6f6006ac90 0x7f6f6006d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6f70000f60 tx=0x7f6f70009040 comp rx=0 tx=0).stop 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 msgr2=0x7f6f80142de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 0x7f6f80142de0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c001eb0 tx=0x7f6f6c00c860 comp rx=0 tx=0).stop 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 shutdown_connections 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f6f6006ac90 0x7f6f6006d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f6f80156d70 0x7f6f80143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.603 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f6f8014d430 0x7f6f80154ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 --2- 172.21.15.47:0/2456741624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f6f801533c0 0x7f6f80142de0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:28.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.602+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 >> 172.21.15.47:0/2456741624 conn(0x7f6f8006ae30 msgr2=0x7f6f800c1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:28.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.603+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 shutdown_connections 2024-05-10T05:18:28.604 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:28.603+0000 7f6f85400700 1 -- 172.21.15.47:0/2456741624 wait complete. 2024-05-10T05:18:29.634 INFO:tasks.ceph:Scrubbing osd.0 2024-05-10T05:18:29.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:29.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.936+0000 7f1179200700 1 Processor -- start 2024-05-10T05:18:29.936 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.936+0000 7f1179200700 1 -- start start 2024-05-10T05:18:29.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1179200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11740ca8e0 0x7f11740cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1179200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740c3780 0x7f11740c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1179200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11740c62b0 con 0x7f1174152bc0 2024-05-10T05:18:29.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1179200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11740c56a0 con 0x7f11740ca8e0 2024-05-10T05:18:29.938 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1179200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11740c5980 con 0x7f11740c3780 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1171400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11740ca8e0 0x7f11740cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1172800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740c3780 0x7f11740c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1171400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f11740ca8e0 0x7f11740cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:55210/0 (socket says 172.21.15.47:55210) 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.938+0000 7f1171400700 1 -- 172.21.15.47:0/252575999 learned_addr learned my addr 172.21.15.47:0/252575999 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.939+0000 7f1171400700 1 -- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740c3780 msgr2=0x7f11740c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.939+0000 7f1171400700 1 --2- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740c3780 0x7f11740c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.939+0000 7f1171400700 1 -- 172.21.15.47:0/252575999 >> v1:172.21.15.117:6789/0 conn(0x7f1174152bc0 legacy=0x7f1174155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.939+0000 7f1171400700 1 -- 172.21.15.47:0/252575999 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740c5c60 con 0x7f11740ca8e0 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.939+0000 7f1172800700 1 --2- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740c3780 0x7f11740c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.939+0000 7f1171400700 1 --2- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11740ca8e0 0x7f11740cacf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11600098f0 tx=0x7f1160009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b17f81ef8e5be0fd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1170a00700 1 -- 172.21.15.47:0/252575999 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160011830 con 0x7f11740ca8e0 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1170a00700 1 -- 172.21.15.47:0/252575999 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1160011990 con 0x7f11740ca8e0 2024-05-10T05:18:29.940 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1170a00700 1 -- 172.21.15.47:0/252575999 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160011d20 con 0x7f11740ca8e0 2024-05-10T05:18:29.941 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1179200700 1 -- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11740ca8e0 msgr2=0x7f11740cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1179200700 1 --2- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11740ca8e0 0x7f11740cacf0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f11600098f0 tx=0x7f1160009c00 comp rx=0 tx=0).stop 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1179200700 1 -- 172.21.15.47:0/252575999 shutdown_connections 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1179200700 1 --2- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740c3780 0x7f11740c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1179200700 1 --2- 172.21.15.47:0/252575999 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f11740ca8e0 0x7f11740cacf0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.940+0000 7f1179200700 1 -- 172.21.15.47:0/252575999 >> 172.21.15.47:0/252575999 conn(0x7f11740c7610 msgr2=0x7f11740c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.941+0000 7f1179200700 1 -- 172.21.15.47:0/252575999 shutdown_connections 2024-05-10T05:18:29.942 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.941+0000 7f1179200700 1 -- 172.21.15.47:0/252575999 wait complete. 2024-05-10T05:18:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.943+0000 7f1179200700 1 Processor -- start 2024-05-10T05:18:29.943 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.943+0000 7f1179200700 1 -- start start 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.944+0000 7f1179200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11740c3780 0x7f1174149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.944+0000 7f1179200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740ca8e0 0x7f11741571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.944+0000 7f1179200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1174152bc0 0x7f11741ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.944+0000 7f1179200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11741f0130 con 0x7f11740c3780 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.944+0000 7f1179200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1174155ac0 con 0x7f1174152bc0 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.944+0000 7f1179200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1174157df0 con 0x7f11740ca8e0 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11740c3780 0x7f1174149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11740c3780 0x7f1174149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55892/0 (socket says 172.21.15.47:55892) 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 -- 172.21.15.47:0/2749333563 learned_addr learned my addr 172.21.15.47:0/2749333563 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1172800700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1174152bc0 0x7f11741ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171400700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740ca8e0 0x7f11741571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.946 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 -- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740ca8e0 msgr2=0x7f11741571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f11740ca8e0 0x7f11741571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 -- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1174152bc0 msgr2=0x7f11741ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1174152bc0 0x7f11741ef580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1171e00700 1 -- 172.21.15.47:0/2749333563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f116c009a70 con 0x7f11740c3780 2024-05-10T05:18:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.945+0000 7f1172800700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1174152bc0 0x7f11741ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:29.947 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.946+0000 7f1171e00700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11740c3780 0x7f1174149a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f116400c450 tx=0x7f116400c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.946+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11640052d0 con 0x7f11740c3780 2024-05-10T05:18:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.946+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1164005430 con 0x7f11740c3780 2024-05-10T05:18:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.946+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1160009550 con 0x7f11740c3780 2024-05-10T05:18:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.946+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11640038c0 con 0x7f11740c3780 2024-05-10T05:18:29.948 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.946+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1174153250 con 0x7f11740c3780 2024-05-10T05:18:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.947+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11740c8b80 con 0x7f11740c3780 2024-05-10T05:18:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.948+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1164003a20 con 0x7f11740c3780 2024-05-10T05:18:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.949+0000 7f116a000700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f115406ac90 0x7f115406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.949 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.949+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f11640891b0 con 0x7f11740c3780 2024-05-10T05:18:29.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.949+0000 7f116a000700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f11540745c0 0x7f1154076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:29.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.949+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 --> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1154077180 con 0x7f11540745c0 2024-05-10T05:18:29.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.949+0000 7f1171400700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f115406ac90 0x7f115406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.949+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1164089520 con 0x7f11740c3780 2024-05-10T05:18:29.950 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.950+0000 7f1172800700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f11540745c0 0x7f1154076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:29.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.950+0000 7f1171400700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f115406ac90 0x7f115406d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11740b02d0 tx=0x7f1160008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:29.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.950+0000 7f1172800700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f11540745c0 0x7f1154076ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:29.951 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.951+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== osd.0 v2:172.21.15.47:6808/43823 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f1154077180 con 0x7f11540745c0 2024-05-10T05:18:29.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 --> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f11740c5330 con 0x7f11540745c0 2024-05-10T05:18:29.967 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f116a000700 1 -- 172.21.15.47:0/2749333563 <== osd.0 v2:172.21.15.47:6808/43823 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f116c00f040 con 0x7f11540745c0 2024-05-10T05:18:29.967 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:29.968 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:29.968 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f11540745c0 msgr2=0x7f1154076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:6808/43823,v1:172.21.15.47:6809/43823] conn(0x7f11540745c0 0x7f1154076ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f115406ac90 msgr2=0x7f115406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f115406ac90 0x7f115406d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11740b02d0 tx=0x7f1160008030 comp rx=0 tx=0).stop 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11740c3780 msgr2=0x7f1174149a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.967+0000 7f1179200700 1 --2- 172.21.15.47:0/2749333563 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f11740c3780 0x7f1174149a00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f116400c450 tx=0x7f116400c760 comp rx=0 tx=0).stop 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.968+0000 7f1172800700 1 -- 172.21.15.47:0/2749333563 reap_dead start 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.968+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 shutdown_connections 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.968+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 >> 172.21.15.47:0/2749333563 conn(0x7f11740c7610 msgr2=0x7f11740c4510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:29.969 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.968+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 shutdown_connections 2024-05-10T05:18:29.970 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:29.968+0000 7f1179200700 1 -- 172.21.15.47:0/2749333563 wait complete. 2024-05-10T05:18:29.995 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-10T05:18:30.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.266+0000 7f5994600700 1 Processor -- start 2024-05-10T05:18:30.266 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.266+0000 7f5994600700 1 -- start start 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.267+0000 7f5994600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f598c155590 0x7f598c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.267+0000 7f5994600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f598c155ee0 0x7f598c15fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.267+0000 7f5994600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f598c0c8290 con 0x7f598c0c7020 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.267+0000 7f5994600700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c1562f0 con 0x7f598c155590 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.267+0000 7f5994600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f598c0c79a0 con 0x7f598c155ee0 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f598c155590 0x7f598c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f598c155590 0x7f598c1559a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55900/0 (socket says 172.21.15.47:55900) 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 -- 172.21.15.47:0/1516940955 learned_addr learned my addr 172.21.15.47:0/1516940955 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991c00700 1 --1- 172.21.15.47:0/1516940955 >> v1:172.21.15.47:6789/0 conn(0x7f598c0c7020 0x7f598c0c4fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37252/0 (socket says 172.21.15.47:37252) 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5992600700 1 --2- 172.21.15.47:0/1516940955 >> v2:172.21.15.117:3300/0 conn(0x7f598c155ee0 0x7f598c15fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f598be00700 1 -- 172.21.15.47:0/1516940955 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603648008 0 0) 0x7f598c0c8290 con 0x7f598c0c7020 2024-05-10T05:18:30.269 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f598be00700 1 -- 172.21.15.47:0/1516940955 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59740035b0 con 0x7f598c0c7020 2024-05-10T05:18:30.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 -- 172.21.15.47:0/1516940955 >> v2:172.21.15.117:3300/0 conn(0x7f598c155ee0 msgr2=0x7f598c15fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:30.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 --2- 172.21.15.47:0/1516940955 >> v2:172.21.15.117:3300/0 conn(0x7f598c155ee0 0x7f598c15fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 -- 172.21.15.47:0/1516940955 >> v1:172.21.15.47:6789/0 conn(0x7f598c0c7020 legacy=0x7f598c0c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5991200700 1 -- 172.21.15.47:0/1516940955 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598c0c6760 con 0x7f598c155590 2024-05-10T05:18:30.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.268+0000 7f5992600700 1 --2- 172.21.15.47:0/1516940955 >> v2:172.21.15.117:3300/0 conn(0x7f598c155ee0 0x7f598c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:30.270 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.269+0000 7f5991200700 1 --2- 172.21.15.47:0/1516940955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c1559a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f598c0bc220 tx=0x7f5978009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f761b79c8337f8a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.269+0000 7f598be00700 1 -- 172.21.15.47:0/1516940955 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978011830 con 0x7f598c155590 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.269+0000 7f598be00700 1 -- 172.21.15.47:0/1516940955 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978011990 con 0x7f598c155590 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.269+0000 7f598be00700 1 -- 172.21.15.47:0/1516940955 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978011d20 con 0x7f598c155590 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.269+0000 7f5994600700 1 -- 172.21.15.47:0/1516940955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 msgr2=0x7f598c1559a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.269+0000 7f5994600700 1 --2- 172.21.15.47:0/1516940955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c1559a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f598c0bc220 tx=0x7f5978009bd0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.270+0000 7f5994600700 1 -- 172.21.15.47:0/1516940955 shutdown_connections 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.270+0000 7f5994600700 1 --2- 172.21.15.47:0/1516940955 >> v2:172.21.15.117:3300/0 conn(0x7f598c155ee0 0x7f598c15fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.270+0000 7f5994600700 1 --2- 172.21.15.47:0/1516940955 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c1559a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.271 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.270+0000 7f5994600700 1 -- 172.21.15.47:0/1516940955 >> 172.21.15.47:0/1516940955 conn(0x7f598c0aa2d0 msgr2=0x7f598c0aa6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:30.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.270+0000 7f5994600700 1 -- 172.21.15.47:0/1516940955 shutdown_connections 2024-05-10T05:18:30.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.270+0000 7f5994600700 1 -- 172.21.15.47:0/1516940955 wait complete. 2024-05-10T05:18:30.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.272+0000 7f5994600700 1 Processor -- start 2024-05-10T05:18:30.272 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.272+0000 7f5994600700 1 -- start start 2024-05-10T05:18:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.273+0000 7f5994600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f598c0c7020 0x7f598c1ebd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.273+0000 7f5994600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.273+0000 7f5994600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f598c155ee0 0x7f598c1dc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.275 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.273+0000 7f5994600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c1ecc10 con 0x7f598c155590 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.273+0000 7f5994600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598c1dbd60 con 0x7f598c0c7020 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.273+0000 7f5994600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598c1ec780 con 0x7f598c155ee0 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c0aca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55906/0 (socket says 172.21.15.47:55906) 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 -- 172.21.15.47:0/3740826013 learned_addr learned my addr 172.21.15.47:0/3740826013 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991c00700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f598c0c7020 0x7f598c1ebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5992600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f598c155ee0 0x7f598c1dc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 -- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f598c155ee0 msgr2=0x7f598c1dc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f598c155ee0 0x7f598c1dc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 -- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f598c0c7020 msgr2=0x7f598c1ebd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f598c0c7020 0x7f598c1ebd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991200700 1 -- 172.21.15.47:0/3740826013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5978009550 con 0x7f598c155590 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5992600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f598c155ee0 0x7f598c1dc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.274+0000 7f5991c00700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f598c0c7020 0x7f598c1ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:30.276 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.275+0000 7f5991200700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c0aca60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5978009c10 tx=0x7f5978004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.275+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59780036a0 con 0x7f598c155590 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.275+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f597801e070 con 0x7f598c155590 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.275+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598c151de0 con 0x7f598c155590 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.275+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978003a60 con 0x7f598c155590 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.275+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f598c0bc6d0 con 0x7f598c155590 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.276+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f598c0c6990 con 0x7f598c155590 2024-05-10T05:18:30.277 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.277+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5978003bc0 con 0x7f598c155590 2024-05-10T05:18:30.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.278+0000 7f5989600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f596c06acc0 0x7f596c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.278 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.278+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f597808a5e0 con 0x7f598c155590 2024-05-10T05:18:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.279+0000 7f5991c00700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f596c06acc0 0x7f596c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.279 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.279+0000 7f5991c00700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f596c06acc0 0x7f596c06d1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59800011e0 tx=0x7f5980007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.283 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.283+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f5978055490 con 0x7f598c155590 2024-05-10T05:18:30.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.496+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f598c0c39f0 con 0x7f596c06acc0 2024-05-10T05:18:30.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.497+0000 7f5989600700 1 -- 172.21.15.47:0/3740826013 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f598c0c39f0 con 0x7f596c06acc0 2024-05-10T05:18:30.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.499+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f596c06acc0 msgr2=0x7f596c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.499+0000 7f5994600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f596c06acc0 0x7f596c06d1d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f59800011e0 tx=0x7f5980007ca0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 msgr2=0x7f598c0aca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c0aca60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5978009c10 tx=0x7f5978004750 comp rx=0 tx=0).stop 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 shutdown_connections 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f596c06acc0 0x7f596c06d1d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f598c155ee0 0x7f598c1dc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f598c0c7020 0x7f598c1ebd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 --2- 172.21.15.47:0/3740826013 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f598c155590 0x7f598c0aca60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 >> 172.21.15.47:0/3740826013 conn(0x7f598c0aa2d0 msgr2=0x7f598c154c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 shutdown_connections 2024-05-10T05:18:30.501 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.500+0000 7f5994600700 1 -- 172.21.15.47:0/3740826013 wait complete. 2024-05-10T05:18:30.502 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 0 to deep-scrub 2024-05-10T05:18:30.528 INFO:tasks.ceph:Scrubbing osd.1 2024-05-10T05:18:30.529 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.803+0000 7fda0b200700 1 Processor -- start 2024-05-10T05:18:30.803 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.803+0000 7fda0b200700 1 -- start start 2024-05-10T05:18:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.804+0000 7fda0b200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fda0c0c59c0 0x7fda0c0ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.806 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.804+0000 7fda0b200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c155440 con 0x7fda0c1529a0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.804+0000 7fda0b200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda0c152db0 con 0x7fda0c1558d0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.804+0000 7fda0b200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda0c0c6280 con 0x7fda0c0c59c0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda09400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fda0c1529a0 0x7fda0c0c8ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:37256/0 (socket says 172.21.15.47:37256) 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda09400700 1 -- 172.21.15.47:0/4286400315 learned_addr learned my addr 172.21.15.47:0/4286400315 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda09e00700 1 --2- 172.21.15.47:0/4286400315 >> v2:172.21.15.117:3300/0 conn(0x7fda0c0c59c0 0x7fda0c0ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699538986 0 0) 0x7fda0c155440 con 0x7fda0c1529a0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9f00035b0 con 0x7fda0c1529a0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639274351 0 0) 0x7fda0c152db0 con 0x7fda0c1558d0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.805+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c155440 con 0x7fda0c1558d0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda09e00700 1 -- 172.21.15.47:0/4286400315 >> v1:172.21.15.117:6789/0 conn(0x7fda0c1558d0 legacy=0x7fda0c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda09e00700 1 -- 172.21.15.47:0/4286400315 >> v1:172.21.15.47:6789/0 conn(0x7fda0c1529a0 legacy=0x7fda0c0c8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 260607786 0 0) 0x7fd9f00035b0 con 0x7fda0c1529a0 2024-05-10T05:18:30.807 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda09e00700 1 -- 172.21.15.47:0/4286400315 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0c70a0 con 0x7fda0c0c59c0 2024-05-10T05:18:30.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda09e00700 1 --2- 172.21.15.47:0/4286400315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c0ca100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009840 tx=0x7fd9fc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b4bb788e2cfef51 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8001670 con 0x7fda0c0c59c0 2024-05-10T05:18:30.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9fc004030 con 0x7fda0c0c59c0 2024-05-10T05:18:30.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.806+0000 7fda08a00700 1 -- 172.21.15.47:0/4286400315 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0043c0 con 0x7fda0c0c59c0 2024-05-10T05:18:30.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 -- 172.21.15.47:0/4286400315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 msgr2=0x7fda0c0ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 --2- 172.21.15.47:0/4286400315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c0ca100 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009840 tx=0x7fd9fc009b50 comp rx=0 tx=0).stop 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 -- 172.21.15.47:0/4286400315 shutdown_connections 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 --2- 172.21.15.47:0/4286400315 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c0ca100 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 -- 172.21.15.47:0/4286400315 >> 172.21.15.47:0/4286400315 conn(0x7fda0c0ac4a0 msgr2=0x7fda0c0ac8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 -- 172.21.15.47:0/4286400315 shutdown_connections 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.807+0000 7fda0b200700 1 -- 172.21.15.47:0/4286400315 wait complete. 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.809+0000 7fda0b200700 1 Processor -- start 2024-05-10T05:18:30.809 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.809+0000 7fda0b200700 1 -- start start 2024-05-10T05:18:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0b200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0b200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0c1529a0 0x7fda0c1e0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.812 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0b200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda0c1558d0 0x7fda0c14d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0b200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1e1460 con 0x7fda0c1558d0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0b200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c0c4570 con 0x7fda0c0c59c0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0b200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c1eb840 con 0x7fda0c1529a0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda0c1558d0 0x7fda0c14d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0a800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda0c1558d0 0x7fda0c14d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55920/0 (socket says 172.21.15.47:55920) 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda0a800700 1 -- 172.21.15.47:0/3781307188 learned_addr learned my addr 172.21.15.47:0/3781307188 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda09e00700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.811+0000 7fda09400700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0c1529a0 0x7fda0c1e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0a800700 1 -- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0c1529a0 msgr2=0x7fda0c1e0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0a800700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0c1529a0 0x7fda0c1e0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0a800700 1 -- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 msgr2=0x7fda0c154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0a800700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0a800700 1 -- 172.21.15.47:0/3781307188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0094a0 con 0x7fda0c1558d0 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda09400700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fda0c1529a0 0x7fda0c1e0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T05:18:30.813 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda09e00700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fda0c0c59c0 0x7fda0c154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0a800700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda0c1558d0 0x7fda0c14d200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fda0400cbc0 tx=0x7fda0400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04003c00 con 0x7fda0c1558d0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda04003d60 con 0x7fda0c1558d0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400ab50 con 0x7fda0c1558d0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c1ebcd0 con 0x7fda0c1558d0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.812+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0c0c47c0 con 0x7fda0c1558d0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.813+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fda0c0c7940 con 0x7fda0c1558d0 2024-05-10T05:18:30.814 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.814+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda0400acb0 con 0x7fda0c1558d0 2024-05-10T05:18:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.815+0000 7fda02000700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd9ec06ac90 0x7fd9ec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.815+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda040898d0 con 0x7fda0c1558d0 2024-05-10T05:18:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda02000700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7fd9ec0745c0 0x7fd9ec076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 --> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd9ec077180 con 0x7fd9ec0745c0 2024-05-10T05:18:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda0408e2a0 con 0x7fda0c1558d0 2024-05-10T05:18:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda09e00700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd9ec06ac90 0x7fd9ec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.816 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda09400700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7fd9ec0745c0 0x7fd9ec076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:30.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda09400700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7fd9ec0745c0 0x7fd9ec076ab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.816+0000 7fda09e00700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd9ec06ac90 0x7fd9ec06d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009840 tx=0x7fd9fc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:30.817 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.817+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== osd.1 v2:172.21.15.47:6816/43821 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fd9ec077180 con 0x7fd9ec0745c0 2024-05-10T05:18:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 --> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fda0c0c7660 con 0x7fd9ec0745c0 2024-05-10T05:18:30.833 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda02000700 1 -- 172.21.15.47:0/3781307188 <== osd.1 v2:172.21.15.47:6816/43821 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd9f8001870 con 0x7fd9ec0745c0 2024-05-10T05:18:30.833 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:30.834 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:30.834 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7fd9ec0745c0 msgr2=0x7fd9ec076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:6816/43821,v1:172.21.15.47:6817/43821] conn(0x7fd9ec0745c0 0x7fd9ec076ab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd9ec06ac90 msgr2=0x7fd9ec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd9ec06ac90 0x7fd9ec06d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009840 tx=0x7fd9fc008030 comp rx=0 tx=0).stop 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda0c1558d0 msgr2=0x7fda0c14d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0b200700 1 --2- 172.21.15.47:0/3781307188 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fda0c1558d0 0x7fda0c14d200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fda0400cbc0 tx=0x7fda0400cf80 comp rx=0 tx=0).stop 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.833+0000 7fda0a800700 1 -- 172.21.15.47:0/3781307188 reap_dead start 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.834+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 shutdown_connections 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.834+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 >> 172.21.15.47:0/3781307188 conn(0x7fda0c0ac4a0 msgr2=0x7fda0c0c8ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.834+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 shutdown_connections 2024-05-10T05:18:30.835 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:30.834+0000 7fda0b200700 1 -- 172.21.15.47:0/3781307188 wait complete. 2024-05-10T05:18:30.858 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-10T05:18:31.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.129+0000 7fd667a00700 1 Processor -- start 2024-05-10T05:18:31.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.130+0000 7fd667a00700 1 -- start start 2024-05-10T05:18:31.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.131+0000 7fd667a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 0x7fd6600c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.131+0000 7fd667a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd66006bdb0 0x7fd66006c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.131+0000 7fd667a00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66006d640 con 0x7fd6600c6cc0 2024-05-10T05:18:31.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.131+0000 7fd667a00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd660152fc0 con 0x7fd66006bdb0 2024-05-10T05:18:31.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.131+0000 7fd667a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c9800 con 0x7fd660152bb0 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd665a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd66006bdb0 0x7fd66006c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd65fe00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 0x7fd6600c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd665a00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fd66006bdb0 0x7fd66006c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:46442/0 (socket says 172.21.15.47:46442) 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd65fe00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 0x7fd6600c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3301/0 says I am v2:172.21.15.47:57366/0 (socket says 172.21.15.47:57366) 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd665a00700 1 -- 172.21.15.47:0/3005869105 learned_addr learned my addr 172.21.15.47:0/3005869105 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd665a00700 1 -- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 msgr2=0x7fd6600c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd665a00700 1 --2- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 0x7fd6600c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.132+0000 7fd665a00700 1 -- 172.21.15.47:0/3005869105 >> v1:172.21.15.117:6789/0 conn(0x7fd6600c6cc0 legacy=0x7fd6600c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd665a00700 1 -- 172.21.15.47:0/3005869105 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66006c700 con 0x7fd66006bdb0 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd65fe00700 1 --2- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 0x7fd6600c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:31.133 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd65f400700 1 -- 172.21.15.47:0/3005869105 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754193127 0 0) 0x7fd66006d640 con 0x7fd6600c6cc0 2024-05-10T05:18:31.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd665a00700 1 --2- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd66006bdb0 0x7fd66006c1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd658009e50 tx=0x7fd65800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79561a46a257b23b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd65f400700 1 -- 172.21.15.47:0/3005869105 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800e070 con 0x7fd66006bdb0 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd65f400700 1 -- 172.21.15.47:0/3005869105 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd65800b910 con 0x7fd66006bdb0 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.133+0000 7fd65f400700 1 -- 172.21.15.47:0/3005869105 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800bcc0 con 0x7fd66006bdb0 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 -- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd66006bdb0 msgr2=0x7fd66006c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 --2- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd66006bdb0 0x7fd66006c1c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd658009e50 tx=0x7fd65800b330 comp rx=0 tx=0).stop 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 -- 172.21.15.47:0/3005869105 shutdown_connections 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 --2- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd66006bdb0 0x7fd66006c1c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 --2- 172.21.15.47:0/3005869105 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd660152bb0 0x7fd6600c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 -- 172.21.15.47:0/3005869105 >> 172.21.15.47:0/3005869105 conn(0x7fd6600ca960 msgr2=0x7fd6600cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 -- 172.21.15.47:0/3005869105 shutdown_connections 2024-05-10T05:18:31.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.134+0000 7fd667a00700 1 -- 172.21.15.47:0/3005869105 wait complete. 2024-05-10T05:18:31.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.137+0000 7fd667a00700 1 Processor -- start 2024-05-10T05:18:31.137 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.137+0000 7fd667a00700 1 -- start start 2024-05-10T05:18:31.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd667a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 0x7fd6601493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd667a00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6600c6cc0 0x7fd66014b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd667a00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd660152bb0 0x7fd6601e7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd667a00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd660155980 con 0x7fd66006bdb0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd667a00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601eac80 con 0x7fd660152bb0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd667a00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601556d0 con 0x7fd6600c6cc0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 0x7fd6601493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 0x7fd6601493c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55950/0 (socket says 172.21.15.47:55950) 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 -- 172.21.15.47:0/2776278023 learned_addr learned my addr 172.21.15.47:0/2776278023 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd660152bb0 0x7fd6601e7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd65fe00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6600c6cc0 0x7fd66014b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 -- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6600c6cc0 msgr2=0x7fd66014b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6600c6cc0 0x7fd66014b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 -- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd660152bb0 msgr2=0x7fd6601e7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd660152bb0 0x7fd6601e7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.139+0000 7fd665000700 1 -- 172.21.15.47:0/2776278023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0094a0 con 0x7fd66006bdb0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd665a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd660152bb0 0x7fd6601e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd665000700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 0x7fd6601493c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c550 tx=0x7fd65400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6540054e0 con 0x7fd66006bdb0 2024-05-10T05:18:31.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd658009b30 con 0x7fd66006bdb0 2024-05-10T05:18:31.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd654003680 con 0x7fd66006bdb0 2024-05-10T05:18:31.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd654003a30 con 0x7fd66006bdb0 2024-05-10T05:18:31.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.140+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66014d640 con 0x7fd66006bdb0 2024-05-10T05:18:31.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.141+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd660074720 con 0x7fd66006bdb0 2024-05-10T05:18:31.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.142+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd654003b90 con 0x7fd66006bdb0 2024-05-10T05:18:31.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.143+0000 7fd65cc00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd64006ac90 0x7fd64006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.143+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd654088d70 con 0x7fd66006bdb0 2024-05-10T05:18:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.144+0000 7fd65fe00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd64006ac90 0x7fd64006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.145+0000 7fd65fe00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd64006ac90 0x7fd64006d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd660151a50 tx=0x7fd64c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.148+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fd6540539e0 con 0x7fd66006bdb0 2024-05-10T05:18:31.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.364+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd660159800 con 0x7fd64006ac90 2024-05-10T05:18:31.365 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.365+0000 7fd65cc00700 1 -- 172.21.15.47:0/2776278023 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd64c011830 con 0x7fd64006ac90 2024-05-10T05:18:31.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd64006ac90 msgr2=0x7fd64006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd64006ac90 0x7fd64006d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd660151a50 tx=0x7fd64c008040 comp rx=0 tx=0).stop 2024-05-10T05:18:31.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 msgr2=0x7fd6601493c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.368 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 0x7fd6601493c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd65400c550 tx=0x7fd65400c910 comp rx=0 tx=0).stop 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 shutdown_connections 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fd660152bb0 0x7fd6601e7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fd66006bdb0 0x7fd6601493c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fd64006ac90 0x7fd64006d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 --2- 172.21.15.47:0/2776278023 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fd6600c6cc0 0x7fd66014b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 >> 172.21.15.47:0/2776278023 conn(0x7fd6600ca960 msgr2=0x7fd660151ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 shutdown_connections 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.368+0000 7fd667a00700 1 -- 172.21.15.47:0/2776278023 wait complete. 2024-05-10T05:18:31.369 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 1 to deep-scrub 2024-05-10T05:18:31.393 INFO:tasks.ceph:Scrubbing osd.2 2024-05-10T05:18:31.393 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:31.666 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.666+0000 7f15efa00700 1 Processor -- start 2024-05-10T05:18:31.667 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.666+0000 7f15efa00700 1 -- start start 2024-05-10T05:18:31.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15efa00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15e8152ce0 0x7f15e81594e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15efa00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8072f60 con 0x7f15e806abf0 2024-05-10T05:18:31.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15efa00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8072390 con 0x7f15e8156100 2024-05-10T05:18:31.668 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15efa00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e80c2de0 con 0x7f15e8152ce0 2024-05-10T05:18:31.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15e7e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f15e806abf0 0x7f15e81559f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42812/0 (socket says 172.21.15.47:42812) 2024-05-10T05:18:31.669 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15e7e00700 1 -- 172.21.15.47:0/289934998 learned_addr learned my addr 172.21.15.47:0/289934998 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.668+0000 7f15ed000700 1 --2- 172.21.15.47:0/289934998 >> v2:172.21.15.117:3300/0 conn(0x7f15e8152ce0 0x7f15e81594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271042834 0 0) 0x7f15e8072f60 con 0x7f15e806abf0 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15d00035b0 con 0x7f15e806abf0 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2022842974 0 0) 0x7f15d00035b0 con 0x7f15e806abf0 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 >> v2:172.21.15.117:3300/0 conn(0x7f15e8152ce0 msgr2=0x7f15e81594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 --2- 172.21.15.47:0/289934998 >> v2:172.21.15.117:3300/0 conn(0x7f15e8152ce0 0x7f15e81594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 >> v1:172.21.15.117:6789/0 conn(0x7f15e8156100 legacy=0x7f15e815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8155530 con 0x7f15e806abf0 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7f15d4001670 con 0x7f15e806abf0 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 >> v1:172.21.15.47:6789/0 conn(0x7f15e806abf0 legacy=0x7f15e81559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.673 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d0003a00 0x7f15d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15d0004850 0x7f15d0004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d00053a0 0x7f15d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e80c2de0 con 0x7f15d0003a00 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d000c2d0 con 0x7f15d0004850 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d000c490 con 0x7f15d00053a0 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.669+0000 7f15ed000700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d0003a00 0x7f15d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15e7e00700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15d0004850 0x7f15d0004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15eda00700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d00053a0 0x7f15d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15ed000700 1 -- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d00053a0 msgr2=0x7f15d000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15ed000700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d00053a0 0x7f15d000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15ed000700 1 -- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15d0004850 msgr2=0x7f15d0004c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15ed000700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15d0004850 0x7f15d0004c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15ed000700 1 -- 172.21.15.47:0/289934998 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d00035b0 con 0x7f15d0003a00 2024-05-10T05:18:31.674 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15eda00700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d00053a0 0x7f15d000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15eda00700 1 -- 172.21.15.47:0/289934998 reap_dead start 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15ed000700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d0003a00 0x7f15d0003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009b10 tx=0x7f15d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d765a546c6f888f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc005a20 con 0x7f15d0003a00 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc005b80 con 0x7f15d0003a00 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.670+0000 7f15e7400700 1 -- 172.21.15.47:0/289934998 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc00e6c0 con 0x7f15d0003a00 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 -- 172.21.15.47:0/289934998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d0003a00 msgr2=0x7f15d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d0003a00 0x7f15d0003e70 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009b10 tx=0x7f15d0005880 comp rx=0 tx=0).stop 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 -- 172.21.15.47:0/289934998 shutdown_connections 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 --2- 172.21.15.47:0/289934998 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15d0003a00 0x7f15d0003e70 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 -- 172.21.15.47:0/289934998 >> 172.21.15.47:0/289934998 conn(0x7f15e80c7720 msgr2=0x7f15e80c7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 -- 172.21.15.47:0/289934998 shutdown_connections 2024-05-10T05:18:31.675 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.671+0000 7f15efa00700 1 -- 172.21.15.47:0/289934998 wait complete. 2024-05-10T05:18:31.677 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.673+0000 7f15efa00700 1 Processor -- start 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.674+0000 7f15efa00700 1 -- start start 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15efa00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d0003a00 0x7f15e814f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15efa00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80c67e0 0x7f15e81eb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15efa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e81ebc30 0x7f15e81447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15efa00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8156630 con 0x7f15e81ebc30 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15efa00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81598e0 con 0x7f15e80c67e0 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15efa00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81ef290 con 0x7f15d0003a00 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15eda00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e81ebc30 0x7f15e81447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15eda00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e81ebc30 0x7f15e81447a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55966/0 (socket says 172.21.15.47:55966) 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.675+0000 7f15eda00700 1 -- 172.21.15.47:0/3868433469 learned_addr learned my addr 172.21.15.47:0/3868433469 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15eda00700 1 -- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d0003a00 msgr2=0x7f15e814f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15eda00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15d0003a00 0x7f15e814f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15eda00700 1 -- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80c67e0 msgr2=0x7f15e81eb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.678 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15eda00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80c67e0 0x7f15e81eb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15eda00700 1 -- 172.21.15.47:0/3868433469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8159600 con 0x7f15e81ebc30 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15eda00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e81ebc30 0x7f15e81447a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15e8071440 tx=0x7f15e000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0003c10 con 0x7f15e81ebc30 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e0003d90 con 0x7f15e81ebc30 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15e80c6160 con 0x7f15e81ebc30 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0005310 con 0x7f15e81ebc30 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.676+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e81ef4e0 con 0x7f15e81ebc30 2024-05-10T05:18:31.679 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.677+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f15e8072c80 con 0x7f15e81ebc30 2024-05-10T05:18:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.679+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15e0005470 con 0x7f15e81ebc30 2024-05-10T05:18:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.679+0000 7f15e4c00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.679+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15e008a180 con 0x7f15e81ebc30 2024-05-10T05:18:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.680+0000 7f15e4c00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7f15c80745c0 0x7f15c8076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.680+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 --> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f15c8077180 con 0x7f15c80745c0 2024-05-10T05:18:31.680 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.680+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15e008a4f0 con 0x7f15e81ebc30 2024-05-10T05:18:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.680+0000 7f15ed000700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.680+0000 7f15e7e00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7f15c80745c0 0x7f15c8076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.680+0000 7f15ed000700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009b10 tx=0x7f15dc013000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.681+0000 7f15e7e00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7f15c80745c0 0x7f15c8076ab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:31.681 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.681+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== osd.2 v2:172.21.15.47:6800/43824 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f15c8077180 con 0x7f15c80745c0 2024-05-10T05:18:31.697 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.697+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 --> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f15e80729e0 con 0x7f15c80745c0 2024-05-10T05:18:31.698 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.697+0000 7f15e4c00700 1 -- 172.21.15.47:0/3868433469 <== osd.2 v2:172.21.15.47:6800/43824 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f15d4007c90 con 0x7f15c80745c0 2024-05-10T05:18:31.698 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:31.698 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:31.698 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7f15c80745c0 msgr2=0x7f15c8076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:6800/43824,v1:172.21.15.47:6801/43824] conn(0x7f15c80745c0 0x7f15c8076ab0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 msgr2=0x7f15c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009b10 tx=0x7f15dc013000 comp rx=0 tx=0).stop 2024-05-10T05:18:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e81ebc30 msgr2=0x7f15e81447a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:31.699 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 --2- 172.21.15.47:0/3868433469 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e81ebc30 0x7f15e81447a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f15e8071440 tx=0x7f15e000ee50 comp rx=0 tx=0).stop 2024-05-10T05:18:31.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15eda00700 1 -- 172.21.15.47:0/3868433469 reap_dead start 2024-05-10T05:18:31.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 shutdown_connections 2024-05-10T05:18:31.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 >> 172.21.15.47:0/3868433469 conn(0x7f15e80c7720 msgr2=0x7f15e81533a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:31.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 shutdown_connections 2024-05-10T05:18:31.700 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.698+0000 7f15efa00700 1 -- 172.21.15.47:0/3868433469 wait complete. 2024-05-10T05:18:31.724 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-10T05:18:31.996 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.996+0000 7f0652e00700 1 Processor -- start 2024-05-10T05:18:31.997 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.996+0000 7f0652e00700 1 -- start start 2024-05-10T05:18:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f0652e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0c6d90 0x7f064c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f0652e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0c31e0 con 0x7f064c0cad00 2024-05-10T05:18:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f0652e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0cb110 con 0x7f064c0ca8f0 2024-05-10T05:18:31.998 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f0652e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0c50e0 con 0x7f064c0c6d90 2024-05-10T05:18:31.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f0650e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f064c0cad00 0x7f064c0c3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42826/0 (socket says 172.21.15.47:42826) 2024-05-10T05:18:31.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f0650e00700 1 -- 172.21.15.47:0/2291024412 learned_addr learned my addr 172.21.15.47:0/2291024412 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:31.999 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.998+0000 7f064be00700 1 --2- 172.21.15.47:0/2291024412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0c6d90 0x7f064c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925915576 0 0) 0x7f064c0c31e0 con 0x7f064c0cad00 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06300035b0 con 0x7f064c0cad00 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965198270 0 0) 0x7f064c0cb110 con 0x7f064c0ca8f0 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f064c0c31e0 con 0x7f064c0ca8f0 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064be00700 1 -- 172.21.15.47:0/2291024412 >> v1:172.21.15.117:6789/0 conn(0x7f064c0ca8f0 legacy=0x7f064c0c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064be00700 1 -- 172.21.15.47:0/2291024412 >> v1:172.21.15.47:6789/0 conn(0x7f064c0cad00 legacy=0x7f064c0c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064be00700 1 -- 172.21.15.47:0/2291024412 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0c5340 con 0x7f064c0c6d90 2024-05-10T05:18:32.000 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:31.999+0000 7f064be00700 1 --2- 172.21.15.47:0/2291024412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0c6d90 0x7f064c155ef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af1033abe522b47b server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011830 con 0x7f064c0c6d90 2024-05-10T05:18:32.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c011990 con 0x7f064c0c6d90 2024-05-10T05:18:32.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f064aa00700 1 -- 172.21.15.47:0/2291024412 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c011d20 con 0x7f064c0c6d90 2024-05-10T05:18:32.001 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 -- 172.21.15.47:0/2291024412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0c6d90 msgr2=0x7f064c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 --2- 172.21.15.47:0/2291024412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0c6d90 0x7f064c155ef0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f063c009870 tx=0x7f063c009b80 comp rx=0 tx=0).stop 2024-05-10T05:18:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 -- 172.21.15.47:0/2291024412 shutdown_connections 2024-05-10T05:18:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 --2- 172.21.15.47:0/2291024412 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0c6d90 0x7f064c155ef0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 -- 172.21.15.47:0/2291024412 >> 172.21.15.47:0/2291024412 conn(0x7f064c0c7620 msgr2=0x7f064c0c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 -- 172.21.15.47:0/2291024412 shutdown_connections 2024-05-10T05:18:32.002 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.000+0000 7f0652e00700 1 -- 172.21.15.47:0/2291024412 wait complete. 2024-05-10T05:18:32.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.003+0000 7f0652e00700 1 Processor -- start 2024-05-10T05:18:32.003 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.003+0000 7f0652e00700 1 -- start start 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f0652e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 0x7f064c1ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f0652e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0ca8f0 0x7f064c0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f0652e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c0cad00 0x7f064c0c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f0652e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1eb800 con 0x7f064c0c6d90 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f0652e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c156f60 con 0x7f064c0cad00 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f0652e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0aa0d0 con 0x7f064c0ca8f0 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f064be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 0x7f064c1ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f064be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 0x7f064c1ebc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:55980/0 (socket says 172.21.15.47:55980) 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.004+0000 7f064be00700 1 -- 172.21.15.47:0/3118821890 learned_addr learned my addr 172.21.15.47:0/3118821890 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:32.006 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064b400700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0ca8f0 0x7f064c0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f0650e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c0cad00 0x7f064c0c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064be00700 1 -- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0ca8f0 msgr2=0x7f064c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064be00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0ca8f0 0x7f064c0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064be00700 1 -- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c0cad00 msgr2=0x7f064c0c9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064be00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c0cad00 0x7f064c0c9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064be00700 1 -- 172.21.15.47:0/3118821890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0094a0 con 0x7f064c0c6d90 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064b400700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0ca8f0 0x7f064c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f0650e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c0cad00 0x7f064c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f064be00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 0x7f064c1ebc20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f063c0090b0 tx=0x7f063c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c01a860 con 0x7f064c0c6d90 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f063c01a9c0 con 0x7f064c0c6d90 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c01ad30 con 0x7f064c0c6d90 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.005+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c1eb160 con 0x7f064c0c6d90 2024-05-10T05:18:32.007 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.006+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c0aa650 con 0x7f064c0c6d90 2024-05-10T05:18:32.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.007+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c074720 con 0x7f064c0c6d90 2024-05-10T05:18:32.008 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.008+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f063c022070 con 0x7f064c0c6d90 2024-05-10T05:18:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.009+0000 7f0643e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f062c06ac90 0x7f062c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.009+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f063c08a350 con 0x7f064c0c6d90 2024-05-10T05:18:32.009 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.009+0000 7f064b400700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f062c06ac90 0x7f062c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.010 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.010+0000 7f064b400700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f062c06ac90 0x7f062c06d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f064c0ca410 tx=0x7f0638009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.013 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.013+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f063c055210 con 0x7f064c0c6d90 2024-05-10T05:18:32.232 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.232+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f064c0c5be0 con 0x7f062c06ac90 2024-05-10T05:18:32.233 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.233+0000 7f0643e00700 1 -- 172.21.15.47:0/3118821890 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0638014420 con 0x7f062c06ac90 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f062c06ac90 msgr2=0x7f062c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f062c06ac90 0x7f062c06d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f064c0ca410 tx=0x7f0638009040 comp rx=0 tx=0).stop 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 msgr2=0x7f064c1ebc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 0x7f064c1ebc20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f063c0090b0 tx=0x7f063c004750 comp rx=0 tx=0).stop 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 shutdown_connections 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f064c0cad00 0x7f064c0c9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f064c0c6d90 0x7f064c1ebc20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.236 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f062c06ac90 0x7f062c06d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 --2- 172.21.15.47:0/3118821890 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f064c0ca8f0 0x7f064c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 >> 172.21.15.47:0/3118821890 conn(0x7f064c0c7620 msgr2=0x7f064c154c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 shutdown_connections 2024-05-10T05:18:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.235+0000 7f0652e00700 1 -- 172.21.15.47:0/3118821890 wait complete. 2024-05-10T05:18:32.237 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 2 to deep-scrub 2024-05-10T05:18:32.264 INFO:tasks.ceph:Scrubbing osd.3 2024-05-10T05:18:32.264 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:32.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.542+0000 7f98db200700 1 Processor -- start 2024-05-10T05:18:32.542 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.542+0000 7f98db200700 1 -- start start 2024-05-10T05:18:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.543+0000 7f98db200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f98d4152bc0 0x7f98d4155e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.543+0000 7f98db200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c3e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98db200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d40c62b0 con 0x7f98d40ca8e0 2024-05-10T05:18:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98db200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d40cb100 con 0x7f98d4152bc0 2024-05-10T05:18:32.544 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98db200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d41563a0 con 0x7f98d40cacf0 2024-05-10T05:18:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f98d4152bc0 0x7f98d4155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f98d40ca8e0 0x7f98d40c3780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42828/0 (socket says 172.21.15.47:42828) 2024-05-10T05:18:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3400700 1 -- 172.21.15.47:0/3563182322 learned_addr learned my addr 172.21.15.47:0/3563182322 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:32.545 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d9200700 1 --2- 172.21.15.47:0/3563182322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d2a00700 1 -- 172.21.15.47:0/3563182322 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589322374 0 0) 0x7f98d40c62b0 con 0x7f98d40ca8e0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3e00700 1 -- 172.21.15.47:0/3563182322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 msgr2=0x7f98d40c3e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3e00700 1 --2- 172.21.15.47:0/3563182322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c3e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3e00700 1 -- 172.21.15.47:0/3563182322 >> v1:172.21.15.47:6789/0 conn(0x7f98d40ca8e0 legacy=0x7f98d40c3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.544+0000 7f98d3e00700 1 -- 172.21.15.47:0/3563182322 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40c56a0 con 0x7f98d4152bc0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.545+0000 7f98d3e00700 1 --2- 172.21.15.47:0/3563182322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d4155e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009840 tx=0x7f98c4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63e6cf11fce9f62 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.545+0000 7f98d2a00700 1 -- 172.21.15.47:0/3563182322 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011830 con 0x7f98d4152bc0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.545+0000 7f98d2a00700 1 -- 172.21.15.47:0/3563182322 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c4011990 con 0x7f98d4152bc0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.545+0000 7f98d2a00700 1 -- 172.21.15.47:0/3563182322 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c4011d20 con 0x7f98d4152bc0 2024-05-10T05:18:32.547 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 -- 172.21.15.47:0/3563182322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 msgr2=0x7f98d4155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 --2- 172.21.15.47:0/3563182322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d4155e60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009840 tx=0x7f98c4009b50 comp rx=0 tx=0).stop 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 -- 172.21.15.47:0/3563182322 shutdown_connections 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 --2- 172.21.15.47:0/3563182322 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d4155e60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 --2- 172.21.15.47:0/3563182322 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c3e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 -- 172.21.15.47:0/3563182322 >> 172.21.15.47:0/3563182322 conn(0x7f98d40c7610 msgr2=0x7f98d40c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 -- 172.21.15.47:0/3563182322 shutdown_connections 2024-05-10T05:18:32.548 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.546+0000 7f98db200700 1 -- 172.21.15.47:0/3563182322 wait complete. 2024-05-10T05:18:32.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.548+0000 7f98db200700 1 Processor -- start 2024-05-10T05:18:32.549 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.548+0000 7f98db200700 1 -- start start 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.549+0000 7f98db200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98d40ca8e0 0x7f98d4154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.549+0000 7f98db200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98db200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98db200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4155210 con 0x7f98d4152bc0 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98db200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d4153380 con 0x7f98d40ca8e0 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98db200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d414a8c0 con 0x7f98d40cacf0 2024-05-10T05:18:32.551 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d41538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56000/0 (socket says 172.21.15.47:56000) 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 -- 172.21.15.47:0/783340790 learned_addr learned my addr 172.21.15.47:0/783340790 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d3400700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d3e00700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98d40ca8e0 0x7f98d4154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 -- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 msgr2=0x7f98d40c0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f98d40cacf0 0x7f98d40c0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 -- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98d40ca8e0 msgr2=0x7f98d4154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f98d40ca8e0 0x7f98d4154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.550+0000 7f98d9200700 1 -- 172.21.15.47:0/783340790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c40094a0 con 0x7f98d4152bc0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.551+0000 7f98d9200700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d41538f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00efc0 tx=0x7f98cc00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.551+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00cad0 con 0x7f98d4152bc0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.551+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98cc00f040 con 0x7f98d4152bc0 2024-05-10T05:18:32.552 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.551+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d41ebca0 con 0x7f98d4152bc0 2024-05-10T05:18:32.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.551+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98cc00ce70 con 0x7f98d4152bc0 2024-05-10T05:18:32.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.551+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d4155d20 con 0x7f98d4152bc0 2024-05-10T05:18:32.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.552+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98d40c5f40 con 0x7f98d4152bc0 2024-05-10T05:18:32.553 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.553+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98cc014480 con 0x7f98d4152bc0 2024-05-10T05:18:32.554 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.554+0000 7f98cbe00700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f98b406ac90 0x7f98b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.554+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f98cc08a1e0 con 0x7f98d4152bc0 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.554+0000 7f98cbe00700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f98b40745c0 0x7f98b4076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.554+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 --> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98b4077180 con 0x7f98b40745c0 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.554+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98cc08c7c0 con 0x7f98d4152bc0 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.554+0000 7f98d3400700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f98b40745c0 0x7f98b4076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.555+0000 7f98d3e00700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f98b406ac90 0x7f98b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.555+0000 7f98d3400700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f98b40745c0 0x7f98b4076ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.555 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.555+0000 7f98d3e00700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f98b406ac90 0x7f98b406d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009840 tx=0x7f98c4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.556 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.556+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== osd.3 v2:172.21.15.47:6824/43825 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f98b4077180 con 0x7f98b40745c0 2024-05-10T05:18:32.571 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.571+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 --> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98d40c5c60 con 0x7f98b40745c0 2024-05-10T05:18:32.572 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98cbe00700 1 -- 172.21.15.47:0/783340790 <== osd.3 v2:172.21.15.47:6824/43825 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f98c0004ab0 con 0x7f98b40745c0 2024-05-10T05:18:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:32.572 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:32.572 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:32.573 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f98b40745c0 msgr2=0x7f98b4076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:6824/43825,v1:172.21.15.47:6825/43825] conn(0x7f98b40745c0 0x7f98b4076ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f98b406ac90 msgr2=0x7f98b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f98b406ac90 0x7f98b406d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f98c4009840 tx=0x7f98c4008030 comp rx=0 tx=0).stop 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 msgr2=0x7f98d41538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 --2- 172.21.15.47:0/783340790 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f98d4152bc0 0x7f98d41538f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f98cc00efc0 tx=0x7f98cc00c0c0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98d9200700 1 -- 172.21.15.47:0/783340790 reap_dead start 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 shutdown_connections 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 >> 172.21.15.47:0/783340790 conn(0x7f98d40c7610 msgr2=0x7f98d414dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 shutdown_connections 2024-05-10T05:18:32.574 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.572+0000 7f98db200700 1 -- 172.21.15.47:0/783340790 wait complete. 2024-05-10T05:18:32.597 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-10T05:18:32.874 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.874+0000 7f2780000700 1 Processor -- start 2024-05-10T05:18:32.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.874+0000 7f2780000700 1 -- start start 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f2780000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f27780c6cc0 0x7f2778152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f2780000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f27780c5cf0 0x7f27780c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f2780000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f277806d640 con 0x7f27780c92d0 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f2780000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27780c9800 con 0x7f27780c6cc0 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f2780000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27780c8910 con 0x7f27780c5cf0 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f277d600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f27780c6cc0 0x7f2778152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f277d600700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f27780c6cc0 0x7f2778152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56016/0 (socket says 172.21.15.47:56016) 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f277e000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f27780c92d0 0x7f277806bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42832/0 (socket says 172.21.15.47:42832) 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f277d600700 1 -- 172.21.15.47:0/1294462624 learned_addr learned my addr 172.21.15.47:0/1294462624 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.876+0000 7f277cc00700 1 --2- 172.21.15.47:0/1294462624 >> v2:172.21.15.117:3300/0 conn(0x7f27780c5cf0 0x7f27780c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f277d600700 1 -- 172.21.15.47:0/1294462624 >> v2:172.21.15.117:3300/0 conn(0x7f27780c5cf0 msgr2=0x7f27780c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:32.877 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f277d600700 1 --2- 172.21.15.47:0/1294462624 >> v2:172.21.15.117:3300/0 conn(0x7f27780c5cf0 0x7f27780c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f277d600700 1 -- 172.21.15.47:0/1294462624 >> v1:172.21.15.47:6789/0 conn(0x7f27780c92d0 legacy=0x7f277806bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.878 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f277d600700 1 -- 172.21.15.47:0/1294462624 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780c6100 con 0x7f27780c6cc0 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f277d600700 1 --2- 172.21.15.47:0/1294462624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f2778152bb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27780ca790 tx=0x7f276c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a86b7cf83007c1a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f2777e00700 1 -- 172.21.15.47:0/1294462624 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00b870 con 0x7f27780c6cc0 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f2777e00700 1 -- 172.21.15.47:0/1294462624 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276c00b9d0 con 0x7f27780c6cc0 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.877+0000 7f2777e00700 1 -- 172.21.15.47:0/1294462624 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276c00bd60 con 0x7f27780c6cc0 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 -- 172.21.15.47:0/1294462624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 msgr2=0x7f2778152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 --2- 172.21.15.47:0/1294462624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f2778152bb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f27780ca790 tx=0x7f276c009bd0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 -- 172.21.15.47:0/1294462624 shutdown_connections 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 --2- 172.21.15.47:0/1294462624 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f2778152bb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 --2- 172.21.15.47:0/1294462624 >> v2:172.21.15.117:3300/0 conn(0x7f27780c5cf0 0x7f27780c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 -- 172.21.15.47:0/1294462624 >> 172.21.15.47:0/1294462624 conn(0x7f27780ca960 msgr2=0x7f27780cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:32.879 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 -- 172.21.15.47:0/1294462624 shutdown_connections 2024-05-10T05:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.878+0000 7f2780000700 1 -- 172.21.15.47:0/1294462624 wait complete. 2024-05-10T05:18:32.880 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.880+0000 7f2780000700 1 Processor -- start 2024-05-10T05:18:32.881 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.880+0000 7f2780000700 1 -- start start 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f2780000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27780c5cf0 0x7f27780ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f2780000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f27781538c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f2780000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27780c92d0 0x7f2778143dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f2780000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778154320 con 0x7f27780c6cc0 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f2780000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2778147b40 con 0x7f27780c5cf0 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f2780000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2778154f30 con 0x7f27780c92d0 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f277cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f27781538c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f277cc00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f27781538c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56020/0 (socket says 172.21.15.47:56020) 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.882+0000 7f277cc00700 1 -- 172.21.15.47:0/2990192485 learned_addr learned my addr 172.21.15.47:0/2990192485 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277d600700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27780c5cf0 0x7f27780ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.884 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277e000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27780c92d0 0x7f2778143dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277cc00700 1 -- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27780c92d0 msgr2=0x7f2778143dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277cc00700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27780c92d0 0x7f2778143dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277cc00700 1 -- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27780c5cf0 msgr2=0x7f27780ab7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277cc00700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27780c5cf0 0x7f27780ab7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277cc00700 1 -- 172.21.15.47:0/2990192485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c009550 con 0x7f27780c6cc0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f277cc00700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f27781538c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f276400d800 tx=0x7f276400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27640125f0 con 0x7f27780c6cc0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2764012750 con 0x7f27780c6cc0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277814a7a0 con 0x7f27780c6cc0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.883+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2764012ae0 con 0x7f27780c6cc0 2024-05-10T05:18:32.885 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.884+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f277814a9f0 con 0x7f27780c6cc0 2024-05-10T05:18:32.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.885+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2778153710 con 0x7f27780c6cc0 2024-05-10T05:18:32.886 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.886+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2764012c40 con 0x7f27780c6cc0 2024-05-10T05:18:32.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.887+0000 7f2775600700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f275806ac90 0x7f275806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:32.887 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.887+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27640897d0 con 0x7f27780c6cc0 2024-05-10T05:18:32.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.888+0000 7f277d600700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f275806ac90 0x7f275806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:32.888 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.888+0000 7f277d600700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f275806ac90 0x7f275806d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f276c014040 tx=0x7f276c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:32.892 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:32.892+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f27640545f0 con 0x7f27780c6cc0 2024-05-10T05:18:33.109 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.109+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f27780c65a0 con 0x7f275806ac90 2024-05-10T05:18:33.110 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.110+0000 7f2775600700 1 -- 172.21.15.47:0/2990192485 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f27780c65a0 con 0x7f275806ac90 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f275806ac90 msgr2=0x7f275806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f275806ac90 0x7f275806d1a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f276c014040 tx=0x7f276c008030 comp rx=0 tx=0).stop 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 msgr2=0x7f27781538c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f27781538c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f276400d800 tx=0x7f276400db10 comp rx=0 tx=0).stop 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 shutdown_connections 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f275806ac90 0x7f275806d1a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f27780c92d0 0x7f2778143dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.113 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f27780c5cf0 0x7f27780ab7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 --2- 172.21.15.47:0/2990192485 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f27780c6cc0 0x7f27781538c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.112+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 >> 172.21.15.47:0/2990192485 conn(0x7f27780ca960 msgr2=0x7f2778156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:33.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.113+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 shutdown_connections 2024-05-10T05:18:33.114 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.113+0000 7f2780000700 1 -- 172.21.15.47:0/2990192485 wait complete. 2024-05-10T05:18:33.114 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 3 to deep-scrub 2024-05-10T05:18:33.141 INFO:tasks.ceph:Scrubbing osd.4 2024-05-10T05:18:33.141 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:33.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.418+0000 7fca8e000700 1 Processor -- start 2024-05-10T05:18:33.419 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.418+0000 7fca8e000700 1 -- start start 2024-05-10T05:18:33.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca8e000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca880c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca8e000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fca880c2660 0x7fca88158b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca8e000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca88159750 con 0x7fca88152d20 2024-05-10T05:18:33.420 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca8e000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca880732d0 con 0x7fca880c2660 2024-05-10T05:18:33.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca8e000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca88072ff0 con 0x7fca880c0f70 2024-05-10T05:18:33.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca87e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fca88152d20 0x7fca88159040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42834/0 (socket says 172.21.15.47:42834) 2024-05-10T05:18:33.421 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca87e00700 1 -- 172.21.15.47:0/66904312 learned_addr learned my addr 172.21.15.47:0/66904312 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca86a00700 1 --2- 172.21.15.47:0/66904312 >> v2:172.21.15.117:3300/0 conn(0x7fca880c2660 0x7fca88158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.420+0000 7fca87400700 1 --2- 172.21.15.47:0/66904312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca880c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca86000700 1 -- 172.21.15.47:0/66904312 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1880918184 0 0) 0x7fca88159750 con 0x7fca88152d20 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca86000700 1 -- 172.21.15.47:0/66904312 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca6c0035b0 con 0x7fca88152d20 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca87400700 1 -- 172.21.15.47:0/66904312 >> v2:172.21.15.117:3300/0 conn(0x7fca880c2660 msgr2=0x7fca88158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca87400700 1 --2- 172.21.15.47:0/66904312 >> v2:172.21.15.117:3300/0 conn(0x7fca880c2660 0x7fca88158b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca87400700 1 -- 172.21.15.47:0/66904312 >> v1:172.21.15.47:6789/0 conn(0x7fca88152d20 legacy=0x7fca88159040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca87400700 1 -- 172.21.15.47:0/66904312 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88072110 con 0x7fca880c0f70 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.421+0000 7fca87400700 1 --2- 172.21.15.47:0/66904312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca880c2120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca78009840 tx=0x7fca78009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2733b4454a321674 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.422 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca86000700 1 -- 172.21.15.47:0/66904312 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011830 con 0x7fca880c0f70 2024-05-10T05:18:33.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca86000700 1 -- 172.21.15.47:0/66904312 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca78011990 con 0x7fca880c0f70 2024-05-10T05:18:33.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca86000700 1 -- 172.21.15.47:0/66904312 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78011d20 con 0x7fca880c0f70 2024-05-10T05:18:33.423 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca8e000700 1 -- 172.21.15.47:0/66904312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 msgr2=0x7fca880c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca8e000700 1 --2- 172.21.15.47:0/66904312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca880c2120 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca78009840 tx=0x7fca78009b50 comp rx=0 tx=0).stop 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca8e000700 1 -- 172.21.15.47:0/66904312 shutdown_connections 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca8e000700 1 --2- 172.21.15.47:0/66904312 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca880c2120 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca8e000700 1 --2- 172.21.15.47:0/66904312 >> v2:172.21.15.117:3300/0 conn(0x7fca880c2660 0x7fca88158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.422+0000 7fca8e000700 1 -- 172.21.15.47:0/66904312 >> 172.21.15.47:0/66904312 conn(0x7fca880c4220 msgr2=0x7fca880c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.423+0000 7fca8e000700 1 -- 172.21.15.47:0/66904312 shutdown_connections 2024-05-10T05:18:33.424 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.423+0000 7fca8e000700 1 -- 172.21.15.47:0/66904312 wait complete. 2024-05-10T05:18:33.425 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.425+0000 7fca8e000700 1 Processor -- start 2024-05-10T05:18:33.426 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.426+0000 7fca8e000700 1 -- start start 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca8e000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca881578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca8e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca880c2660 0x7fca881ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca8e000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca88152d20 0x7fca881ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca8e000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca88158600 con 0x7fca880c2660 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca8e000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca881eef30 con 0x7fca88152d20 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca8e000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca880ad9a0 con 0x7fca880c0f70 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca86a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca880c2660 0x7fca881ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.427+0000 7fca86a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca880c2660 0x7fca881ee3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56030/0 (socket says 172.21.15.47:56030) 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 -- 172.21.15.47:0/911712311 learned_addr learned my addr 172.21.15.47:0/911712311 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca87400700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca881578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca87e00700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca88152d20 0x7fca881ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.429 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 -- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 msgr2=0x7fca881578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca881578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 -- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca88152d20 msgr2=0x7fca881ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fca88152d20 0x7fca881ee930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 -- 172.21.15.47:0/911712311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca780094a0 con 0x7fca880c2660 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca87400700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fca880c0f70 0x7fca881578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca86a00700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca880c2660 0x7fca881ee3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e840 tx=0x7fca7400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.428+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74009590 con 0x7fca880c2660 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.429+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca74013680 con 0x7fca880c2660 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.429+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca74013a30 con 0x7fca880c2660 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.429+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca881570e0 con 0x7fca880c2660 2024-05-10T05:18:33.430 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.429+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca88158340 con 0x7fca880c2660 2024-05-10T05:18:33.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.429+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fca88072c80 con 0x7fca880c2660 2024-05-10T05:18:33.431 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.431+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fca74013b90 con 0x7fca880c2660 2024-05-10T05:18:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca7f400700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fca6806acc0 0x7fca6806d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fca74089740 con 0x7fca880c2660 2024-05-10T05:18:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca7f400700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7fca680745f0 0x7fca68076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.432 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 --> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca680771b0 con 0x7fca680745f0 2024-05-10T05:18:33.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca7408bcc0 con 0x7fca880c2660 2024-05-10T05:18:33.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca87400700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fca6806acc0 0x7fca6806d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.432+0000 7fca87e00700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7fca680745f0 0x7fca68076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.433+0000 7fca87400700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fca6806acc0 0x7fca6806d1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca78009840 tx=0x7fca78008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.433 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.433+0000 7fca87e00700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7fca680745f0 0x7fca68076ae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.434 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.434+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== osd.4 v2:172.21.15.117:6800/44079 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7fca680771b0 con 0x7fca680745f0 2024-05-10T05:18:33.450 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.450+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 --> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fca880726d0 con 0x7fca680745f0 2024-05-10T05:18:33.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.450+0000 7fca7f400700 1 -- 172.21.15.47:0/911712311 <== osd.4 v2:172.21.15.117:6800/44079 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fca80001cd0 con 0x7fca680745f0 2024-05-10T05:18:33.451 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:33.451 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:33.451 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7fca680745f0 msgr2=0x7fca68076ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6800/44079,v1:172.21.15.117:6801/44079] conn(0x7fca680745f0 0x7fca68076ae0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fca6806acc0 msgr2=0x7fca6806d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fca6806acc0 0x7fca6806d1d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fca78009840 tx=0x7fca78008030 comp rx=0 tx=0).stop 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca880c2660 msgr2=0x7fca881ee3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 --2- 172.21.15.47:0/911712311 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fca880c2660 0x7fca881ee3f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fca7400e840 tx=0x7fca7400ec00 comp rx=0 tx=0).stop 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca87e00700 1 -- 172.21.15.47:0/911712311 reap_dead start 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 shutdown_connections 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 >> 172.21.15.47:0/911712311 conn(0x7fca880c4220 msgr2=0x7fca881521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 shutdown_connections 2024-05-10T05:18:33.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.451+0000 7fca8e000700 1 -- 172.21.15.47:0/911712311 wait complete. 2024-05-10T05:18:33.476 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-10T05:18:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.752+0000 7f57b2c00700 1 Processor -- start 2024-05-10T05:18:33.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.752+0000 7f57b2c00700 1 -- start start 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.753+0000 7f57b2c00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57ac0c6cc0 0x7f57ac152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.753+0000 7f57b2c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57ac0c5cf0 0x7f57ac0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57b2c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac06d640 con 0x7f57ac0c92d0 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57b2c00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0c9800 con 0x7f57ac0c6cc0 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57b2c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0c8910 con 0x7f57ac0c5cf0 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57abe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f57ac0c6cc0 0x7f57ac152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57b0c00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f57ac0c92d0 0x7f57ac06bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42848/0 (socket says 172.21.15.47:42848) 2024-05-10T05:18:33.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57b0c00700 1 -- 172.21.15.47:0/2126555452 learned_addr learned my addr 172.21.15.47:0/2126555452 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57ab400700 1 --2- 172.21.15.47:0/2126555452 >> v2:172.21.15.117:3300/0 conn(0x7f57ac0c5cf0 0x7f57ac0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57abe00700 1 -- 172.21.15.47:0/2126555452 >> v2:172.21.15.117:3300/0 conn(0x7f57ac0c5cf0 msgr2=0x7f57ac0c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57abe00700 1 --2- 172.21.15.47:0/2126555452 >> v2:172.21.15.117:3300/0 conn(0x7f57ac0c5cf0 0x7f57ac0c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57abe00700 1 -- 172.21.15.47:0/2126555452 >> v1:172.21.15.47:6789/0 conn(0x7f57ac0c92d0 legacy=0x7f57ac06bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57abe00700 1 -- 172.21.15.47:0/2126555452 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0c6100 con 0x7f57ac0c6cc0 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.754+0000 7f57aaa00700 1 -- 172.21.15.47:0/2126555452 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1461306908 0 0) 0x7f57ac06d640 con 0x7f57ac0c92d0 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.755+0000 7f57abe00700 1 --2- 172.21.15.47:0/2126555452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c6cc0 0x7f57ac152bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0ca790 tx=0x7f579c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecbbf3f89c317af server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.755+0000 7f57aaa00700 1 -- 172.21.15.47:0/2126555452 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c011830 con 0x7f57ac0c6cc0 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.755+0000 7f57aaa00700 1 -- 172.21.15.47:0/2126555452 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579c011990 con 0x7f57ac0c6cc0 2024-05-10T05:18:33.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.755+0000 7f57aaa00700 1 -- 172.21.15.47:0/2126555452 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c011d20 con 0x7f57ac0c6cc0 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.755+0000 7f57b2c00700 1 -- 172.21.15.47:0/2126555452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c6cc0 msgr2=0x7f57ac152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.755+0000 7f57b2c00700 1 --2- 172.21.15.47:0/2126555452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c6cc0 0x7f57ac152bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57ac0ca790 tx=0x7f579c009b20 comp rx=0 tx=0).stop 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.756+0000 7f57b2c00700 1 -- 172.21.15.47:0/2126555452 shutdown_connections 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.756+0000 7f57b2c00700 1 --2- 172.21.15.47:0/2126555452 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c6cc0 0x7f57ac152bb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.756+0000 7f57b2c00700 1 --2- 172.21.15.47:0/2126555452 >> v2:172.21.15.117:3300/0 conn(0x7f57ac0c5cf0 0x7f57ac0c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.756+0000 7f57b2c00700 1 -- 172.21.15.47:0/2126555452 >> 172.21.15.47:0/2126555452 conn(0x7f57ac0ca960 msgr2=0x7f57ac0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:33.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.756+0000 7f57b2c00700 1 -- 172.21.15.47:0/2126555452 shutdown_connections 2024-05-10T05:18:33.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.756+0000 7f57b2c00700 1 -- 172.21.15.47:0/2126555452 wait complete. 2024-05-10T05:18:33.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.758+0000 7f57b2c00700 1 Processor -- start 2024-05-10T05:18:33.758 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.758+0000 7f57b2c00700 1 -- start start 2024-05-10T05:18:33.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b2c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57ac0c5cf0 0x7f57ac0bd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b2c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57ac0c6cc0 0x7f57ac0c3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b2c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 0x7f57ac14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b2c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac1ee7e0 con 0x7f57ac0c92d0 2024-05-10T05:18:33.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b2c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0c4840 con 0x7f57ac0c5cf0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b2c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0bf9b0 con 0x7f57ac0c6cc0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 0x7f57ac14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 0x7f57ac14d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56044/0 (socket says 172.21.15.47:56044) 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 -- 172.21.15.47:0/1947951287 learned_addr learned my addr 172.21.15.47:0/1947951287 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57abe00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57ac0c5cf0 0x7f57ac0bd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57ab400700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57ac0c6cc0 0x7f57ac0c3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 -- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57ac0c6cc0 msgr2=0x7f57ac0c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57ac0c6cc0 0x7f57ac0c3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 -- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57ac0c5cf0 msgr2=0x7f57ac0bd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57ac0c5cf0 0x7f57ac0bd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.760+0000 7f57b0c00700 1 -- 172.21.15.47:0/1947951287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0094a0 con 0x7f57ac0c92d0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.761+0000 7f57b0c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 0x7f57ac14d980 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f57a400cb60 tx=0x7f57a400ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.761+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400a9a0 con 0x7f57ac0c92d0 2024-05-10T05:18:33.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.761+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400ab00 con 0x7f57ac0c92d0 2024-05-10T05:18:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.761+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0bdb30 con 0x7f57ac0c92d0 2024-05-10T05:18:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.761+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a40070d0 con 0x7f57ac0c92d0 2024-05-10T05:18:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.761+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac155a30 con 0x7f57ac0c92d0 2024-05-10T05:18:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.762+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac0c1420 con 0x7f57ac0c92d0 2024-05-10T05:18:33.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.763+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57a4007230 con 0x7f57ac0c92d0 2024-05-10T05:18:33.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.764+0000 7f57a3e00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f578c06acc0 0x7f578c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:33.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.764+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57a40893b0 con 0x7f57ac0c92d0 2024-05-10T05:18:33.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.765+0000 7f57abe00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f578c06acc0 0x7f578c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:33.765 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.765+0000 7f57abe00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f578c06acc0 0x7f578c06d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f579c000c00 tx=0x7f579c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:33.769 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.769+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f57a40541b0 con 0x7f57ac0c92d0 2024-05-10T05:18:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.985+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f57ac0c9a50 con 0x7f578c06acc0 2024-05-10T05:18:33.986 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.986+0000 7f57a3e00700 1 -- 172.21.15.47:0/1947951287 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f579c011cb0 con 0x7f578c06acc0 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f578c06acc0 msgr2=0x7f578c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f578c06acc0 0x7f578c06d1d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f579c000c00 tx=0x7f579c008030 comp rx=0 tx=0).stop 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 msgr2=0x7f57ac14d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 0x7f57ac14d980 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f57a400cb60 tx=0x7f57a400ce70 comp rx=0 tx=0).stop 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 shutdown_connections 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57ac0c92d0 0x7f57ac14d980 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.990 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57ac0c5cf0 0x7f57ac0bd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f578c06acc0 0x7f578c06d1d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 --2- 172.21.15.47:0/1947951287 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57ac0c6cc0 0x7f57ac0c3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 >> 172.21.15.47:0/1947951287 conn(0x7f57ac0ca960 msgr2=0x7f57ac0c51e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 shutdown_connections 2024-05-10T05:18:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:33.989+0000 7f57b2c00700 1 -- 172.21.15.47:0/1947951287 wait complete. 2024-05-10T05:18:33.991 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 4 to deep-scrub 2024-05-10T05:18:34.017 INFO:tasks.ceph:Scrubbing osd.5 2024-05-10T05:18:34.018 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:34.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.291+0000 7f957d200700 1 Processor -- start 2024-05-10T05:18:34.292 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.291+0000 7f957d200700 1 -- start start 2024-05-10T05:18:34.294 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f957d200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95780c2980 0x7f9578150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f957d200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f95780ac070 0x7f957806dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f957d200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9578153380 con 0x7f95780abc60 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f957d200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95780ac640 con 0x7f95780c2980 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f957d200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9578153600 con 0x7f95780ac070 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f9575e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f95780c2980 0x7f9578150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f956fe00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f95780abc60 0x7f95780a9e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42860/0 (socket says 172.21.15.47:42860) 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.293+0000 7f956fe00700 1 -- 172.21.15.47:0/342934635 learned_addr learned my addr 172.21.15.47:0/342934635 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9576800700 1 --2- 172.21.15.47:0/342934635 >> v2:172.21.15.117:3300/0 conn(0x7f95780ac070 0x7f957806dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575400700 1 -- 172.21.15.47:0/342934635 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4147491837 0 0) 0x7f9578153380 con 0x7f95780abc60 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575400700 1 -- 172.21.15.47:0/342934635 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f955c0035b0 con 0x7f95780abc60 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575e00700 1 -- 172.21.15.47:0/342934635 >> v2:172.21.15.117:3300/0 conn(0x7f95780ac070 msgr2=0x7f957806dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575e00700 1 --2- 172.21.15.47:0/342934635 >> v2:172.21.15.117:3300/0 conn(0x7f95780ac070 0x7f957806dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.295 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575e00700 1 -- 172.21.15.47:0/342934635 >> v1:172.21.15.47:6789/0 conn(0x7f95780abc60 legacy=0x7f95780a9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575e00700 1 -- 172.21.15.47:0/342934635 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95781538e0 con 0x7f95780c2980 2024-05-10T05:18:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9576800700 1 --2- 172.21.15.47:0/342934635 >> v2:172.21.15.117:3300/0 conn(0x7f95780ac070 0x7f957806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575e00700 1 --2- 172.21.15.47:0/342934635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f9578150bb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f95780ab9c0 tx=0x7f9568009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc13b136f186d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575400700 1 -- 172.21.15.47:0/342934635 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568011830 con 0x7f95780c2980 2024-05-10T05:18:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575400700 1 -- 172.21.15.47:0/342934635 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568011990 con 0x7f95780c2980 2024-05-10T05:18:34.296 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.294+0000 7f9575400700 1 -- 172.21.15.47:0/342934635 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568011d20 con 0x7f95780c2980 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 -- 172.21.15.47:0/342934635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 msgr2=0x7f9578150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 --2- 172.21.15.47:0/342934635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f9578150bb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f95780ab9c0 tx=0x7f9568009b20 comp rx=0 tx=0).stop 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 -- 172.21.15.47:0/342934635 shutdown_connections 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 --2- 172.21.15.47:0/342934635 >> v2:172.21.15.117:3300/0 conn(0x7f95780ac070 0x7f957806dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 --2- 172.21.15.47:0/342934635 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f9578150bb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 -- 172.21.15.47:0/342934635 >> 172.21.15.47:0/342934635 conn(0x7f957806add0 msgr2=0x7f957806b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 -- 172.21.15.47:0/342934635 shutdown_connections 2024-05-10T05:18:34.297 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.295+0000 7f957d200700 1 -- 172.21.15.47:0/342934635 wait complete. 2024-05-10T05:18:34.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.298+0000 7f957d200700 1 Processor -- start 2024-05-10T05:18:34.298 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.298+0000 7f957d200700 1 -- start start 2024-05-10T05:18:34.301 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f957d200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95780abc60 0x7f95781db850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f957d200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95780ac070 0x7f957814d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f957d200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f95781488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f957d200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95781dc340 con 0x7f95780c2980 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f957d200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95781eef60 con 0x7f95780abc60 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f957d200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95781ef1b0 con 0x7f95780ac070 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f9576800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f95781488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f9576800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f95781488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56076/0 (socket says 172.21.15.47:56076) 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f9576800700 1 -- 172.21.15.47:0/1273424547 learned_addr learned my addr 172.21.15.47:0/1273424547 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.300+0000 7f956fe00700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95780ac070 0x7f957814d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9575e00700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95780abc60 0x7f95781db850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9576800700 1 -- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95780ac070 msgr2=0x7f957814d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9576800700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f95780ac070 0x7f957814d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9576800700 1 -- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95780abc60 msgr2=0x7f95781db850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9576800700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f95780abc60 0x7f95781db850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.302 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9576800700 1 -- 172.21.15.47:0/1273424547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680094a0 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f9576800700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f95781488c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9570007e70 tx=0x7f957000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957000ddd0 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957000f040 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9570003c60 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f957814b290 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.301+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95781ebc90 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.302+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f95781540e0 con 0x7f95780c2980 2024-05-10T05:18:34.303 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.303+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9570004030 con 0x7f95780c2980 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.304+0000 7f956e000700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f955406ac90 0x7f955406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.304+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95700897e0 con 0x7f95780c2980 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.305+0000 7f956e000700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7f95540745c0 0x7f9554076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.305+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 --> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9554077180 con 0x7f95540745c0 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.305+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f957008bdc0 con 0x7f95780c2980 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.305+0000 7f9575e00700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f955406ac90 0x7f955406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.305 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.305+0000 7f956fe00700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7f95540745c0 0x7f9554076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.306+0000 7f9575e00700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f955406ac90 0x7f955406d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95780ab9c0 tx=0x7f9568008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.306 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.306+0000 7f956fe00700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7f95540745c0 0x7f9554076ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.307 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.307+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== osd.5 v2:172.21.15.117:6808/44080 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f9554077180 con 0x7f95540745c0 2024-05-10T05:18:34.322 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.322+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 --> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9578074720 con 0x7f95540745c0 2024-05-10T05:18:34.323 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.323+0000 7f956e000700 1 -- 172.21.15.47:0/1273424547 <== osd.5 v2:172.21.15.117:6808/44080 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9578074720 con 0x7f95540745c0 2024-05-10T05:18:34.323 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:34.324 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.323+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7f95540745c0 msgr2=0x7f9554076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.323+0000 7f957d200700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6808/44080,v1:172.21.15.117:6809/44080] conn(0x7f95540745c0 0x7f9554076ab0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f955406ac90 msgr2=0x7f955406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f955406ac90 0x7f955406d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f95780ab9c0 tx=0x7f9568008030 comp rx=0 tx=0).stop 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 msgr2=0x7f95781488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 --2- 172.21.15.47:0/1273424547 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f95780c2980 0x7f95781488c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9570007e70 tx=0x7f957000d3b0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f9576800700 1 -- 172.21.15.47:0/1273424547 reap_dead start 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 shutdown_connections 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 >> 172.21.15.47:0/1273424547 conn(0x7f957806add0 msgr2=0x7f957814ded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 shutdown_connections 2024-05-10T05:18:34.325 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.324+0000 7f957d200700 1 -- 172.21.15.47:0/1273424547 wait complete. 2024-05-10T05:18:34.348 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-10T05:18:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.620+0000 7f0e9be00700 1 Processor -- start 2024-05-10T05:18:34.620 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.620+0000 7f0e9be00700 1 -- start start 2024-05-10T05:18:34.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.621+0000 7f0e9be00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0e9c0c5a00 0x7f0e9c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.621+0000 7f0e9be00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f0e9c1588d0 0x7f0e9c158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.621+0000 7f0e9be00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e9c06cbd0 con 0x7f0e9c155360 2024-05-10T05:18:34.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.621+0000 7f0e9be00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c159660 con 0x7f0e9c0c5a00 2024-05-10T05:18:34.623 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.621+0000 7f0e9be00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e9c06ce20 con 0x7f0e9c1588d0 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0e9c0c5a00 0x7f0e9c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f0e9c0c5a00 0x7f0e9c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56084/0 (socket says 172.21.15.47:56084) 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9b400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f0e9c155360 0x7f0e9c155770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42866/0 (socket says 172.21.15.47:42866) 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 -- 172.21.15.47:0/513670158 learned_addr learned my addr 172.21.15.47:0/513670158 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9a000700 1 --2- 172.21.15.47:0/513670158 >> v2:172.21.15.117:3300/0 conn(0x7f0e9c1588d0 0x7f0e9c158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 -- 172.21.15.47:0/513670158 >> v2:172.21.15.117:3300/0 conn(0x7f0e9c1588d0 msgr2=0x7f0e9c158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 --2- 172.21.15.47:0/513670158 >> v2:172.21.15.117:3300/0 conn(0x7f0e9c1588d0 0x7f0e9c158ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 -- 172.21.15.47:0/513670158 >> v1:172.21.15.47:6789/0 conn(0x7f0e9c155360 legacy=0x7f0e9c155770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.624 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 -- 172.21.15.47:0/513670158 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e9c06d100 con 0x7f0e9c0c5a00 2024-05-10T05:18:34.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e99600700 1 -- 172.21.15.47:0/513670158 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445716080 0 0) 0x7f0e9c06cbd0 con 0x7f0e9c155360 2024-05-10T05:18:34.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.622+0000 7f0e9aa00700 1 --2- 172.21.15.47:0/513670158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c1529e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c08b900 tx=0x7f0e8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79c68cb9cd936da server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e99600700 1 -- 172.21.15.47:0/513670158 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c011830 con 0x7f0e9c0c5a00 2024-05-10T05:18:34.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e99600700 1 -- 172.21.15.47:0/513670158 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c011990 con 0x7f0e9c0c5a00 2024-05-10T05:18:34.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e99600700 1 -- 172.21.15.47:0/513670158 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c011d20 con 0x7f0e9c0c5a00 2024-05-10T05:18:34.625 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e9be00700 1 -- 172.21.15.47:0/513670158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c0c5a00 msgr2=0x7f0e9c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e9be00700 1 --2- 172.21.15.47:0/513670158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c1529e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c08b900 tx=0x7f0e8c009bd0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e9be00700 1 -- 172.21.15.47:0/513670158 shutdown_connections 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e9be00700 1 --2- 172.21.15.47:0/513670158 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c1529e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e9be00700 1 --2- 172.21.15.47:0/513670158 >> v2:172.21.15.117:3300/0 conn(0x7f0e9c1588d0 0x7f0e9c158ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.623+0000 7f0e9be00700 1 -- 172.21.15.47:0/513670158 >> 172.21.15.47:0/513670158 conn(0x7f0e9c0ca700 msgr2=0x7f0e9c0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.624+0000 7f0e9be00700 1 -- 172.21.15.47:0/513670158 shutdown_connections 2024-05-10T05:18:34.626 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.624+0000 7f0e9be00700 1 -- 172.21.15.47:0/513670158 wait complete. 2024-05-10T05:18:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.626+0000 7f0e9be00700 1 Processor -- start 2024-05-10T05:18:34.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.626+0000 7f0e9be00700 1 -- start start 2024-05-10T05:18:34.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.627+0000 7f0e9be00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.627+0000 7f0e9be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 0x7f0e9c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.627+0000 7f0e9be00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e9c1588d0 0x7f0e9c0aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.630 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.627+0000 7f0e9be00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c0ab130 con 0x7f0e9c155360 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.627+0000 7f0e9be00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c1df530 con 0x7f0e9c0c5a00 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.627+0000 7f0e9be00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e9c1ec0b0 con 0x7f0e9c1588d0 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 0x7f0e9c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 0x7f0e9c0ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56092/0 (socket says 172.21.15.47:56092) 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 -- 172.21.15.47:0/3659165458 learned_addr learned my addr 172.21.15.47:0/3659165458 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9aa00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9b400700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e9c1588d0 0x7f0e9c0aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 -- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e9c1588d0 msgr2=0x7f0e9c0aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e9c1588d0 0x7f0e9c0aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 -- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e9c0c5a00 msgr2=0x7f0e9c0ab870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c0ab870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.631 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 -- 172.21.15.47:0/3659165458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009550 con 0x7f0e9c155360 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9b400700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e9c1588d0 0x7f0e9c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.628+0000 7f0e9a000700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 0x7f0e9c0ae980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e870 tx=0x7f0e8800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.629+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88009590 con 0x7f0e9c155360 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.629+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88013680 con 0x7f0e9c155360 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.629+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e9c1ec5e0 con 0x7f0e9c155360 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.629+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88013a10 con 0x7f0e9c155360 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.629+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c1dfe70 con 0x7f0e9c155360 2024-05-10T05:18:34.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.630+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9c0ad420 con 0x7f0e9c155360 2024-05-10T05:18:34.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.631+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e88013b70 con 0x7f0e9c155360 2024-05-10T05:18:34.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.632+0000 7f0e92a00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0e7c06acc0 0x7f0e7c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:34.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.632+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0e88089590 con 0x7f0e9c155360 2024-05-10T05:18:34.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.632+0000 7f0e9aa00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0e7c06acc0 0x7f0e7c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:34.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.633+0000 7f0e9aa00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0e7c06acc0 0x7f0e7c06d1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c014040 tx=0x7f0e8c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:34.637 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.637+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f0e880543a0 con 0x7f0e9c155360 2024-05-10T05:18:34.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.852+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e9c0c8600 con 0x7f0e7c06acc0 2024-05-10T05:18:34.853 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.853+0000 7f0e92a00700 1 -- 172.21.15.47:0/3659165458 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0e8c011b80 con 0x7f0e7c06acc0 2024-05-10T05:18:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0e7c06acc0 msgr2=0x7f0e7c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.856 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0e7c06acc0 0x7f0e7c06d1d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c014040 tx=0x7f0e8c008030 comp rx=0 tx=0).stop 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 msgr2=0x7f0e9c0ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 0x7f0e9c0ae980 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e870 tx=0x7f0e8800eb80 comp rx=0 tx=0).stop 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 shutdown_connections 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f0e7c06acc0 0x7f0e7c06d1d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f0e9c1588d0 0x7f0e9c0aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f0e9c0c5a00 0x7f0e9c0ab870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 --2- 172.21.15.47:0/3659165458 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f0e9c155360 0x7f0e9c0ae980 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 >> 172.21.15.47:0/3659165458 conn(0x7f0e9c0ca700 msgr2=0x7f0e9c154ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 shutdown_connections 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:34.856+0000 7f0e9be00700 1 -- 172.21.15.47:0/3659165458 wait complete. 2024-05-10T05:18:34.857 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 5 to deep-scrub 2024-05-10T05:18:34.884 INFO:tasks.ceph:Scrubbing osd.6 2024-05-10T05:18:34.885 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:35.160 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.160+0000 7f3929600700 1 Processor -- start 2024-05-10T05:18:35.161 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.160+0000 7f3929600700 1 -- start start 2024-05-10T05:18:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3929600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f39240c0f70 0x7f39240c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3929600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3924072ff0 con 0x7f39240c2660 2024-05-10T05:18:35.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3929600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3924072110 con 0x7f3924152d20 2024-05-10T05:18:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3929600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39240732d0 con 0x7f39240c0f70 2024-05-10T05:18:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3922000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f39240c2660 0x7f3924158b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42868/0 (socket says 172.21.15.47:42868) 2024-05-10T05:18:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3922000700 1 -- 172.21.15.47:0/1154917729 learned_addr learned my addr 172.21.15.47:0/1154917729 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:35.163 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.162+0000 7f3922a00700 1 --2- 172.21.15.47:0/1154917729 >> v2:172.21.15.117:3300/0 conn(0x7f39240c0f70 0x7f39240c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187323088 0 0) 0x7f3924072ff0 con 0x7f39240c2660 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39080035b0 con 0x7f39240c2660 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518753231 0 0) 0x7f3924072110 con 0x7f3924152d20 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3924072ff0 con 0x7f3924152d20 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1027641796 0 0) 0x7f39080035b0 con 0x7f39240c2660 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3922a00700 1 -- 172.21.15.47:0/1154917729 >> v1:172.21.15.117:6789/0 conn(0x7f3924152d20 legacy=0x7f3924159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.164 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3922a00700 1 -- 172.21.15.47:0/1154917729 >> v1:172.21.15.47:6789/0 conn(0x7f39240c2660 legacy=0x7f3924158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3922a00700 1 -- 172.21.15.47:0/1154917729 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39240723f0 con 0x7f39240c0f70 2024-05-10T05:18:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.163+0000 7f3922a00700 1 --2- 172.21.15.47:0/1154917729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39240c0f70 0x7f39240c2120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3914009840 tx=0x7f3914009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1886c2c50c9f76c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910001670 con 0x7f39240c0f70 2024-05-10T05:18:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3914004030 con 0x7f39240c0f70 2024-05-10T05:18:35.165 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3921600700 1 -- 172.21.15.47:0/1154917729 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39140043c0 con 0x7f39240c0f70 2024-05-10T05:18:35.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3929600700 1 -- 172.21.15.47:0/1154917729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39240c0f70 msgr2=0x7f39240c2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3929600700 1 --2- 172.21.15.47:0/1154917729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39240c0f70 0x7f39240c2120 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3914009840 tx=0x7f3914009b50 comp rx=0 tx=0).stop 2024-05-10T05:18:35.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3929600700 1 -- 172.21.15.47:0/1154917729 shutdown_connections 2024-05-10T05:18:35.166 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3929600700 1 --2- 172.21.15.47:0/1154917729 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f39240c0f70 0x7f39240c2120 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.164+0000 7f3929600700 1 -- 172.21.15.47:0/1154917729 >> 172.21.15.47:0/1154917729 conn(0x7f39240c4220 msgr2=0x7f39240c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:35.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.165+0000 7f3929600700 1 -- 172.21.15.47:0/1154917729 shutdown_connections 2024-05-10T05:18:35.167 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.165+0000 7f3929600700 1 -- 172.21.15.47:0/1154917729 wait complete. 2024-05-10T05:18:35.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.167+0000 7f3929600700 1 Processor -- start 2024-05-10T05:18:35.168 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.167+0000 7f3929600700 1 -- start start 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.168+0000 7f3929600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39240c0f70 0x7f3924154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.168+0000 7f3929600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39240c2660 0x7f39241eec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.168+0000 7f3929600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3924152d20 0x7f3924153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.168+0000 7f3929600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241ef510 con 0x7f39240c2660 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.168+0000 7f3929600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39241ef7f0 con 0x7f3924152d20 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.168+0000 7f3929600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39240a87d0 con 0x7f39240c0f70 2024-05-10T05:18:35.171 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39240c2660 0x7f39241eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39240c2660 0x7f39241eec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56096/0 (socket says 172.21.15.47:56096) 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 -- 172.21.15.47:0/994252945 learned_addr learned my addr 172.21.15.47:0/994252945 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922a00700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39240c0f70 0x7f3924154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3923400700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3924152d20 0x7f3924153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 -- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39240c0f70 msgr2=0x7f3924154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f39240c0f70 0x7f3924154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 -- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3924152d20 msgr2=0x7f3924153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3924152d20 0x7f3924153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 -- 172.21.15.47:0/994252945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39140094a0 con 0x7f39240c2660 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f3922000700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39240c2660 0x7f39241eec50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f391000c700 tx=0x7f391000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.169+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910004c80 con 0x7f39240c2660 2024-05-10T05:18:35.172 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.170+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3910004de0 con 0x7f39240c2660 2024-05-10T05:18:35.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.170+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39100072d0 con 0x7f39240c2660 2024-05-10T05:18:35.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.170+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39240a8ab0 con 0x7f39240c2660 2024-05-10T05:18:35.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.170+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39240a9070 con 0x7f39240c2660 2024-05-10T05:18:35.173 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.171+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3924072c80 con 0x7f39240c2660 2024-05-10T05:18:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.172+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3910007430 con 0x7f39240c2660 2024-05-10T05:18:35.174 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.173+0000 7f391aa00700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f390406ac90 0x7f390406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.173+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3910089300 con 0x7f39240c2660 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.173+0000 7f391aa00700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f39040745c0 0x7f3904076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.173+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 --> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3904077180 con 0x7f39040745c0 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.173+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f391008b8e0 con 0x7f39240c2660 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.173+0000 7f3922a00700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f390406ac90 0x7f390406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.174+0000 7f3923400700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f39040745c0 0x7f3904076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.174+0000 7f3922a00700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f390406ac90 0x7f390406d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3914009840 tx=0x7f3914008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.175 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.174+0000 7f3923400700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f39040745c0 0x7f3904076ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.176 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.175+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== osd.6 v2:172.21.15.117:6816/44081 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f3904077180 con 0x7f39040745c0 2024-05-10T05:18:35.191 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.191+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 --> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f39240a9230 con 0x7f39040745c0 2024-05-10T05:18:35.192 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.192+0000 7f391aa00700 1 -- 172.21.15.47:0/994252945 <== osd.6 v2:172.21.15.117:6816/44081 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f39240a9230 con 0x7f39040745c0 2024-05-10T05:18:35.193 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:35.193 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:35.193 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:35.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f39040745c0 msgr2=0x7f3904076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6816/44081,v1:172.21.15.117:6817/44081] conn(0x7f39040745c0 0x7f3904076ab0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f390406ac90 msgr2=0x7f390406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.196 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f390406ac90 0x7f390406d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3914009840 tx=0x7f3914008030 comp rx=0 tx=0).stop 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39240c2660 msgr2=0x7f39241eec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 --2- 172.21.15.47:0/994252945 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f39240c2660 0x7f39241eec50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f391000c700 tx=0x7f391000ca10 comp rx=0 tx=0).stop 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3923400700 1 -- 172.21.15.47:0/994252945 reap_dead start 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 shutdown_connections 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 >> 172.21.15.47:0/994252945 conn(0x7f39240c4220 msgr2=0x7f3924152180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 shutdown_connections 2024-05-10T05:18:35.197 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.193+0000 7f3929600700 1 -- 172.21.15.47:0/994252945 wait complete. 2024-05-10T05:18:35.218 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-10T05:18:35.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.493+0000 7f31f2000700 1 Processor -- start 2024-05-10T05:18:35.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.493+0000 7f31f2000700 1 -- start start 2024-05-10T05:18:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.494+0000 7f31f2000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec152e00 0x7f31ec159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31f2000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31ec06e810 0x7f31ec159540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31f2000700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec06ee90 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31f2000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec158bb0 con 0x7f31ec06e810 2024-05-10T05:18:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31f2000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec159a80 con 0x7f31ec152e00 2024-05-10T05:18:35.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31ec06e810 0x7f31ec159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f31ec06e810 0x7f31ec159540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56108/0 (socket says 172.21.15.47:56108) 2024-05-10T05:18:35.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 -- 172.21.15.47:0/289042860 learned_addr learned my addr 172.21.15.47:0/289042860 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:35.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31eaa00700 1 --2- 172.21.15.47:0/289042860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec152e00 0x7f31ec159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 -- 172.21.15.47:0/289042860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec152e00 msgr2=0x7f31ec159000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 --2- 172.21.15.47:0/289042860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec152e00 0x7f31ec159000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 -- 172.21.15.47:0/289042860 >> v1:172.21.15.117:6789/0 conn(0x7f31ec0c0bc0 legacy=0x7f31ec06abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.495+0000 7f31ebe00700 1 -- 172.21.15.47:0/289042860 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec06f5e0 con 0x7f31ec06e810 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.496+0000 7f31ebe00700 1 --2- 172.21.15.47:0/289042860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec06e810 0x7f31ec159540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f836568c0e027935 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.496+0000 7f31ea000700 1 -- 172.21.15.47:0/289042860 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400e070 con 0x7f31ec06e810 2024-05-10T05:18:35.497 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.496+0000 7f31ea000700 1 -- 172.21.15.47:0/289042860 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e400b910 con 0x7f31ec06e810 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.496+0000 7f31ea000700 1 -- 172.21.15.47:0/289042860 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400bcc0 con 0x7f31ec06e810 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 -- 172.21.15.47:0/289042860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec06e810 msgr2=0x7f31ec159540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 --2- 172.21.15.47:0/289042860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec06e810 0x7f31ec159540 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f31e4009e50 tx=0x7f31e400b330 comp rx=0 tx=0).stop 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 -- 172.21.15.47:0/289042860 shutdown_connections 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 --2- 172.21.15.47:0/289042860 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec06e810 0x7f31ec159540 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 --2- 172.21.15.47:0/289042860 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec152e00 0x7f31ec159000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 -- 172.21.15.47:0/289042860 >> 172.21.15.47:0/289042860 conn(0x7f31ec06c330 msgr2=0x7f31ec0a9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 -- 172.21.15.47:0/289042860 shutdown_connections 2024-05-10T05:18:35.498 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.497+0000 7f31f2000700 1 -- 172.21.15.47:0/289042860 wait complete. 2024-05-10T05:18:35.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.499+0000 7f31f2000700 1 Processor -- start 2024-05-10T05:18:35.499 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.499+0000 7f31f2000700 1 -- start start 2024-05-10T05:18:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.500+0000 7f31f2000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec06e810 0x7f31ec1ec030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.500+0000 7f31f2000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 0x7f31ec14edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.500+0000 7f31f2000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ec152e00 0x7f31ec14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.500+0000 7f31f2000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a67e0 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.502 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.500+0000 7f31f2000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0aac90 con 0x7f31ec152e00 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.500+0000 7f31f2000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0a74b0 con 0x7f31ec06e810 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 0x7f31ec14edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 0x7f31ec14edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56118/0 (socket says 172.21.15.47:56118) 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 -- 172.21.15.47:0/3297685979 learned_addr learned my addr 172.21.15.47:0/3297685979 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eb400700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec06e810 0x7f31ec1ec030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31ebe00700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ec152e00 0x7f31ec14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 -- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec06e810 msgr2=0x7f31ec1ec030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec06e810 0x7f31ec1ec030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 -- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ec152e00 msgr2=0x7f31ec14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ec152e00 0x7f31ec14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.501+0000 7f31eaa00700 1 -- 172.21.15.47:0/3297685979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e4009b30 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.502+0000 7f31eaa00700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 0x7f31ec14edd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e8d0 tx=0x7f31d800ebe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.502+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8009590 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.502+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d8013680 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.503 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.502+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80139f0 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.502+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec0a7650 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.502+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec0a9470 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.503+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0a6a50 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.504 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.504+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f31d8013b50 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.505+0000 7f31e3400700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f31cc06acc0 0x7f31cc06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.505+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31d8089900 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.505 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.505+0000 7f31eb400700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f31cc06acc0 0x7f31cc06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:35.506 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.506+0000 7f31eb400700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f31cc06acc0 0x7f31cc06d1d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007fd0 tx=0x7f31dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:35.510 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.509+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f31d8054680 con 0x7f31ec0c0bc0 2024-05-10T05:18:35.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.723+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f31ec1596c0 con 0x7f31cc06acc0 2024-05-10T05:18:35.724 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.724+0000 7f31e3400700 1 -- 172.21.15.47:0/3297685979 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f31ec1596c0 con 0x7f31cc06acc0 2024-05-10T05:18:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.726+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f31cc06acc0 msgr2=0x7f31cc06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.726+0000 7f31f2000700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f31cc06acc0 0x7f31cc06d1d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f31dc007fd0 tx=0x7f31dc009040 comp rx=0 tx=0).stop 2024-05-10T05:18:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.726+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 msgr2=0x7f31ec14edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.726+0000 7f31f2000700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 0x7f31ec14edd0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f31d800e8d0 tx=0x7f31d800ebe0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 shutdown_connections 2024-05-10T05:18:35.727 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f31ec152e00 0x7f31ec14e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f31cc06acc0 0x7f31cc06d1d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f31ec06e810 0x7f31ec1ec030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 --2- 172.21.15.47:0/3297685979 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f31ec0c0bc0 0x7f31ec14edd0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 >> 172.21.15.47:0/3297685979 conn(0x7f31ec06c330 msgr2=0x7f31ec06abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 shutdown_connections 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:35.727+0000 7f31f2000700 1 -- 172.21.15.47:0/3297685979 wait complete. 2024-05-10T05:18:35.728 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 6 to deep-scrub 2024-05-10T05:18:35.755 INFO:tasks.ceph:Scrubbing osd.7 2024-05-10T05:18:35.756 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-10T05:18:36.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.034+0000 7f72a3e00700 1 Processor -- start 2024-05-10T05:18:36.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.034+0000 7f72a3e00700 1 -- start start 2024-05-10T05:18:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.035+0000 7f72a3e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f729c152e60 0x7f729c158c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.035+0000 7f72a3e00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0c78e0 con 0x7f729c0c72a0 2024-05-10T05:18:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.035+0000 7f72a3e00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f729c0c34d0 con 0x7f729c0c7fd0 2024-05-10T05:18:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.035+0000 7f72a3e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f729c156730 con 0x7f729c152e60 2024-05-10T05:18:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f72a0a00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f729c0c72a0 0x7f729c0c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42872/0 (socket says 172.21.15.47:42872) 2024-05-10T05:18:36.036 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f72a0a00700 1 -- 172.21.15.47:0/2185876595 learned_addr learned my addr 172.21.15.47:0/2185876595 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f72a1e00700 1 --2- 172.21.15.47:0/2185876595 >> v2:172.21.15.117:3300/0 conn(0x7f729c152e60 0x7f729c158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f729be00700 1 -- 172.21.15.47:0/2185876595 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4090136730 0 0) 0x7f729c0c78e0 con 0x7f729c0c72a0 2024-05-10T05:18:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f729be00700 1 -- 172.21.15.47:0/2185876595 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72840035b0 con 0x7f729c0c72a0 2024-05-10T05:18:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f72a1e00700 1 -- 172.21.15.47:0/2185876595 >> v1:172.21.15.117:6789/0 conn(0x7f729c0c7fd0 legacy=0x7f729c156020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.037 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f72a1e00700 1 -- 172.21.15.47:0/2185876595 >> v1:172.21.15.47:6789/0 conn(0x7f729c0c72a0 legacy=0x7f729c0c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.036+0000 7f72a1e00700 1 -- 172.21.15.47:0/2185876595 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c0c37b0 con 0x7f729c152e60 2024-05-10T05:18:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.037+0000 7f72a1e00700 1 --2- 172.21.15.47:0/2185876595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c152e60 0x7f729c158c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27fdaf44e005639e server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.037+0000 7f729be00700 1 -- 172.21.15.47:0/2185876595 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729400e070 con 0x7f729c152e60 2024-05-10T05:18:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.037+0000 7f729be00700 1 -- 172.21.15.47:0/2185876595 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729400bb20 con 0x7f729c152e60 2024-05-10T05:18:36.038 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.037+0000 7f729be00700 1 -- 172.21.15.47:0/2185876595 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7294012430 con 0x7f729c152e60 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 -- 172.21.15.47:0/2185876595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c152e60 msgr2=0x7f729c158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 --2- 172.21.15.47:0/2185876595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c152e60 0x7f729c158c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7294009d90 tx=0x7f729400b330 comp rx=0 tx=0).stop 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 -- 172.21.15.47:0/2185876595 shutdown_connections 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 --2- 172.21.15.47:0/2185876595 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c152e60 0x7f729c158c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 -- 172.21.15.47:0/2185876595 >> 172.21.15.47:0/2185876595 conn(0x7f729c0aa340 msgr2=0x7f729c0aa750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 -- 172.21.15.47:0/2185876595 shutdown_connections 2024-05-10T05:18:36.039 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.038+0000 7f72a3e00700 1 -- 172.21.15.47:0/2185876595 wait complete. 2024-05-10T05:18:36.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.040+0000 7f72a3e00700 1 Processor -- start 2024-05-10T05:18:36.040 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.040+0000 7f72a3e00700 1 -- start start 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.041+0000 7f72a3e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c0c72a0 0x7f729c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.041+0000 7f72a3e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729c0c7fd0 0x7f729c1ee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.041+0000 7f72a3e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f729c152e60 0x7f729c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.041+0000 7f72a3e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c155470 con 0x7f729c0c7fd0 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.041+0000 7f72a3e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f729c1ef2f0 con 0x7f729c0c72a0 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.041+0000 7f72a3e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f729c156c10 con 0x7f729c152e60 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729c0c7fd0 0x7f729c1ee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.043 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729c0c7fd0 0x7f729c1ee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56128/0 (socket says 172.21.15.47:56128) 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 -- 172.21.15.47:0/3386025929 learned_addr learned my addr 172.21.15.47:0/3386025929 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a1400700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c0c72a0 0x7f729c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a1e00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f729c152e60 0x7f729c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 -- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f729c152e60 msgr2=0x7f729c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f729c152e60 0x7f729c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 -- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c0c72a0 msgr2=0x7f729c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f729c0c72a0 0x7f729c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.042+0000 7f72a0a00700 1 -- 172.21.15.47:0/3386025929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7294009a70 con 0x7f729c0c7fd0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.043+0000 7f72a0a00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729c0c7fd0 0x7f729c1ee5d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7288001eb0 tx=0x7f728800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.043+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7288005d70 con 0x7f729c0c7fd0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.043+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f728800ce70 con 0x7f729c0c7fd0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.043+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72880072d0 con 0x7f729c0c7fd0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.043+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f729c14e350 con 0x7f729c0c7fd0 2024-05-10T05:18:36.044 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.043+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f729c1ebbe0 con 0x7f729c0c7fd0 2024-05-10T05:18:36.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.044+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f729c155b00 con 0x7f729c0c7fd0 2024-05-10T05:18:36.045 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.045+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7288007430 con 0x7f729c0c7fd0 2024-05-10T05:18:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.046+0000 7f7299600700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727c06ac90 0x7f727c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.046+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7288088b60 con 0x7f729c0c7fd0 2024-05-10T05:18:36.046 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.046+0000 7f7299600700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7f727c0745c0 0x7f727c076ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.046+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 --> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f727c077180 con 0x7f727c0745c0 2024-05-10T05:18:36.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.046+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f728808d2a0 con 0x7f729c0c7fd0 2024-05-10T05:18:36.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.046+0000 7f72a1400700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727c06ac90 0x7f727c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.047+0000 7f72a1e00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7f727c0745c0 0x7f727c076ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.047+0000 7f72a1400700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727c06ac90 0x7f727c06d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.047 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.047+0000 7f72a1e00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7f727c0745c0 0x7f727c076ab0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.048 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.048+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== osd.7 v2:172.21.15.117:6824/44082 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26118 (crc 0 0 0) 0x7f727c077180 con 0x7f727c0745c0 2024-05-10T05:18:36.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.063+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 --> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f729c06def0 con 0x7f727c0745c0 2024-05-10T05:18:36.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.064+0000 7f7299600700 1 -- 172.21.15.47:0/3386025929 <== osd.7 v2:172.21.15.117:6824/44082 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f729c06def0 con 0x7f727c0745c0 2024-05-10T05:18:36.065 INFO:teuthology.orchestra.run.smithi047.stdout:{ 2024-05-10T05:18:36.065 INFO:teuthology.orchestra.run.smithi047.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-10T05:18:36.065 INFO:teuthology.orchestra.run.smithi047.stdout:} 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.064+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7f727c0745c0 msgr2=0x7f727c076ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.064+0000 7f72a3e00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6824/44082,v1:172.21.15.117:6825/44082] conn(0x7f727c0745c0 0x7f727c076ab0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727c06ac90 msgr2=0x7f727c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f727c06ac90 0x7f727c06d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7290007fd0 tx=0x7f7290009040 comp rx=0 tx=0).stop 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729c0c7fd0 msgr2=0x7f729c1ee5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 --2- 172.21.15.47:0/3386025929 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f729c0c7fd0 0x7f729c1ee5d0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f7288001eb0 tx=0x7f728800c7b0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a1e00700 1 -- 172.21.15.47:0/3386025929 reap_dead start 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 shutdown_connections 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 >> 172.21.15.47:0/3386025929 conn(0x7f729c0aa340 msgr2=0x7f729c0c5100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 shutdown_connections 2024-05-10T05:18:36.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.065+0000 7f72a3e00700 1 -- 172.21.15.47:0/3386025929 wait complete. 2024-05-10T05:18:36.093 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-10T05:18:36.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.365+0000 7f3b57e00700 1 Processor -- start 2024-05-10T05:18:36.366 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.365+0000 7f3b57e00700 1 -- start start 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b57e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500c6d90 0x7f3b50155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b57e00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f3b500ca8f0 0x7f3b500cad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b57e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b500c3600 0x7f3b500c3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b57e00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500c50e0 con 0x7f3b500c3600 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b57e00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b500c31e0 con 0x7f3b500ca8f0 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b57e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b500c5340 con 0x7f3b500c6d90 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b55e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b500c3600 0x7f3b500c3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b55e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f3b500c3600 0x7f3b500c3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56138/0 (socket says 172.21.15.47:56138) 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b55e00700 1 -- 172.21.15.47:0/249297549 learned_addr learned my addr 172.21.15.47:0/249297549 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b55400700 1 --2- 172.21.15.47:0/249297549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500c6d90 0x7f3b50155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.369 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.367+0000 7f3b54a00700 1 --2- 172.21.15.47:0/249297549 >> v2:172.21.15.117:3300/0 conn(0x7f3b500ca8f0 0x7f3b500cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b55e00700 1 -- 172.21.15.47:0/249297549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500c6d90 msgr2=0x7f3b50155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b55e00700 1 --2- 172.21.15.47:0/249297549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500c6d90 0x7f3b50155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b55e00700 1 -- 172.21.15.47:0/249297549 >> v2:172.21.15.117:3300/0 conn(0x7f3b500ca8f0 msgr2=0x7f3b500cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b55e00700 1 --2- 172.21.15.47:0/249297549 >> v2:172.21.15.117:3300/0 conn(0x7f3b500ca8f0 0x7f3b500cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b55e00700 1 -- 172.21.15.47:0/249297549 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b500c5620 con 0x7f3b500c3600 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b55e00700 1 --2- 172.21.15.47:0/249297549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c3600 0x7f3b500c3a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b500cb4b0 tx=0x7f3b4800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ae01c3f9351dc1 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.368+0000 7f3b4fe00700 1 -- 172.21.15.47:0/249297549 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800e070 con 0x7f3b500c3600 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b4fe00700 1 -- 172.21.15.47:0/249297549 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4800b910 con 0x7f3b500c3600 2024-05-10T05:18:36.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b4fe00700 1 -- 172.21.15.47:0/249297549 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4800bcc0 con 0x7f3b500c3600 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 -- 172.21.15.47:0/249297549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c3600 msgr2=0x7f3b500c3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 --2- 172.21.15.47:0/249297549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c3600 0x7f3b500c3a10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3b500cb4b0 tx=0x7f3b4800b330 comp rx=0 tx=0).stop 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 -- 172.21.15.47:0/249297549 shutdown_connections 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 --2- 172.21.15.47:0/249297549 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500c6d90 0x7f3b50155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 --2- 172.21.15.47:0/249297549 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c3600 0x7f3b500c3a10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 --2- 172.21.15.47:0/249297549 >> v2:172.21.15.117:3300/0 conn(0x7f3b500ca8f0 0x7f3b500cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.371 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 -- 172.21.15.47:0/249297549 >> 172.21.15.47:0/249297549 conn(0x7f3b500c7620 msgr2=0x7f3b500c7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:36.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.369+0000 7f3b57e00700 1 -- 172.21.15.47:0/249297549 shutdown_connections 2024-05-10T05:18:36.372 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.370+0000 7f3b57e00700 1 -- 172.21.15.47:0/249297549 wait complete. 2024-05-10T05:18:36.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.372+0000 7f3b57e00700 1 Processor -- start 2024-05-10T05:18:36.373 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.372+0000 7f3b57e00700 1 -- start start 2024-05-10T05:18:36.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b57e00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b500c3600 0x7f3b50146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b57e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 0x7f3b501570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b57e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500ca8f0 0x7f3b50154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b57e00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501404e0 con 0x7f3b500c6d90 2024-05-10T05:18:36.376 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b57e00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b501408a0 con 0x7f3b500c3600 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b57e00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b50158500 con 0x7f3b500ca8f0 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b54a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 0x7f3b501570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b54a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 0x7f3b501570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56142/0 (socket says 172.21.15.47:56142) 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.374+0000 7f3b54a00700 1 -- 172.21.15.47:0/646274804 learned_addr learned my addr 172.21.15.47:0/646274804 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b55400700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b500c3600 0x7f3b50146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b55e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500ca8f0 0x7f3b50154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b54a00700 1 -- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500ca8f0 msgr2=0x7f3b50154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b54a00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500ca8f0 0x7f3b50154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b54a00700 1 -- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b500c3600 msgr2=0x7f3b50146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b54a00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b500c3600 0x7f3b50146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b54a00700 1 -- 172.21.15.47:0/646274804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b48009b30 con 0x7f3b500c6d90 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b54a00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 0x7f3b501570c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00e870 tx=0x7f3b3c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.377 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.375+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c009590 con 0x7f3b500c6d90 2024-05-10T05:18:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.376+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c013680 con 0x7f3b500c6d90 2024-05-10T05:18:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.376+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b50140650 con 0x7f3b500c6d90 2024-05-10T05:18:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.376+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c013a30 con 0x7f3b500c6d90 2024-05-10T05:18:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.376+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b50156900 con 0x7f3b500c6d90 2024-05-10T05:18:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.377+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b50074720 con 0x7f3b500c6d90 2024-05-10T05:18:36.378 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.378+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b3c013b90 con 0x7f3b500c6d90 2024-05-10T05:18:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.379+0000 7f3b4d600700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3b3006acc0 0x7f3b3006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.379+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b3c089930 con 0x7f3b500c6d90 2024-05-10T05:18:36.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.379+0000 7f3b55400700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3b3006acc0 0x7f3b3006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.380 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.380+0000 7f3b55400700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3b3006acc0 0x7f3b3006d1d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008cbb0 tx=0x7f3b44009210 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.383 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.383+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f3b3c054620 con 0x7f3b500c6d90 2024-05-10T05:18:36.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.595+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b500c5ec0 con 0x7f3b3006acc0 2024-05-10T05:18:36.596 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.596+0000 7f3b4d600700 1 -- 172.21.15.47:0/646274804 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b440117b0 con 0x7f3b3006acc0 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3b3006acc0 msgr2=0x7f3b3006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3b3006acc0 0x7f3b3006d1d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3b5008cbb0 tx=0x7f3b44009210 comp rx=0 tx=0).stop 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 msgr2=0x7f3b501570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 0x7f3b501570c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00e870 tx=0x7f3b3c00eb80 comp rx=0 tx=0).stop 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 shutdown_connections 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f3b3006acc0 0x7f3b3006d1d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f3b500ca8f0 0x7f3b50154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f3b500c3600 0x7f3b50146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 --2- 172.21.15.47:0/646274804 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f3b500c6d90 0x7f3b501570c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 >> 172.21.15.47:0/646274804 conn(0x7f3b500c7620 msgr2=0x7f3b500c0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 shutdown_connections 2024-05-10T05:18:36.600 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.599+0000 7f3b57e00700 1 -- 172.21.15.47:0/646274804 wait complete. 2024-05-10T05:18:36.601 INFO:teuthology.orchestra.run.smithi047.stderr:instructed osd(s) 7 to deep-scrub 2024-05-10T05:18:36.628 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:18:36.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.900+0000 7eff1b400700 1 Processor -- start 2024-05-10T05:18:36.901 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.900+0000 7eff1b400700 1 -- start start 2024-05-10T05:18:36.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.902+0000 7eff1b400700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7eff140c9440 0x7eff14158b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.902+0000 7eff1b400700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1406c7c0 con 0x7eff14159050 2024-05-10T05:18:36.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.902+0000 7eff1b400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff1406d060 con 0x7eff140c5c40 2024-05-10T05:18:36.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.902+0000 7eff1b400700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff14159890 con 0x7eff140c9440 2024-05-10T05:18:36.903 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.902+0000 7eff19400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7eff14159050 0x7eff1415fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:42886/0 (socket says 172.21.15.47:42886) 2024-05-10T05:18:36.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.902+0000 7eff19400700 1 -- 172.21.15.47:0/3758751646 learned_addr learned my addr 172.21.15.47:0/3758751646 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:36.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13e00700 1 --2- 172.21.15.47:0/3758751646 >> v2:172.21.15.117:3300/0 conn(0x7eff140c9440 0x7eff14158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771603187 0 0) 0x7eff1406c7c0 con 0x7eff14159050 2024-05-10T05:18:36.904 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efefc0035b0 con 0x7eff14159050 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210577337 0 0) 0x7efefc0035b0 con 0x7eff14159050 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 >> v2:172.21.15.117:3300/0 conn(0x7eff140c9440 msgr2=0x7eff14158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 --2- 172.21.15.47:0/3758751646 >> v2:172.21.15.117:3300/0 conn(0x7eff140c9440 0x7eff14158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 >> v1:172.21.15.117:6789/0 conn(0x7eff140c5c40 legacy=0x7eff140c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 --> v1:172.21.15.47:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1406ca10 con 0x7eff14159050 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 <== mon.0 v1:172.21.15.47:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 306557055 0 0) 0x7eff0c0019f0 con 0x7eff14159050 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13e00700 1 --2- 172.21.15.47:0/3758751646 >> v2:172.21.15.117:3300/0 conn(0x7eff140c9440 0x7eff14158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 >> v1:172.21.15.47:6789/0 conn(0x7eff14159050 legacy=0x7eff1415fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efefc003a00 0x7efefc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efefc004850 0x7efefc004c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc0053a0 0x7efefc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff14159890 con 0x7efefc004850 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efefc00c2d0 con 0x7efefc0053a0 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.903+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efefc00c490 con 0x7efefc003a00 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efefc004850 0x7efefc004c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff18a00700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efefc003a00 0x7efefc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff19400700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc0053a0 0x7efefc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 -- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efefc003a00 msgr2=0x7efefc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7efefc003a00 0x7efefc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 -- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc0053a0 msgr2=0x7efefc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:36.908 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc0053a0 0x7efefc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff19400700 1 -- 172.21.15.47:0/3758751646 reap_dead start 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 -- 172.21.15.47:0/3758751646 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc0035b0 con 0x7efefc004850 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.904+0000 7eff13e00700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efefc004850 0x7efefc004c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7eff00009d30 tx=0x7efefc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf34505d0a5cd1f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00009e80 con 0x7efefc004850 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0000e9a0 con 0x7efefc004850 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff13400700 1 -- 172.21.15.47:0/3758751646 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0000ed10 con 0x7efefc004850 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff1b400700 1 -- 172.21.15.47:0/3758751646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efefc004850 msgr2=0x7efefc004c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff1b400700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efefc004850 0x7efefc004c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7eff00009d30 tx=0x7efefc005880 comp rx=0 tx=0).stop 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff1b400700 1 -- 172.21.15.47:0/3758751646 shutdown_connections 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff1b400700 1 --2- 172.21.15.47:0/3758751646 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7efefc004850 0x7efefc004c60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.905+0000 7eff1b400700 1 -- 172.21.15.47:0/3758751646 >> 172.21.15.47:0/3758751646 conn(0x7eff140ca940 msgr2=0x7eff140cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.906+0000 7eff1b400700 1 -- 172.21.15.47:0/3758751646 shutdown_connections 2024-05-10T05:18:36.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.906+0000 7eff1b400700 1 -- 172.21.15.47:0/3758751646 wait complete. 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.908+0000 7eff1b400700 1 Processor -- start 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.908+0000 7eff1b400700 1 -- start start 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.909+0000 7eff1b400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc004850 0x7eff140c4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.909+0000 7eff1b400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 0x7eff140c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.909+0000 7eff1b400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff140c2ce0 0x7eff140c0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.909+0000 7eff1b400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140bfe20 con 0x7eff141deb20 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.909+0000 7eff1b400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff140c0f60 con 0x7efefc004850 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.909+0000 7eff1b400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff141ebc00 con 0x7eff140c2ce0 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 0x7eff140c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 0x7eff140c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56154/0 (socket says 172.21.15.47:56154) 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 -- 172.21.15.47:0/212863989 learned_addr learned my addr 172.21.15.47:0/212863989 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:36.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff19400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff140c2ce0 0x7eff140c0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff18a00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc004850 0x7eff140c4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 -- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff140c2ce0 msgr2=0x7eff140c0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff140c2ce0 0x7eff140c0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 -- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc004850 msgr2=0x7eff140c4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc004850 0x7eff140c4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 -- 172.21.15.47:0/212863989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1414dcd0 con 0x7eff141deb20 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.910+0000 7eff13e00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 0x7eff140c27a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c2a0 tx=0x7eff000047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.911+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00003ab0 con 0x7eff141deb20 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.911+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00003c10 con 0x7eff141deb20 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.911+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff140bfa60 con 0x7eff141deb20 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.911+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00009e80 con 0x7eff141deb20 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.911+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1414e320 con 0x7eff141deb20 2024-05-10T05:18:36.913 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.912+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff14074720 con 0x7eff141deb20 2024-05-10T05:18:36.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.913+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7eff00013470 con 0x7eff141deb20 2024-05-10T05:18:36.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.914+0000 7eff10c00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efef406ac90 0x7efef406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:36.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.914+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff0008afe0 con 0x7eff141deb20 2024-05-10T05:18:36.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.914+0000 7eff18a00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efef406ac90 0x7efef406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:36.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.915+0000 7eff18a00700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efef406ac90 0x7efef406d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff08007fd0 tx=0x7eff08009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:36.920 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:36.919+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7eff00055e10 con 0x7eff141deb20 2024-05-10T05:18:37.129 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.128+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff14152e20 con 0x7efef406ac90 2024-05-10T05:18:37.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.140+0000 7eff10c00700 1 -- 172.21.15.47:0/212863989 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+368946 (secure 0 0 0) 0x7eff14152e20 con 0x7efef406ac90 2024-05-10T05:18:37.145 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.144+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efef406ac90 msgr2=0x7efef406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.144+0000 7eff1b400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efef406ac90 0x7efef406d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7eff08007fd0 tx=0x7eff08009040 comp rx=0 tx=0).stop 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.144+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 msgr2=0x7eff140c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.144+0000 7eff1b400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 0x7eff140c27a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7efefc00c2a0 tx=0x7eff000047c0 comp rx=0 tx=0).stop 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 shutdown_connections 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7efef406ac90 0x7efef406d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7eff140c2ce0 0x7eff140c0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:37.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7efefc004850 0x7eff140c4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:37.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 --2- 172.21.15.47:0/212863989 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7eff141deb20 0x7eff140c27a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:37.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 >> 172.21.15.47:0/212863989 conn(0x7eff140ca940 msgr2=0x7eff140c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:37.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 shutdown_connections 2024-05-10T05:18:37.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:37.145+0000 7eff1b400700 1 -- 172.21.15.47:0/212863989 wait complete. 2024-05-10T05:18:37.150 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:18:37.172 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":827,"stamp":"2024-05-10T05:18:36.691839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235773933,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":4755,"num_read_kb":580569,"num_write":359369,"num_write_kb":31014503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529554,"ondisk_log_size":529554,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7006072,"kb_used_data":462904,"kb_used_omap":12,"kb_used_meta":6543091,"kb_avail":747968648,"statfs":{"total":773094113280,"available":765919895552,"internally_reserved":0,"allocated":474013696,"data_stored":472521330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6700125752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-32682670,"num_objects":-211,"num_object_clones":0,"num_object_copies":-566,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-211,"num_whiteouts":0,"num_read":5,"num_read_kb":17,"num_write":248,"num_write_kb":1780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-93,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004183"},"pg_stats":[{"pgid":"3.3f","version":"28'1987","reported_seq":2015,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.969947+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T05:18:25.969947+0000","last_peered":"2024-05-10T05:18:25.969947+0000","last_clean":"2024-05-10T05:18:25.969947+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:18:25.969947+0000","last_undegraded":"2024-05-10T05:18:25.969947+0000","last_fullsized":"2024-05-10T05:18:25.969947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1980","reported_seq":2009,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.940590+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T05:18:25.940590+0000","last_peered":"2024-05-10T05:18:25.940590+0000","last_clean":"2024-05-10T05:18:25.940590+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:25.940590+0000","last_undegraded":"2024-05-10T05:18:25.940590+0000","last_fullsized":"2024-05-10T05:18:25.940590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2129","reported_seq":2158,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.136920+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T05:18:26.136920+0000","last_peered":"2024-05-10T05:18:26.136920+0000","last_clean":"2024-05-10T05:18:26.136920+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:18:26.136920+0000","last_undegraded":"2024-05-10T05:18:26.136920+0000","last_fullsized":"2024-05-10T05:18:26.136920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2129,"log_dups_size":0,"ondisk_log_size":2129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2105","reported_seq":2134,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.005491+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T05:18:26.005491+0000","last_peered":"2024-05-10T05:18:26.005491+0000","last_clean":"2024-05-10T05:18:26.005491+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:18:26.005491+0000","last_undegraded":"2024-05-10T05:18:26.005491+0000","last_fullsized":"2024-05-10T05:18:26.005491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:36:51.843509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2061","reported_seq":2087,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.942772+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T05:18:25.942772+0000","last_peered":"2024-05-10T05:18:25.942772+0000","last_clean":"2024-05-10T05:18:25.942772+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:18:25.942772+0000","last_undegraded":"2024-05-10T05:18:25.942772+0000","last_fullsized":"2024-05-10T05:18:25.942772+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2061,"log_dups_size":0,"ondisk_log_size":2061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:08:29.248726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1968","reported_seq":1994,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.021279+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T05:18:26.021279+0000","last_peered":"2024-05-10T05:18:26.021279+0000","last_clean":"2024-05-10T05:18:26.021279+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:18:26.021279+0000","last_undegraded":"2024-05-10T05:18:26.021279+0000","last_fullsized":"2024-05-10T05:18:26.021279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:05:11.689723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2006","reported_seq":2032,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.942667+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T05:18:25.942667+0000","last_peered":"2024-05-10T05:18:25.942667+0000","last_clean":"2024-05-10T05:18:25.942667+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:18:25.942667+0000","last_undegraded":"2024-05-10T05:18:25.942667+0000","last_fullsized":"2024-05-10T05:18:25.942667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:43:23.181040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2023","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.005140+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T05:18:26.005140+0000","last_peered":"2024-05-10T05:18:26.005140+0000","last_clean":"2024-05-10T05:18:26.005140+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:18:26.005140+0000","last_undegraded":"2024-05-10T05:18:26.005140+0000","last_fullsized":"2024-05-10T05:18:26.005140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2083","reported_seq":2109,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.021610+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T05:18:26.021610+0000","last_peered":"2024-05-10T05:18:26.021610+0000","last_clean":"2024-05-10T05:18:26.021610+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:18:26.021610+0000","last_undegraded":"2024-05-10T05:18:26.021610+0000","last_fullsized":"2024-05-10T05:18:26.021610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:22:09.790858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2091","reported_seq":2118,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.022981+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T05:18:26.022981+0000","last_peered":"2024-05-10T05:18:26.022981+0000","last_clean":"2024-05-10T05:18:26.022981+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:18:26.022981+0000","last_undegraded":"2024-05-10T05:18:26.022981+0000","last_fullsized":"2024-05-10T05:18:26.022981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:00:13.486103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1958","reported_seq":1985,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.000392+0000","last_change":"2024-05-10T04:51:52.760172+0000","last_active":"2024-05-10T05:18:26.000392+0000","last_peered":"2024-05-10T05:18:26.000392+0000","last_clean":"2024-05-10T05:18:26.000392+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:26.000392+0000","last_undegraded":"2024-05-10T05:18:26.000392+0000","last_fullsized":"2024-05-10T05:18:26.000392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:59.395042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.653549+0000","last_change":"2024-05-10T04:51:52.752194+0000","last_active":"2024-05-10T05:18:26.653549+0000","last_peered":"2024-05-10T05:18:26.653549+0000","last_clean":"2024-05-10T05:18:26.653549+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:26.653549+0000","last_undegraded":"2024-05-10T05:18:26.653549+0000","last_fullsized":"2024-05-10T05:18:26.653549+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2029","reported_seq":2068,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.847677+0000","last_change":"2024-05-10T05:18:33.847792+0000","last_active":"2024-05-10T05:18:33.847677+0000","last_peered":"2024-05-10T05:18:33.847677+0000","last_clean":"2024-05-10T05:18:33.847677+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:33.847677+0000","last_undegraded":"2024-05-10T05:18:33.847677+0000","last_fullsized":"2024-05-10T05:18:33.847677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2029","last_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_deep_scrub":"28'2029","last_deep_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.847651+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:17.105998+0000","scrub_duration":0.018189367000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'2006","reported_seq":2034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.135282+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T05:18:26.135282+0000","last_peered":"2024-05-10T05:18:26.135282+0000","last_clean":"2024-05-10T05:18:26.135282+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:18:26.135282+0000","last_undegraded":"2024-05-10T05:18:26.135282+0000","last_fullsized":"2024-05-10T05:18:26.135282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2108","reported_seq":2136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980583+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T05:18:25.980583+0000","last_peered":"2024-05-10T05:18:25.980583+0000","last_clean":"2024-05-10T05:18:25.980583+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:25.980583+0000","last_undegraded":"2024-05-10T05:18:25.980583+0000","last_fullsized":"2024-05-10T05:18:25.980583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2108,"log_dups_size":0,"ondisk_log_size":2108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1994","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.130691+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T05:18:26.130691+0000","last_peered":"2024-05-10T05:18:26.130691+0000","last_clean":"2024-05-10T05:18:26.130691+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:18:26.130691+0000","last_undegraded":"2024-05-10T05:18:26.130691+0000","last_fullsized":"2024-05-10T05:18:26.130691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:55:51.101418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2070","reported_seq":2097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.024975+0000","last_change":"2024-05-10T04:51:52.766766+0000","last_active":"2024-05-10T05:18:26.024975+0000","last_peered":"2024-05-10T05:18:26.024975+0000","last_clean":"2024-05-10T05:18:26.024975+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:26.024975+0000","last_undegraded":"2024-05-10T05:18:26.024975+0000","last_fullsized":"2024-05-10T05:18:26.024975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:30:33.485598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1994","reported_seq":2022,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.958261+0000","last_change":"2024-05-10T04:51:52.754285+0000","last_active":"2024-05-10T05:18:25.958261+0000","last_peered":"2024-05-10T05:18:25.958261+0000","last_clean":"2024-05-10T05:18:25.958261+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:25.958261+0000","last_undegraded":"2024-05-10T05:18:25.958261+0000","last_fullsized":"2024-05-10T05:18:25.958261+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2104","reported_seq":2131,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.991112+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T05:18:25.991112+0000","last_peered":"2024-05-10T05:18:25.991112+0000","last_clean":"2024-05-10T05:18:25.991112+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:18:25.991112+0000","last_undegraded":"2024-05-10T05:18:25.991112+0000","last_fullsized":"2024-05-10T05:18:25.991112+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:39:00.431957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7882,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.621313+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T05:18:21.621313+0000","last_peered":"2024-05-10T05:18:21.621313+0000","last_clean":"2024-05-10T05:18:21.621313+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:18:21.621313+0000","last_undegraded":"2024-05-10T05:18:21.621313+0000","last_fullsized":"2024-05-10T05:18:21.621313+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1891","reported_seq":1921,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.284347+0000","last_change":"2024-05-10T04:51:52.140421+0000","last_active":"2024-05-10T05:18:23.284347+0000","last_peered":"2024-05-10T05:18:23.284347+0000","last_clean":"2024-05-10T05:18:23.284347+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:23.284347+0000","last_undegraded":"2024-05-10T05:18:23.284347+0000","last_fullsized":"2024-05-10T05:18:23.284347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":1891,"log_dups_size":0,"ondisk_log_size":1891,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1915,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2039","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.932859+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T05:18:25.932859+0000","last_peered":"2024-05-10T05:18:25.932859+0000","last_clean":"2024-05-10T05:18:25.932859+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:18:25.932859+0000","last_undegraded":"2024-05-10T05:18:25.932859+0000","last_fullsized":"2024-05-10T05:18:25.932859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7650,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.233532+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T05:18:23.233532+0000","last_peered":"2024-05-10T05:18:23.233532+0000","last_clean":"2024-05-10T05:18:23.233532+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:18:23.233532+0000","last_undegraded":"2024-05-10T05:18:23.233532+0000","last_fullsized":"2024-05-10T05:18:23.233532+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6434","reported_seq":6465,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.284140+0000","last_change":"2024-05-10T04:51:52.134894+0000","last_active":"2024-05-10T05:18:23.284140+0000","last_peered":"2024-05-10T05:18:23.284140+0000","last_clean":"2024-05-10T05:18:23.284140+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:23.284140+0000","last_undegraded":"2024-05-10T05:18:23.284140+0000","last_fullsized":"2024-05-10T05:18:23.284140+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6334,"log_dups_size":0,"ondisk_log_size":6334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2041","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.129631+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T05:18:26.129631+0000","last_peered":"2024-05-10T05:18:26.129631+0000","last_clean":"2024-05-10T05:18:26.129631+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:26.129631+0000","last_undegraded":"2024-05-10T05:18:26.129631+0000","last_fullsized":"2024-05-10T05:18:26.129631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7723,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.767377+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T05:18:21.767377+0000","last_peered":"2024-05-10T05:18:21.767377+0000","last_clean":"2024-05-10T05:18:21.767377+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:18:21.767377+0000","last_undegraded":"2024-05-10T05:18:21.767377+0000","last_fullsized":"2024-05-10T05:18:21.767377+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9867","reported_seq":9894,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.294683+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T05:18:23.294683+0000","last_peered":"2024-05-10T05:18:23.294683+0000","last_clean":"2024-05-10T05:18:23.294683+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:23.294683+0000","last_undegraded":"2024-05-10T05:18:23.294683+0000","last_fullsized":"2024-05-10T05:18:23.294683+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7067,"log_dups_size":0,"ondisk_log_size":7067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:56:14.455717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9870,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2094","reported_seq":2115,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.994347+0000","last_change":"2024-05-10T04:52:40.336526+0000","last_active":"2024-05-10T05:18:25.994347+0000","last_peered":"2024-05-10T05:18:25.994347+0000","last_clean":"2024-05-10T05:18:25.994347+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:18:25.994347+0000","last_undegraded":"2024-05-10T05:18:25.994347+0000","last_fullsized":"2024-05-10T05:18:25.994347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7500,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.135736+0000","last_change":"2024-05-10T04:51:57.171274+0000","last_active":"2024-05-10T05:18:26.135736+0000","last_peered":"2024-05-10T05:18:26.135736+0000","last_clean":"2024-05-10T05:18:26.135736+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:26.135736+0000","last_undegraded":"2024-05-10T05:18:26.135736+0000","last_fullsized":"2024-05-10T05:18:26.135736+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5469","reported_seq":5496,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.252459+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T05:18:23.252459+0000","last_peered":"2024-05-10T05:18:23.252459+0000","last_clean":"2024-05-10T05:18:23.252459+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:18:23.252459+0000","last_undegraded":"2024-05-10T05:18:23.252459+0000","last_fullsized":"2024-05-10T05:18:23.252459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5469,"log_dups_size":0,"ondisk_log_size":5469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:26:09.696262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5469,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2034","reported_seq":2060,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.023478+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T05:18:26.023478+0000","last_peered":"2024-05-10T05:18:26.023478+0000","last_clean":"2024-05-10T05:18:26.023478+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:18:26.023478+0000","last_undegraded":"2024-05-10T05:18:26.023478+0000","last_fullsized":"2024-05-10T05:18:26.023478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:17:15.305154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7514","reported_seq":7578,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.137852+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T05:18:26.137852+0000","last_peered":"2024-05-10T05:18:26.137852+0000","last_clean":"2024-05-10T05:18:26.137852+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:18:26.137852+0000","last_undegraded":"2024-05-10T05:18:26.137852+0000","last_fullsized":"2024-05-10T05:18:26.137852+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5295,"num_write_kb":976486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8788","reported_seq":8816,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.292910+0000","last_change":"2024-05-10T04:51:52.138996+0000","last_active":"2024-05-10T05:18:23.292910+0000","last_peered":"2024-05-10T05:18:23.292910+0000","last_clean":"2024-05-10T05:18:23.292910+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:23.292910+0000","last_undegraded":"2024-05-10T05:18:23.292910+0000","last_fullsized":"2024-05-10T05:18:23.292910+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6288,"log_dups_size":0,"ondisk_log_size":6288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.136493+0000","last_change":"2024-05-10T04:51:52.751043+0000","last_active":"2024-05-10T05:18:26.136493+0000","last_peered":"2024-05-10T05:18:26.136493+0000","last_clean":"2024-05-10T05:18:26.136493+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:26.136493+0000","last_undegraded":"2024-05-10T05:18:26.136493+0000","last_fullsized":"2024-05-10T05:18:26.136493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.254302+0000","last_change":"2024-05-10T04:52:40.388737+0000","last_active":"2024-05-10T05:18:23.254302+0000","last_peered":"2024-05-10T05:18:23.254302+0000","last_clean":"2024-05-10T05:18:23.254302+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:23.254302+0000","last_undegraded":"2024-05-10T05:18:23.254302+0000","last_fullsized":"2024-05-10T05:18:23.254302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9788","reported_seq":9815,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.287881+0000","last_change":"2024-05-10T04:51:52.135494+0000","last_active":"2024-05-10T05:18:23.287881+0000","last_peered":"2024-05-10T05:18:23.287881+0000","last_clean":"2024-05-10T05:18:23.287881+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:23.287881+0000","last_undegraded":"2024-05-10T05:18:23.287881+0000","last_fullsized":"2024-05-10T05:18:23.287881+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7988,"log_dups_size":0,"ondisk_log_size":7988,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2031","reported_seq":2058,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.985452+0000","last_change":"2024-05-10T04:51:52.753556+0000","last_active":"2024-05-10T05:18:25.985452+0000","last_peered":"2024-05-10T05:18:25.985452+0000","last_clean":"2024-05-10T05:18:25.985452+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:25.985452+0000","last_undegraded":"2024-05-10T05:18:25.985452+0000","last_fullsized":"2024-05-10T05:18:25.985452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7236","reported_seq":7478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.833908+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T05:18:25.833908+0000","last_peered":"2024-05-10T05:18:25.833908+0000","last_clean":"2024-05-10T05:18:25.833908+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:18:25.833908+0000","last_undegraded":"2024-05-10T05:18:25.833908+0000","last_fullsized":"2024-05-10T05:18:25.833908+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:54:48.068101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5149,"num_write_kb":870343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4833","reported_seq":4862,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.110857+0000","last_change":"2024-05-10T04:51:52.131730+0000","last_active":"2024-05-10T05:18:33.110857+0000","last_peered":"2024-05-10T05:18:33.110857+0000","last_clean":"2024-05-10T05:18:33.110857+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:33.110857+0000","last_undegraded":"2024-05-10T05:18:33.110857+0000","last_fullsized":"2024-05-10T05:18:33.110857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4833,"log_dups_size":0,"ondisk_log_size":4833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2106","reported_seq":2134,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.111125+0000","last_change":"2024-05-10T04:51:52.749137+0000","last_active":"2024-05-10T05:18:33.111125+0000","last_peered":"2024-05-10T05:18:33.111125+0000","last_clean":"2024-05-10T05:18:33.111125+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:33.111125+0000","last_undegraded":"2024-05-10T05:18:33.111125+0000","last_fullsized":"2024-05-10T05:18:33.111125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7811,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.692175+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T05:18:21.692175+0000","last_peered":"2024-05-10T05:18:21.692175+0000","last_clean":"2024-05-10T05:18:21.692175+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:18:21.692175+0000","last_undegraded":"2024-05-10T05:18:21.692175+0000","last_fullsized":"2024-05-10T05:18:21.692175+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9719","reported_seq":9746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:16:11.532711+0000","last_change":"2024-05-10T04:51:52.138549+0000","last_active":"2024-05-10T05:16:11.532711+0000","last_peered":"2024-05-10T05:16:11.532711+0000","last_clean":"2024-05-10T05:16:11.532711+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:16:11.532711+0000","last_undegraded":"2024-05-10T05:16:11.532711+0000","last_fullsized":"2024-05-10T05:16:11.532711+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7519,"log_dups_size":0,"ondisk_log_size":7519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:33:31.585408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2011","reported_seq":2038,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.952945+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T05:18:25.952945+0000","last_peered":"2024-05-10T05:18:25.952945+0000","last_clean":"2024-05-10T05:18:25.952945+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:25.952945+0000","last_undegraded":"2024-05-10T05:18:25.952945+0000","last_fullsized":"2024-05-10T05:18:25.952945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.260791+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T05:18:23.260791+0000","last_peered":"2024-05-10T05:18:23.260791+0000","last_clean":"2024-05-10T05:18:23.260791+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:18:23.260791+0000","last_undegraded":"2024-05-10T05:18:23.260791+0000","last_fullsized":"2024-05-10T05:18:23.260791+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6185","reported_seq":6955,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:30.975086+0000","last_change":"2024-05-10T04:51:52.147319+0000","last_active":"2024-05-10T05:18:30.975086+0000","last_peered":"2024-05-10T05:18:30.975086+0000","last_clean":"2024-05-10T05:18:30.975086+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:30.975086+0000","last_undegraded":"2024-05-10T05:18:30.975086+0000","last_fullsized":"2024-05-10T05:18:30.975086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6185,"log_dups_size":0,"ondisk_log_size":6185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11372145,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6181,"num_write_kb":47965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2046","reported_seq":2073,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.936799+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T05:18:25.936799+0000","last_peered":"2024-05-10T05:18:25.936799+0000","last_clean":"2024-05-10T05:18:25.936799+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:18:25.936799+0000","last_undegraded":"2024-05-10T05:18:25.936799+0000","last_fullsized":"2024-05-10T05:18:25.936799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:15:44.067744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7408","reported_seq":7470,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.144245+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T05:18:26.144245+0000","last_peered":"2024-05-10T05:18:26.144245+0000","last_clean":"2024-05-10T05:18:26.144245+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:18:26.144245+0000","last_undegraded":"2024-05-10T05:18:26.144245+0000","last_fullsized":"2024-05-10T05:18:26.144245+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6304,"log_dups_size":0,"ondisk_log_size":6304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5304,"num_write_kb":989379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6457","reported_seq":6485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.288493+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T05:18:23.288493+0000","last_peered":"2024-05-10T05:18:23.288493+0000","last_clean":"2024-05-10T05:18:23.288493+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:18:23.288493+0000","last_undegraded":"2024-05-10T05:18:23.288493+0000","last_fullsized":"2024-05-10T05:18:23.288493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6457,"log_dups_size":0,"ondisk_log_size":6457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:01:59.928104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6459,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2058","reported_seq":2094,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:30.497891+0000","last_change":"2024-05-10T04:52:41.276730+0000","last_active":"2024-05-10T05:18:30.497891+0000","last_peered":"2024-05-10T05:18:30.497891+0000","last_clean":"2024-05-10T05:18:30.497891+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:30.497891+0000","last_undegraded":"2024-05-10T05:18:30.497891+0000","last_fullsized":"2024-05-10T05:18:30.497891+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7621,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.456881+0000","last_change":"2024-05-10T04:51:57.167553+0000","last_active":"2024-05-10T05:18:21.456881+0000","last_peered":"2024-05-10T05:18:21.456881+0000","last_clean":"2024-05-10T05:18:21.456881+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:21.456881+0000","last_undegraded":"2024-05-10T05:18:21.456881+0000","last_fullsized":"2024-05-10T05:18:21.456881+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5960","reported_seq":5989,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.154248+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T05:18:26.154248+0000","last_peered":"2024-05-10T05:18:26.154248+0000","last_clean":"2024-05-10T05:18:26.154248+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:26.154248+0000","last_undegraded":"2024-05-10T05:18:26.154248+0000","last_fullsized":"2024-05-10T05:18:26.154248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5960,"log_dups_size":0,"ondisk_log_size":5960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":37127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2075,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.018103+0000","last_change":"2024-05-10T04:51:52.764936+0000","last_active":"2024-05-10T05:18:26.018103+0000","last_peered":"2024-05-10T05:18:26.018103+0000","last_clean":"2024-05-10T05:18:26.018103+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:26.018103+0000","last_undegraded":"2024-05-10T05:18:26.018103+0000","last_fullsized":"2024-05-10T05:18:26.018103+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7575","reported_seq":7641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.143998+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T05:18:26.143998+0000","last_peered":"2024-05-10T05:18:26.143998+0000","last_clean":"2024-05-10T05:18:26.143998+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:18:26.143998+0000","last_undegraded":"2024-05-10T05:18:26.143998+0000","last_fullsized":"2024-05-10T05:18:26.143998+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7375,"log_dups_size":0,"ondisk_log_size":7375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5441,"num_write_kb":923430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9428","reported_seq":10123,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.284503+0000","last_change":"2024-05-10T04:51:52.140772+0000","last_active":"2024-05-10T05:18:23.284503+0000","last_peered":"2024-05-10T05:18:23.284503+0000","last_clean":"2024-05-10T05:18:23.284503+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:23.284503+0000","last_undegraded":"2024-05-10T05:18:23.284503+0000","last_fullsized":"2024-05-10T05:18:23.284503+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7928,"log_dups_size":0,"ondisk_log_size":7928,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9422,"num_write_kb":67821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1992","reported_seq":2019,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.986484+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T05:18:25.986484+0000","last_peered":"2024-05-10T05:18:25.986484+0000","last_clean":"2024-05-10T05:18:25.986484+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:18:25.986484+0000","last_undegraded":"2024-05-10T05:18:25.986484+0000","last_fullsized":"2024-05-10T05:18:25.986484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:04:48.308370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7643,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771899+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T05:18:21.771899+0000","last_peered":"2024-05-10T05:18:21.771899+0000","last_clean":"2024-05-10T05:18:21.771899+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:18:21.771899+0000","last_undegraded":"2024-05-10T05:18:21.771899+0000","last_fullsized":"2024-05-10T05:18:21.771899+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:08:41.904342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4831","reported_seq":4860,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.280591+0000","last_change":"2024-05-10T04:51:52.139376+0000","last_active":"2024-05-10T05:18:23.280591+0000","last_peered":"2024-05-10T05:18:23.280591+0000","last_clean":"2024-05-10T05:18:23.280591+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:18:23.280591+0000","last_undegraded":"2024-05-10T05:18:23.280591+0000","last_fullsized":"2024-05-10T05:18:23.280591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4831,"log_dups_size":0,"ondisk_log_size":4831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4833,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2054","reported_seq":2082,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.972982+0000","last_change":"2024-05-10T04:51:52.746527+0000","last_active":"2024-05-10T05:18:25.972982+0000","last_peered":"2024-05-10T05:18:25.972982+0000","last_clean":"2024-05-10T05:18:25.972982+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:25.972982+0000","last_undegraded":"2024-05-10T05:18:25.972982+0000","last_fullsized":"2024-05-10T05:18:25.972982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.780712+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T05:18:21.780712+0000","last_peered":"2024-05-10T05:18:21.780712+0000","last_clean":"2024-05-10T05:18:21.780712+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:18:21.780712+0000","last_undegraded":"2024-05-10T05:18:21.780712+0000","last_fullsized":"2024-05-10T05:18:21.780712+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2076","reported_seq":2104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.279408+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T05:18:23.279408+0000","last_peered":"2024-05-10T05:18:23.279408+0000","last_clean":"2024-05-10T05:18:23.279408+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:18:23.279408+0000","last_undegraded":"2024-05-10T05:18:23.279408+0000","last_fullsized":"2024-05-10T05:18:23.279408+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2076,"log_dups_size":0,"ondisk_log_size":2076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:34.006195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2091,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2077","reported_seq":2104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.999922+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T05:18:25.999922+0000","last_peered":"2024-05-10T05:18:25.999922+0000","last_clean":"2024-05-10T05:18:25.999922+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:25.999922+0000","last_undegraded":"2024-05-10T05:18:25.999922+0000","last_fullsized":"2024-05-10T05:18:25.999922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:49:49.545039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7642,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.750337+0000","last_change":"2024-05-10T04:52:41.239639+0000","last_active":"2024-05-10T05:18:21.750337+0000","last_peered":"2024-05-10T05:18:21.750337+0000","last_clean":"2024-05-10T05:18:21.750337+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:18:21.750337+0000","last_undegraded":"2024-05-10T05:18:21.750337+0000","last_fullsized":"2024-05-10T05:18:21.750337+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2468,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.256049+0000","last_change":"2024-05-10T04:51:52.135162+0000","last_active":"2024-05-10T05:18:23.256049+0000","last_peered":"2024-05-10T05:18:23.256049+0000","last_clean":"2024-05-10T05:18:23.256049+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:23.256049+0000","last_undegraded":"2024-05-10T05:18:23.256049+0000","last_fullsized":"2024-05-10T05:18:23.256049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2008","reported_seq":2035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.928316+0000","last_change":"2024-05-10T04:51:52.753534+0000","last_active":"2024-05-10T05:18:25.928316+0000","last_peered":"2024-05-10T05:18:25.928316+0000","last_clean":"2024-05-10T05:18:25.928316+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:25.928316+0000","last_undegraded":"2024-05-10T05:18:25.928316+0000","last_fullsized":"2024-05-10T05:18:25.928316+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:26:30.354547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7497,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.750820+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T05:18:21.750820+0000","last_peered":"2024-05-10T05:18:21.750820+0000","last_clean":"2024-05-10T05:18:21.750820+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:18:21.750820+0000","last_undegraded":"2024-05-10T05:18:21.750820+0000","last_fullsized":"2024-05-10T05:18:21.750820+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3410","reported_seq":3450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.526731+0000","last_change":"2024-05-10T05:18:33.526835+0000","last_active":"2024-05-10T05:18:33.526731+0000","last_peered":"2024-05-10T05:18:33.526731+0000","last_clean":"2024-05-10T05:18:33.526731+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:33.526731+0000","last_undegraded":"2024-05-10T05:18:33.526731+0000","last_fullsized":"2024-05-10T05:18:33.526731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3410","last_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_deep_scrub":"28'3410","last_deep_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.526706+0000","objects_scrubbed":6,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:30.870417+0000","scrub_duration":0.035523645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3414,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2093","reported_seq":2115,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.994534+0000","last_change":"2024-05-10T04:52:40.334760+0000","last_active":"2024-05-10T05:18:25.994534+0000","last_peered":"2024-05-10T05:18:25.994534+0000","last_clean":"2024-05-10T05:18:25.994534+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:18:25.994534+0000","last_undegraded":"2024-05-10T05:18:25.994534+0000","last_fullsized":"2024-05-10T05:18:25.994534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7497,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.702730+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T05:18:21.702730+0000","last_peered":"2024-05-10T05:18:21.702730+0000","last_clean":"2024-05-10T05:18:21.702730+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:18:21.702730+0000","last_undegraded":"2024-05-10T05:18:21.702730+0000","last_fullsized":"2024-05-10T05:18:21.702730+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4732","reported_seq":4772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.007304+0000","last_change":"2024-05-10T05:18:36.007422+0000","last_active":"2024-05-10T05:18:36.007304+0000","last_peered":"2024-05-10T05:18:36.007304+0000","last_clean":"2024-05-10T05:18:36.007304+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:36.007304+0000","last_undegraded":"2024-05-10T05:18:36.007304+0000","last_fullsized":"2024-05-10T05:18:36.007304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4732","last_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_deep_scrub":"28'4732","last_deep_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.007270+0000","objects_scrubbed":4,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:36.412434+0000","scrub_duration":0.047935197999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2048","reported_seq":2075,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.936841+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T05:18:25.936841+0000","last_peered":"2024-05-10T05:18:25.936841+0000","last_clean":"2024-05-10T05:18:25.936841+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:18:25.936841+0000","last_undegraded":"2024-05-10T05:18:25.936841+0000","last_fullsized":"2024-05-10T05:18:25.936841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:11.577505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.776491+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T05:18:21.776491+0000","last_peered":"2024-05-10T05:18:21.776491+0000","last_clean":"2024-05-10T05:18:21.776491+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:18:21.776491+0000","last_undegraded":"2024-05-10T05:18:21.776491+0000","last_fullsized":"2024-05-10T05:18:21.776491+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6063","reported_seq":6093,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.275754+0000","last_change":"2024-05-10T04:51:52.121412+0000","last_active":"2024-05-10T05:18:23.275754+0000","last_peered":"2024-05-10T05:18:23.275754+0000","last_clean":"2024-05-10T05:18:23.275754+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:23.275754+0000","last_undegraded":"2024-05-10T05:18:23.275754+0000","last_fullsized":"2024-05-10T05:18:23.275754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6063,"log_dups_size":0,"ondisk_log_size":6063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6068,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2026","reported_seq":2054,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.021048+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T05:18:26.021048+0000","last_peered":"2024-05-10T05:18:26.021048+0000","last_clean":"2024-05-10T05:18:26.021048+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:18:26.021048+0000","last_undegraded":"2024-05-10T05:18:26.021048+0000","last_fullsized":"2024-05-10T05:18:26.021048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:12:06.339995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8412,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.773846+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T05:18:21.773846+0000","last_peered":"2024-05-10T05:18:21.773846+0000","last_clean":"2024-05-10T05:18:21.773846+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:18:21.773846+0000","last_undegraded":"2024-05-10T05:18:21.773846+0000","last_fullsized":"2024-05-10T05:18:21.773846+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7063","reported_seq":7092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.258996+0000","last_change":"2024-05-10T04:51:52.130397+0000","last_active":"2024-05-10T05:18:23.258996+0000","last_peered":"2024-05-10T05:18:23.258996+0000","last_clean":"2024-05-10T05:18:23.258996+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:18:23.258996+0000","last_undegraded":"2024-05-10T05:18:23.258996+0000","last_fullsized":"2024-05-10T05:18:23.258996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:08:40.085744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7059,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.975796+0000","last_change":"2024-05-10T04:51:52.765214+0000","last_active":"2024-05-10T05:18:25.975796+0000","last_peered":"2024-05-10T05:18:25.975796+0000","last_clean":"2024-05-10T05:18:25.975796+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:25.975796+0000","last_undegraded":"2024-05-10T05:18:25.975796+0000","last_fullsized":"2024-05-10T05:18:25.975796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7589,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.717999+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T05:18:21.717999+0000","last_peered":"2024-05-10T05:18:21.717999+0000","last_clean":"2024-05-10T05:18:21.717999+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:18:21.717999+0000","last_undegraded":"2024-05-10T05:18:21.717999+0000","last_fullsized":"2024-05-10T05:18:21.717999+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2059","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.135178+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T05:18:26.135178+0000","last_peered":"2024-05-10T05:18:26.135178+0000","last_clean":"2024-05-10T05:18:26.135178+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:26.135178+0000","last_undegraded":"2024-05-10T05:18:26.135178+0000","last_fullsized":"2024-05-10T05:18:26.135178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.275769+0000","last_change":"2024-05-10T04:51:52.136415+0000","last_active":"2024-05-10T05:18:23.275769+0000","last_peered":"2024-05-10T05:18:23.275769+0000","last_clean":"2024-05-10T05:18:23.275769+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:23.275769+0000","last_undegraded":"2024-05-10T05:18:23.275769+0000","last_fullsized":"2024-05-10T05:18:23.275769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7596,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.759345+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T05:18:21.759345+0000","last_peered":"2024-05-10T05:18:21.759345+0000","last_clean":"2024-05-10T05:18:21.759345+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:18:21.759345+0000","last_undegraded":"2024-05-10T05:18:21.759345+0000","last_fullsized":"2024-05-10T05:18:21.759345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:47:53.069027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2085","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.014533+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T05:18:26.014533+0000","last_peered":"2024-05-10T05:18:26.014533+0000","last_clean":"2024-05-10T05:18:26.014533+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:18:26.014533+0000","last_undegraded":"2024-05-10T05:18:26.014533+0000","last_fullsized":"2024-05-10T05:18:26.014533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4532","reported_seq":4561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.234093+0000","last_change":"2024-05-10T04:51:52.139634+0000","last_active":"2024-05-10T05:18:23.234093+0000","last_peered":"2024-05-10T05:18:23.234093+0000","last_clean":"2024-05-10T05:18:23.234093+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:18:23.234093+0000","last_undegraded":"2024-05-10T05:18:23.234093+0000","last_fullsized":"2024-05-10T05:18:23.234093+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4532,"log_dups_size":0,"ondisk_log_size":4532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:36:32.435285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4533,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:15:56.300717+0000","last_change":"2024-05-10T04:51:47.444808+0000","last_active":"2024-05-10T05:15:56.300717+0000","last_peered":"2024-05-10T05:15:56.300717+0000","last_clean":"2024-05-10T05:15:56.300717+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:15:56.300717+0000","last_undegraded":"2024-05-10T05:15:56.300717+0000","last_fullsized":"2024-05-10T05:15:56.300717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:46.032259+0000","last_clean_scrub_stamp":"2024-05-10T04:51:46.032259+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:14:00.123321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.745711+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T05:18:21.745711+0000","last_peered":"2024-05-10T05:18:21.745711+0000","last_clean":"2024-05-10T05:18:21.745711+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:18:21.745711+0000","last_undegraded":"2024-05-10T05:18:21.745711+0000","last_fullsized":"2024-05-10T05:18:21.745711+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1994","reported_seq":2023,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980464+0000","last_change":"2024-05-10T04:51:52.756941+0000","last_active":"2024-05-10T05:18:25.980464+0000","last_peered":"2024-05-10T05:18:25.980464+0000","last_clean":"2024-05-10T05:18:25.980464+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:25.980464+0000","last_undegraded":"2024-05-10T05:18:25.980464+0000","last_fullsized":"2024-05-10T05:18:25.980464+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6534","reported_seq":6564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285899+0000","last_change":"2024-05-10T04:51:52.146446+0000","last_active":"2024-05-10T05:18:23.285899+0000","last_peered":"2024-05-10T05:18:23.285899+0000","last_clean":"2024-05-10T05:18:23.285899+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:18:23.285899+0000","last_undegraded":"2024-05-10T05:18:23.285899+0000","last_fullsized":"2024-05-10T05:18:23.285899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6534,"log_dups_size":0,"ondisk_log_size":6534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:21:36.532485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6538,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7694,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.755717+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T05:18:21.755717+0000","last_peered":"2024-05-10T05:18:21.755717+0000","last_clean":"2024-05-10T05:18:21.755717+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:18:21.755717+0000","last_undegraded":"2024-05-10T05:18:21.755717+0000","last_fullsized":"2024-05-10T05:18:21.755717+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4967","reported_seq":4996,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.286007+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T05:18:23.286007+0000","last_peered":"2024-05-10T05:18:23.286007+0000","last_clean":"2024-05-10T05:18:23.286007+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:18:23.286007+0000","last_undegraded":"2024-05-10T05:18:23.286007+0000","last_fullsized":"2024-05-10T05:18:23.286007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:48.813979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4970,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2075","reported_seq":2104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.939332+0000","last_change":"2024-05-10T04:51:52.737944+0000","last_active":"2024-05-10T05:18:25.939332+0000","last_peered":"2024-05-10T05:18:25.939332+0000","last_clean":"2024-05-10T05:18:25.939332+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:25.939332+0000","last_undegraded":"2024-05-10T05:18:25.939332+0000","last_fullsized":"2024-05-10T05:18:25.939332+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2075,"log_dups_size":0,"ondisk_log_size":2075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7178","reported_seq":7224,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.140873+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T05:18:26.140873+0000","last_peered":"2024-05-10T05:18:26.140873+0000","last_clean":"2024-05-10T05:18:26.140873+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:18:26.140873+0000","last_undegraded":"2024-05-10T05:18:26.140873+0000","last_fullsized":"2024-05-10T05:18:26.140873+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6276,"log_dups_size":0,"ondisk_log_size":6276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5018,"num_write_kb":931856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4518","reported_seq":4801,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.115536+0000","last_change":"2024-05-10T04:51:52.139917+0000","last_active":"2024-05-10T05:18:26.115536+0000","last_peered":"2024-05-10T05:18:26.115536+0000","last_clean":"2024-05-10T05:18:26.115536+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:26.115536+0000","last_undegraded":"2024-05-10T05:18:26.115536+0000","last_fullsized":"2024-05-10T05:18:26.115536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4518,"log_dups_size":0,"ondisk_log_size":4518,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5706142,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":1647,"num_write":5099,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1997","reported_seq":2026,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.944618+0000","last_change":"2024-05-10T04:51:52.766716+0000","last_active":"2024-05-10T05:18:25.944618+0000","last_peered":"2024-05-10T05:18:25.944618+0000","last_clean":"2024-05-10T05:18:25.944618+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:25.944618+0000","last_undegraded":"2024-05-10T05:18:25.944618+0000","last_fullsized":"2024-05-10T05:18:25.944618+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1997,"log_dups_size":0,"ondisk_log_size":1997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7840,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.591169+0000","last_change":"2024-05-10T04:51:57.223087+0000","last_active":"2024-05-10T05:18:21.591169+0000","last_peered":"2024-05-10T05:18:21.591169+0000","last_clean":"2024-05-10T05:18:21.591169+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:21.591169+0000","last_undegraded":"2024-05-10T05:18:21.591169+0000","last_fullsized":"2024-05-10T05:18:21.591169+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2929","reported_seq":2958,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285307+0000","last_change":"2024-05-10T04:51:52.145855+0000","last_active":"2024-05-10T05:18:23.285307+0000","last_peered":"2024-05-10T05:18:23.285307+0000","last_clean":"2024-05-10T05:18:23.285307+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:23.285307+0000","last_undegraded":"2024-05-10T05:18:23.285307+0000","last_fullsized":"2024-05-10T05:18:23.285307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2929,"log_dups_size":0,"ondisk_log_size":2929,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:30:07.224456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2041","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.947154+0000","last_change":"2024-05-10T04:51:52.741468+0000","last_active":"2024-05-10T05:18:25.947154+0000","last_peered":"2024-05-10T05:18:25.947154+0000","last_clean":"2024-05-10T05:18:25.947154+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:25.947154+0000","last_undegraded":"2024-05-10T05:18:25.947154+0000","last_fullsized":"2024-05-10T05:18:25.947154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7570,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.138740+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T05:18:26.138740+0000","last_peered":"2024-05-10T05:18:26.138740+0000","last_clean":"2024-05-10T05:18:26.138740+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:26.138740+0000","last_undegraded":"2024-05-10T05:18:26.138740+0000","last_fullsized":"2024-05-10T05:18:26.138740+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2707","reported_seq":2736,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.284716+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T05:18:23.284716+0000","last_peered":"2024-05-10T05:18:23.284716+0000","last_clean":"2024-05-10T05:18:23.284716+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:18:23.284716+0000","last_undegraded":"2024-05-10T05:18:23.284716+0000","last_fullsized":"2024-05-10T05:18:23.284716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2707,"log_dups_size":0,"ondisk_log_size":2707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:51:11.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2712,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980900+0000","last_change":"2024-05-10T04:51:52.750348+0000","last_active":"2024-05-10T05:18:25.980900+0000","last_peered":"2024-05-10T05:18:25.980900+0000","last_clean":"2024-05-10T05:18:25.980900+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:25.980900+0000","last_undegraded":"2024-05-10T05:18:25.980900+0000","last_fullsized":"2024-05-10T05:18:25.980900+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7374,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.715203+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T05:18:21.715203+0000","last_peered":"2024-05-10T05:18:21.715203+0000","last_clean":"2024-05-10T05:18:21.715203+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:18:21.715203+0000","last_undegraded":"2024-05-10T05:18:21.715203+0000","last_fullsized":"2024-05-10T05:18:21.715203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3612","reported_seq":3642,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.280200+0000","last_change":"2024-05-10T04:51:52.143137+0000","last_active":"2024-05-10T05:18:23.280200+0000","last_peered":"2024-05-10T05:18:23.280200+0000","last_clean":"2024-05-10T05:18:23.280200+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:18:23.280200+0000","last_undegraded":"2024-05-10T05:18:23.280200+0000","last_fullsized":"2024-05-10T05:18:23.280200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":3612,"log_dups_size":0,"ondisk_log_size":3612,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3630,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2116","reported_seq":2145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.951248+0000","last_change":"2024-05-10T04:51:52.744429+0000","last_active":"2024-05-10T05:18:25.951248+0000","last_peered":"2024-05-10T05:18:25.951248+0000","last_clean":"2024-05-10T05:18:25.951248+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:25.951248+0000","last_undegraded":"2024-05-10T05:18:25.951248+0000","last_fullsized":"2024-05-10T05:18:25.951248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2116,"log_dups_size":0,"ondisk_log_size":2116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7427,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.754935+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T05:18:21.754935+0000","last_peered":"2024-05-10T05:18:21.754935+0000","last_clean":"2024-05-10T05:18:21.754935+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:18:21.754935+0000","last_undegraded":"2024-05-10T05:18:21.754935+0000","last_fullsized":"2024-05-10T05:18:21.754935+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6718","reported_seq":6748,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.231153+0000","last_change":"2024-05-10T04:51:52.129372+0000","last_active":"2024-05-10T05:18:23.231153+0000","last_peered":"2024-05-10T05:18:23.231153+0000","last_clean":"2024-05-10T05:18:23.231153+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:18:23.231153+0000","last_undegraded":"2024-05-10T05:18:23.231153+0000","last_fullsized":"2024-05-10T05:18:23.231153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6718,"log_dups_size":0,"ondisk_log_size":6718,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6710,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2079","reported_seq":2101,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.953057+0000","last_change":"2024-05-10T04:52:40.335170+0000","last_active":"2024-05-10T05:18:25.953057+0000","last_peered":"2024-05-10T05:18:25.953057+0000","last_clean":"2024-05-10T05:18:25.953057+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:25.953057+0000","last_undegraded":"2024-05-10T05:18:25.953057+0000","last_fullsized":"2024-05-10T05:18:25.953057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7870,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.144442+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T05:18:26.144442+0000","last_peered":"2024-05-10T05:18:26.144442+0000","last_clean":"2024-05-10T05:18:26.144442+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:18:26.144442+0000","last_undegraded":"2024-05-10T05:18:26.144442+0000","last_fullsized":"2024-05-10T05:18:26.144442+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6911","reported_seq":6939,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.292464+0000","last_change":"2024-05-10T04:51:52.149465+0000","last_active":"2024-05-10T05:18:23.292464+0000","last_peered":"2024-05-10T05:18:23.292464+0000","last_clean":"2024-05-10T05:18:23.292464+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:18:23.292464+0000","last_undegraded":"2024-05-10T05:18:23.292464+0000","last_fullsized":"2024-05-10T05:18:23.292464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6911,"log_dups_size":0,"ondisk_log_size":6911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:59:49.767478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6927,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2069","reported_seq":2097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.947516+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T05:18:25.947516+0000","last_peered":"2024-05-10T05:18:25.947516+0000","last_clean":"2024-05-10T05:18:25.947516+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:18:25.947516+0000","last_undegraded":"2024-05-10T05:18:25.947516+0000","last_fullsized":"2024-05-10T05:18:25.947516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:48:08.831018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7414,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.687453+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T05:18:21.687453+0000","last_peered":"2024-05-10T05:18:21.687453+0000","last_clean":"2024-05-10T05:18:21.687453+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:18:21.687453+0000","last_undegraded":"2024-05-10T05:18:21.687453+0000","last_fullsized":"2024-05-10T05:18:21.687453+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:29:06.666693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5970","reported_seq":5999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:13.076816+0000","last_change":"2024-05-10T04:51:52.137835+0000","last_active":"2024-05-10T05:18:13.076816+0000","last_peered":"2024-05-10T05:18:13.076816+0000","last_clean":"2024-05-10T05:18:13.076816+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:18:13.076816+0000","last_undegraded":"2024-05-10T05:18:13.076816+0000","last_fullsized":"2024-05-10T05:18:13.076816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5970,"log_dups_size":0,"ondisk_log_size":5970,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2043","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.004696+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T05:18:26.004696+0000","last_peered":"2024-05-10T05:18:26.004696+0000","last_clean":"2024-05-10T05:18:26.004696+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:26.004696+0000","last_undegraded":"2024-05-10T05:18:26.004696+0000","last_fullsized":"2024-05-10T05:18:26.004696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:00.996835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7895","reported_seq":8000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.134311+0000","last_change":"2024-05-10T04:52:40.389082+0000","last_active":"2024-05-10T05:18:26.134311+0000","last_peered":"2024-05-10T05:18:26.134311+0000","last_clean":"2024-05-10T05:18:26.134311+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:18:26.134311+0000","last_undegraded":"2024-05-10T05:18:26.134311+0000","last_fullsized":"2024-05-10T05:18:26.134311+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7189,"log_dups_size":0,"ondisk_log_size":7189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5700,"num_write_kb":1007695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7940","reported_seq":7969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285512+0000","last_change":"2024-05-10T04:51:52.133244+0000","last_active":"2024-05-10T05:18:23.285512+0000","last_peered":"2024-05-10T05:18:23.285512+0000","last_clean":"2024-05-10T05:18:23.285512+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:18:23.285512+0000","last_undegraded":"2024-05-10T05:18:23.285512+0000","last_fullsized":"2024-05-10T05:18:23.285512+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7340,"log_dups_size":0,"ondisk_log_size":7340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7935,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2034","reported_seq":2061,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.984221+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T05:18:25.984221+0000","last_peered":"2024-05-10T05:18:25.984221+0000","last_clean":"2024-05-10T05:18:25.984221+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:18:25.984221+0000","last_undegraded":"2024-05-10T05:18:25.984221+0000","last_fullsized":"2024-05-10T05:18:25.984221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:45:24.195265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7867,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.646424+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T05:18:21.646424+0000","last_peered":"2024-05-10T05:18:21.646424+0000","last_clean":"2024-05-10T05:18:21.646424+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:18:21.646424+0000","last_undegraded":"2024-05-10T05:18:21.646424+0000","last_fullsized":"2024-05-10T05:18:21.646424+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:19:53.340194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5556","reported_seq":5585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.268189+0000","last_change":"2024-05-10T04:51:52.136296+0000","last_active":"2024-05-10T05:18:23.268189+0000","last_peered":"2024-05-10T05:18:23.268189+0000","last_clean":"2024-05-10T05:18:23.268189+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:23.268189+0000","last_undegraded":"2024-05-10T05:18:23.268189+0000","last_fullsized":"2024-05-10T05:18:23.268189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5556,"log_dups_size":0,"ondisk_log_size":5556,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1961","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980578+0000","last_change":"2024-05-10T04:51:52.776314+0000","last_active":"2024-05-10T05:18:25.980578+0000","last_peered":"2024-05-10T05:18:25.980578+0000","last_clean":"2024-05-10T05:18:25.980578+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:25.980578+0000","last_undegraded":"2024-05-10T05:18:25.980578+0000","last_fullsized":"2024-05-10T05:18:25.980578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1961,"log_dups_size":0,"ondisk_log_size":1961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:16:53.802209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1986","reported_seq":2014,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.941045+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T05:18:25.941045+0000","last_peered":"2024-05-10T05:18:25.941045+0000","last_clean":"2024-05-10T05:18:25.941045+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:18:25.941045+0000","last_undegraded":"2024-05-10T05:18:25.941045+0000","last_fullsized":"2024-05-10T05:18:25.941045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:01:03.765714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2091","reported_seq":2120,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.997473+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T05:18:25.997473+0000","last_peered":"2024-05-10T05:18:25.997473+0000","last_clean":"2024-05-10T05:18:25.997473+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:25.997473+0000","last_undegraded":"2024-05-10T05:18:25.997473+0000","last_fullsized":"2024-05-10T05:18:25.997473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1990","reported_seq":2018,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.014491+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T05:18:26.014491+0000","last_peered":"2024-05-10T05:18:26.014491+0000","last_clean":"2024-05-10T05:18:26.014491+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:18:26.014491+0000","last_undegraded":"2024-05-10T05:18:26.014491+0000","last_fullsized":"2024-05-10T05:18:26.014491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:34.489480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2093","reported_seq":2122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.966135+0000","last_change":"2024-05-10T04:51:52.748722+0000","last_active":"2024-05-10T05:18:25.966135+0000","last_peered":"2024-05-10T05:18:25.966135+0000","last_clean":"2024-05-10T05:18:25.966135+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:25.966135+0000","last_undegraded":"2024-05-10T05:18:25.966135+0000","last_fullsized":"2024-05-10T05:18:25.966135+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2063","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980309+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T05:18:25.980309+0000","last_peered":"2024-05-10T05:18:25.980309+0000","last_clean":"2024-05-10T05:18:25.980309+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:25.980309+0000","last_undegraded":"2024-05-10T05:18:25.980309+0000","last_fullsized":"2024-05-10T05:18:25.980309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1959","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.930069+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T05:18:25.930069+0000","last_peered":"2024-05-10T05:18:25.930069+0000","last_clean":"2024-05-10T05:18:25.930069+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:18:25.930069+0000","last_undegraded":"2024-05-10T05:18:25.930069+0000","last_fullsized":"2024-05-10T05:18:25.930069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2071","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.999191+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T05:18:25.999191+0000","last_peered":"2024-05-10T05:18:25.999191+0000","last_clean":"2024-05-10T05:18:25.999191+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:18:25.999191+0000","last_undegraded":"2024-05-10T05:18:25.999191+0000","last_fullsized":"2024-05-10T05:18:25.999191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:34:26.302299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2052","reported_seq":2081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.924837+0000","last_change":"2024-05-10T04:51:52.738878+0000","last_active":"2024-05-10T05:18:25.924837+0000","last_peered":"2024-05-10T05:18:25.924837+0000","last_clean":"2024-05-10T05:18:25.924837+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:25.924837+0000","last_undegraded":"2024-05-10T05:18:25.924837+0000","last_fullsized":"2024-05-10T05:18:25.924837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2006","reported_seq":2034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.014062+0000","last_change":"2024-05-10T04:51:52.736849+0000","last_active":"2024-05-10T05:18:26.014062+0000","last_peered":"2024-05-10T05:18:26.014062+0000","last_clean":"2024-05-10T05:18:26.014062+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:26.014062+0000","last_undegraded":"2024-05-10T05:18:26.014062+0000","last_fullsized":"2024-05-10T05:18:26.014062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:23:25.517420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2043","reported_seq":2071,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.985667+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T05:18:25.985667+0000","last_peered":"2024-05-10T05:18:25.985667+0000","last_clean":"2024-05-10T05:18:25.985667+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:25.985667+0000","last_undegraded":"2024-05-10T05:18:25.985667+0000","last_fullsized":"2024-05-10T05:18:25.985667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2070","reported_seq":2097,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.021752+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T05:18:26.021752+0000","last_peered":"2024-05-10T05:18:26.021752+0000","last_clean":"2024-05-10T05:18:26.021752+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:18:26.021752+0000","last_undegraded":"2024-05-10T05:18:26.021752+0000","last_fullsized":"2024-05-10T05:18:26.021752+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:17:03.407444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2074","reported_seq":2102,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.126691+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T05:18:26.126691+0000","last_peered":"2024-05-10T05:18:26.126691+0000","last_clean":"2024-05-10T05:18:26.126691+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:18:26.126691+0000","last_undegraded":"2024-05-10T05:18:26.126691+0000","last_fullsized":"2024-05-10T05:18:26.126691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2051","reported_seq":2078,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.986841+0000","last_change":"2024-05-10T04:51:52.762082+0000","last_active":"2024-05-10T05:18:25.986841+0000","last_peered":"2024-05-10T05:18:25.986841+0000","last_clean":"2024-05-10T05:18:25.986841+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:25.986841+0000","last_undegraded":"2024-05-10T05:18:25.986841+0000","last_fullsized":"2024-05-10T05:18:25.986841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:49:58.185581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173251,"num_write_kb":29661400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225990,"ondisk_log_size":225990,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130764,"ondisk_log_size":130764,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235183565,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2414,"num_read_kb":15319,"num_write":184839,"num_write_kb":1350687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":470433792,"data_stored":470367130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172683,"ondisk_log_size":172683,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542468,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":931700,"kb_used_data":70508,"kb_used_omap":1,"kb_used_meta":861182,"kb_avail":93440140,"statfs":{"total":96636764160,"available":95682703360,"internally_reserved":0,"allocated":72200192,"data_stored":72015801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":881850827},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.988,"15min":1.819},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":14.874000000000001,"5min":28.266999999999999,"15min":34.326999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.75,"5min":2.4319999999999999,"15min":1.851},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.31},"max":{"1min":15.058,"5min":28.968,"15min":28.968},"last":0.71699999999999997}]},{"osd":1,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":2.395,"15min":1.976},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.32900000000000001},"max":{"1min":14.84,"5min":34.805999999999997,"15min":34.805999999999997},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.8480000000000001,"5min":2.3769999999999998,"15min":2.3069999999999999},"min":{"1min":0.48399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.102,"5min":29.222000000000001,"15min":105.375},"last":0.80500000000000005}]},{"osd":2,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":2.4260000000000002,"15min":2.077},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.35899999999999999},"max":{"1min":4.3029999999999999,"5min":39.965000000000003,"15min":52.515999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":2.1190000000000002,"5min":2.2229999999999999,"15min":1.804},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":14.782999999999999,"5min":34.756999999999998,"15min":35.595999999999997},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":2.6040000000000001,"15min":2.597},"min":{"1min":0.46300000000000002,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":8.5489999999999995,"5min":38.317999999999998,"15min":64.994},"last":0.69599999999999995},{"interface":"front","average":{"1min":3.1850000000000001,"5min":2.4590000000000001,"15min":1.978},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.907999999999999,"5min":34.841999999999999,"15min":43.789000000000001},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":3.1139999999999999,"15min":2.7109999999999999},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":15.217000000000001,"5min":40.978999999999999,"15min":52.252000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":1.47,"5min":2.746,"15min":3.157},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.36499999999999999},"max":{"1min":8.6969999999999992,"5min":34.289999999999999,"15min":134.07499999999999},"last":0.53600000000000003}]},{"osd":5,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":3.0640000000000001,"15min":2.4769999999999999},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":14.943,"5min":34.875,"15min":34.875},"last":0.78300000000000003},{"interface":"front","average":{"1min":2.5569999999999999,"5min":2.8639999999999999,"15min":2.3420000000000001},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":15.177,"5min":29.867000000000001,"15min":37.582999999999998},"last":0.77100000000000002}]},{"osd":6,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":4.6219999999999999,"15min":3.2559999999999998},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":15.138999999999999,"5min":65.388999999999996,"15min":65.388999999999996},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.6830000000000001,"5min":4.5019999999999998,"15min":3.3980000000000001},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.4029999999999996,"5min":84.454999999999998,"15min":84.454999999999998},"last":0.75600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542467,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":978144,"kb_used_data":90712,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93393696,"statfs":{"total":96636764160,"available":95635144704,"internally_reserved":0,"allocated":92889088,"data_stored":92698114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":2.5579999999999998,"15min":3.0569999999999999},"min":{"1min":0.47699999999999998,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":14.510999999999999,"5min":17.158000000000001,"15min":215.636},"last":0.68600000000000005},{"interface":"front","average":{"1min":2.5070000000000001,"5min":2.6080000000000001,"15min":2.8149999999999999},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":15.693,"5min":26.574000000000002,"15min":216.899},"last":0.58399999999999996}]},{"osd":1,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":1.998,"5min":2.5150000000000001,"15min":3.6709999999999998},"min":{"1min":0.39000000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":9.8569999999999993,"5min":20.341999999999999,"15min":283.584},"last":0.56299999999999994},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5590000000000002,"15min":3.3559999999999999},"min":{"1min":0.57799999999999996,"5min":0.39500000000000002,"15min":0.33500000000000002},"max":{"1min":14.353999999999999,"5min":21.161999999999999,"15min":226.642},"last":0.751}]},{"osd":2,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.3220000000000001,"15min":2.6339999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38200000000000001},"max":{"1min":15.625999999999999,"5min":15.625999999999999,"15min":204.20099999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.9430000000000001,"15min":2.262},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":14.115,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.622}]},{"osd":3,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4470000000000001,"5min":2.3639999999999999,"15min":2.9390000000000001},"min":{"1min":0.54300000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":14.478999999999999,"5min":21.224,"15min":211.06999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.181,"15min":2.8660000000000001},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":15.923,"5min":15.923,"15min":216.947},"last":0.73499999999999999}]},{"osd":4,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.3340000000000001,"5min":2.9980000000000002,"15min":2.653},"min":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":14.304,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.84499999999999997},{"interface":"front","average":{"1min":3.4409999999999998,"5min":3.2200000000000002,"15min":2.4710000000000001},"min":{"1min":0.497,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":16.417000000000002,"5min":37.195,"15min":37.195},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0840000000000001,"15min":2.343},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":11.1,"5min":46.448999999999998,"15min":46.448999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":2.6160000000000001,"5min":2.9079999999999999,"15min":2.589},"min":{"1min":0.58099999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":14.760999999999999,"5min":18.962,"15min":35.591999999999999},"last":0.874}]},{"osd":7,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":2.9359999999999999,"15min":2.3210000000000002},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":15.662000000000001,"5min":58.857999999999997,"15min":58.857999999999997},"last":0.79200000000000004},{"interface":"front","average":{"1min":2.9319999999999999,"5min":4.0650000000000004,"15min":2.7160000000000002},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":11.148,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.77400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542468,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752828,"kb_used_data":45940,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93619012,"statfs":{"total":96636764160,"available":95865868288,"internally_reserved":0,"allocated":47042560,"data_stored":46850033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.1709999999999998,"5min":1.46,"15min":1.3959999999999999},"min":{"1min":0.26800000000000002,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":39.710000000000001,"5min":39.710000000000001,"15min":40.371000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":4.3259999999999996,"5min":2.1019999999999999,"15min":1.9139999999999999},"min":{"1min":0.29199999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":62.222000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":0.375}]},{"osd":2,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2470000000000001,"5min":1.3680000000000001,"15min":1.1699999999999999},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":6.391,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.495},{"interface":"front","average":{"1min":1.875,"5min":1.5880000000000001,"15min":1.3959999999999999},"min":{"1min":0.35899999999999999,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":8.391,"5min":17.998000000000001,"15min":37.643999999999998},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.7770000000000001,"5min":1.7150000000000001,"15min":2.0600000000000001},"min":{"1min":0.38800000000000001,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":51.646999999999998,"5min":51.646999999999998,"15min":108.407},"last":0.57999999999999996},{"interface":"front","average":{"1min":2.0630000000000002,"5min":1.6699999999999999,"15min":1.466},"min":{"1min":0.51000000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":12.359999999999999,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":4.7249999999999996,"5min":2.6739999999999999,"15min":2.2949999999999999},"min":{"1min":0.45800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":52.307000000000002,"5min":52.307000000000002,"15min":52.307000000000002},"last":0.77600000000000002},{"interface":"front","average":{"1min":3.0339999999999998,"5min":2.4809999999999999,"15min":1.9970000000000001},"min":{"1min":0.47199999999999998,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":13.576000000000001,"5min":19.292999999999999,"15min":32.276000000000003},"last":0.86199999999999999}]},{"osd":5,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5110000000000001,"5min":2.202,"15min":1.8660000000000001},"min":{"1min":0.46700000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":9.8170000000000002,"5min":18.966000000000001,"15min":37.572000000000003},"last":0.82999999999999996},{"interface":"front","average":{"1min":4.3659999999999997,"5min":2.5840000000000001,"15min":2.2599999999999998},"min":{"1min":0.56899999999999995,"5min":0.46700000000000003,"15min":0.44600000000000001},"max":{"1min":54.637999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":0.81999999999999995}]},{"osd":6,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":2.5550000000000002,"5min":2.6240000000000001,"15min":2.1459999999999999},"min":{"1min":0.59099999999999997,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":13.968,"5min":41.270000000000003,"15min":41.270000000000003},"last":0.91200000000000003},{"interface":"front","average":{"1min":3.6699999999999999,"5min":2.923,"15min":2.258},"min":{"1min":0.53200000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":18.013000000000002,"5min":41.043999999999997,"15min":41.043999999999997},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri May 10 05:17:41 2024","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.6749999999999998,"15min":2.2490000000000001},"min":{"1min":0.53400000000000003,"5min":0.495,"15min":0.45900000000000002},"max":{"1min":17.946000000000002,"5min":22.251000000000001,"15min":37.850000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":3.927,"5min":2.3809999999999998,"15min":2.359},"min":{"1min":0.622,"5min":0.503,"15min":0.503},"max":{"1min":39.850000000000001,"5min":39.850000000000001,"15min":46.118000000000002},"last":0.88100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575174,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":539116,"kb_used_data":20772,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93832724,"statfs":{"total":96636764160,"available":96084709376,"internally_reserved":0,"allocated":21270528,"data_stored":21093203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.1439999999999999,"15min":1.22},"min":{"1min":0.29999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":8.1189999999999998,"5min":11.212,"15min":24.271000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":1.897,"5min":1.244,"15min":1.4279999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":16.366,"5min":16.366,"15min":30.734999999999999},"last":0.41299999999999998}]},{"osd":1,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.008,"15min":1.444},"min":{"1min":0.40699999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3079999999999998,"5min":9.9079999999999995,"15min":105.28},"last":0.48399999999999999},{"interface":"front","average":{"1min":2.23,"5min":2.23,"15min":2.577},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":16.309000000000001,"5min":73.775999999999996,"15min":105.255},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":1.343,"15min":1.629},"min":{"1min":0.34699999999999998,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.557,"5min":13.557,"15min":60.387999999999998},"last":0.502},{"interface":"front","average":{"1min":1.758,"5min":1.347,"15min":1.4450000000000001},"min":{"1min":0.45400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":14.116,"5min":14.116,"15min":22.358000000000001},"last":0.55100000000000005}]},{"osd":4,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":4.2350000000000003,"15min":2.7890000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":12.548999999999999,"5min":249.88,"15min":249.88},"last":0.628},{"interface":"front","average":{"1min":3.5179999999999998,"5min":4.6390000000000002,"15min":3.1779999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":20.428999999999998,"5min":249.82300000000001,"15min":249.82300000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":4.0250000000000004,"15min":2.7170000000000001},"min":{"1min":0.442,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":15.917999999999999,"5min":256.38600000000002,"15min":256.38600000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":2.3679999999999999,"5min":3.9020000000000001,"15min":2.3769999999999998},"min":{"1min":0.59099999999999997,"5min":0.42899999999999999,"15min":0.42799999999999999},"max":{"1min":14.08,"5min":255.04499999999999,"15min":255.04499999999999},"last":0.59799999999999998}]},{"osd":6,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":3.1190000000000002,"5min":4.9669999999999996,"15min":3.0369999999999999},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":20.393999999999998,"5min":255.06999999999999,"15min":255.06999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":3.327,"5min":4.9809999999999999,"15min":3.1400000000000001},"min":{"1min":0.505,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":18.178000000000001,"5min":253.095,"15min":253.095},"last":0.68200000000000005}]},{"osd":7,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":4.2649999999999997,"5min":4.1109999999999998,"15min":3.008},"min":{"1min":0.65600000000000003,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":24.565000000000001,"5min":249.90799999999999,"15min":249.90799999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.4390000000000001,"15min":3.2029999999999998},"min":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.44400000000000001},"max":{"1min":8.5760000000000005,"5min":256.97699999999998,"15min":256.97699999999998},"last":0.84799999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542467,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":966332,"kb_used_data":50932,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93405508,"statfs":{"total":96636764160,"available":95647240192,"internally_reserved":0,"allocated":52154368,"data_stored":51965329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":4.5620000000000003,"5min":2.2999999999999998,"15min":2.4710000000000001},"min":{"1min":0.25800000000000001,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":50.100000000000001,"5min":50.100000000000001,"15min":192.745},"last":0.443},{"interface":"front","average":{"1min":4.3819999999999997,"5min":1.891,"15min":2.206},"min":{"1min":0.38700000000000001,"5min":0.377,"15min":0.30499999999999999},"max":{"1min":50.145000000000003,"5min":50.145000000000003,"15min":192.62799999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":1.3520000000000001,"15min":1.651},"min":{"1min":0.30399999999999999,"5min":0.29199999999999998,"15min":0.28899999999999998},"max":{"1min":3.9159999999999999,"5min":14.263999999999999,"15min":71.727999999999994},"last":0.41199999999999998},{"interface":"front","average":{"1min":1.431,"5min":1.651,"15min":1.9910000000000001},"min":{"1min":0.35199999999999998,"5min":0.318,"15min":0.29799999999999999},"max":{"1min":5.5410000000000004,"5min":32.435000000000002,"15min":95.793000000000006},"last":0.495}]},{"osd":3,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.1920000000000002,"5min":2.0249999999999999,"15min":2.1030000000000002},"min":{"1min":0.47399999999999998,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":14.446,"5min":21.994,"15min":125.41200000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":3.0030000000000001,"5min":2.0139999999999998,"15min":1.8620000000000001},"min":{"1min":0.42599999999999999,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":16.498000000000001,"5min":26.085000000000001,"15min":111.134},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.7130000000000001,"5min":2.8999999999999999,"15min":2.5099999999999998},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.33300000000000002},"max":{"1min":21.686,"5min":34.137999999999998,"15min":72.697999999999993},"last":0.79800000000000004},{"interface":"front","average":{"1min":4.7569999999999997,"5min":3.2829999999999999,"15min":3.1150000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38300000000000001},"max":{"1min":26.440999999999999,"5min":52.764000000000003,"15min":138.74100000000001},"last":1.014}]},{"osd":5,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":3.1419999999999999,"5min":2.637,"15min":2},"min":{"1min":0.432,"5min":0.42499999999999999,"15min":0.42099999999999999},"max":{"1min":9.3300000000000001,"5min":41.558,"15min":41.558},"last":0.90400000000000003},{"interface":"front","average":{"1min":4.0279999999999996,"5min":2.7149999999999999,"15min":2.165},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":21.745999999999999,"5min":21.745999999999999,"15min":71.340999999999994},"last":1.038}]},{"osd":6,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":5.2930000000000001,"5min":2.7440000000000002,"15min":3.7429999999999999},"min":{"1min":0.46999999999999997,"5min":0.439,"15min":0.439},"max":{"1min":46.985999999999997,"5min":46.985999999999997,"15min":289.625},"last":1},{"interface":"front","average":{"1min":3.6459999999999999,"5min":2.8900000000000001,"15min":4.1399999999999997},"min":{"1min":0.495,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":14.343999999999999,"5min":23.260999999999999,"15min":289.608},"last":0.86099999999999999}]},{"osd":7,"last update":"Fri May 10 05:17:33 2024","interfaces":[{"interface":"back","average":{"1min":2.2450000000000001,"5min":2.0680000000000001,"15min":1.9299999999999999},"min":{"1min":0.53200000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":9.3629999999999995,"5min":28.573,"15min":33.892000000000003},"last":0.84899999999999998},{"interface":"front","average":{"1min":3.1560000000000001,"5min":2.7010000000000001,"15min":2.1200000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":13.920999999999999,"5min":19.215,"15min":41.015000000000001},"last":0.93500000000000005}]}]},{"osd":3,"up_from":14,"seq":60129542468,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077940,"kb_used_data":86316,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293900,"statfs":{"total":96636764160,"available":95532953600,"internally_reserved":0,"allocated":88387584,"data_stored":88202739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":1.528,"15min":1.488},"min":{"1min":0.315,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":22.021000000000001,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.61399999999999999},{"interface":"front","average":{"1min":2.2189999999999999,"5min":1.5009999999999999,"15min":1.8740000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":23.219999999999999,"5min":23.219999999999999,"15min":119.66200000000001},"last":0.42399999999999999}]},{"osd":1,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.948,"5min":1.7629999999999999,"15min":1.4219999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":10.342000000000001,"5min":25.995000000000001,"15min":26.573},"last":0.58599999999999997},{"interface":"front","average":{"1min":2.2549999999999999,"5min":1.714,"15min":1.7210000000000001},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.068999999999999,"5min":32.93,"15min":32.93},"last":0.48799999999999999}]},{"osd":2,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.6499999999999999,"15min":1.371},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":9.9819999999999993,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":2.1230000000000002,"5min":1.3939999999999999,"15min":1.365},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":22.123000000000001,"5min":22.123000000000001,"15min":29.568999999999999},"last":0.54800000000000004}]},{"osd":4,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":4.2030000000000003,"15min":4.1020000000000003},"min":{"1min":0.45500000000000002,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":23.181999999999999,"5min":101.81399999999999,"15min":157.47},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.7120000000000002,"5min":3.9689999999999999,"15min":3.6339999999999999},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":25.175999999999998,"5min":102.501,"15min":189.161},"last":0.89700000000000002}]},{"osd":5,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":2.2109999999999999,"15min":2.488},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.40799999999999997},"max":{"1min":3.9550000000000001,"5min":22.468,"15min":150.14500000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.6640000000000001,"5min":2.851,"15min":3.2759999999999998},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":23.141999999999999,"5min":50.697000000000003,"15min":165.47},"last":0.94899999999999995}]},{"osd":6,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.1520000000000001,"5min":3.1110000000000002,"15min":3.0449999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":10.287000000000001,"5min":43.024999999999999,"15min":179.703},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.1619999999999999,"5min":2.0640000000000001,"15min":2.6509999999999998},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":4.0309999999999997,"5min":17.460000000000001,"15min":135.15899999999999},"last":0.876}]},{"osd":7,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5329999999999999,"5min":2.0830000000000002,"15min":3.1600000000000001},"min":{"1min":0.57499999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":23.079000000000001,"5min":23.079000000000001,"15min":148.93899999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.4319999999999999,"5min":3.113,"15min":3.2650000000000001},"min":{"1min":0.62,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":12.063000000000001,"5min":59.588999999999999,"15min":215.81299999999999},"last":0.84899999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542466,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":928504,"kb_used_data":49456,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93443336,"statfs":{"total":96636764160,"available":95685976064,"internally_reserved":0,"allocated":50642944,"data_stored":50453457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":5.7800000000000002,"15min":5.9690000000000003},"min":{"1min":0.35499999999999998,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":5.165,"5min":220.36600000000001,"15min":440.25299999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.645,"5min":3.5840000000000001,"15min":3.8069999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.31900000000000001},"max":{"1min":8.4920000000000009,"5min":94.004999999999995,"15min":397.101},"last":0.72599999999999998}]},{"osd":1,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9079999999999999,"5min":4.2750000000000004,"15min":4.6559999999999997},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":8.5389999999999997,"5min":101.113,"15min":396.98899999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.752,"5min":2.7229999999999999,"15min":3.0760000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":8.2710000000000008,"5min":32.863,"15min":367.47399999999999},"last":0.755}]},{"osd":2,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":5.6289999999999996,"15min":6.3410000000000002},"min":{"1min":0.42499999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":9.8780000000000001,"5min":217.352,"15min":440.32400000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.827,"5min":3.3700000000000001,"15min":4.2469999999999999},"min":{"1min":0.438,"5min":0.43099999999999999,"15min":0.40899999999999997},"max":{"1min":8.5999999999999996,"5min":93.968999999999994,"15min":396.67700000000002},"last":0.96599999999999997}]},{"osd":3,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":3.3929999999999998,"15min":3.5059999999999998},"min":{"1min":0.54500000000000004,"5min":0.44800000000000001,"15min":0.41799999999999998},"max":{"1min":12.919,"5min":32.831000000000003,"15min":367.52499999999998},"last":1.0600000000000001},{"interface":"front","average":{"1min":2.895,"5min":6.1520000000000001,"15min":6.0720000000000001},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":10.57,"5min":223.80000000000001,"15min":440.197},"last":0.94199999999999995}]},{"osd":5,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":2.0579999999999998,"5min":3.5830000000000002,"15min":4.4829999999999997},"min":{"1min":0.61099999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":8.5690000000000008,"5min":94.930999999999997,"15min":396.73599999999999},"last":1.097},{"interface":"front","average":{"1min":3.4329999999999998,"5min":3.8100000000000001,"15min":4.4009999999999998},"min":{"1min":0.52000000000000002,"5min":0.439,"15min":0.38},"max":{"1min":12.996,"5min":32.759999999999998,"15min":366.06},"last":1.194}]},{"osd":6,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":4.266,"5min":4.891,"15min":6.5919999999999996},"min":{"1min":0.46000000000000002,"5min":0.43099999999999999,"15min":0.32100000000000001},"max":{"1min":30.117999999999999,"5min":132.136,"15min":440.358},"last":0.99099999999999999},{"interface":"front","average":{"1min":3.359,"5min":4.008,"15min":5.2110000000000003},"min":{"1min":0.51500000000000001,"5min":0.46999999999999997,"15min":0.42899999999999999},"max":{"1min":11.356999999999999,"5min":95.834999999999994,"15min":400.21199999999999},"last":1.1579999999999999}]},{"osd":7,"last update":"Fri May 10 05:17:39 2024","interfaces":[{"interface":"back","average":{"1min":6.649,"5min":4.2000000000000002,"15min":3.3450000000000002},"min":{"1min":0.56899999999999995,"5min":0.45800000000000002,"15min":0.42499999999999999},"max":{"1min":45.661000000000001,"5min":45.661000000000001,"15min":121.637},"last":1.125},{"interface":"front","average":{"1min":7.0890000000000004,"5min":5.1230000000000002,"15min":6.5670000000000002},"min":{"1min":0.56999999999999995,"5min":0.5,"15min":0.40600000000000003},"max":{"1min":60.430999999999997,"5min":132.084,"15min":440.291},"last":1.0800000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542467,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":831508,"kb_used_data":48268,"kb_used_omap":1,"kb_used_meta":783230,"kb_avail":93540332,"statfs":{"total":96636764160,"available":95785299968,"internally_reserved":0,"allocated":49426432,"data_stored":49242654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":802027974},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":2.915,"15min":1.9750000000000001},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":13.369,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.4260000000000002,"5min":2.286,"15min":1.736},"min":{"1min":0.373,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":15.297000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.3599999999999999,"15min":1.7},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":16.277000000000001,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.6240000000000001,"15min":1.861},"min":{"1min":0.45000000000000001,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":16.321999999999999,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.92500000000000004}]},{"osd":2,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":2.4750000000000001,"15min":1.825},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":13.664999999999999,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":2.9119999999999999,"5min":3.266,"15min":2.2549999999999999},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":15.089,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.86499999999999999}]},{"osd":3,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6469999999999998,"5min":2.6589999999999998,"15min":1.9870000000000001},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.41199999999999998},"max":{"1min":16.359000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.88500000000000001},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6459999999999999,"15min":2.0390000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":13.775,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.94699999999999995}]},{"osd":4,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.1579999999999999,"5min":5.8890000000000002,"15min":4.2229999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":13.646000000000001,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":2.9860000000000002,"5min":3.4940000000000002,"15min":3.1560000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":22.885999999999999,"5min":55.484999999999999,"15min":174.684},"last":0.69299999999999995}]},{"osd":6,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":3.7639999999999998,"15min":2.8769999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":28.108000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.76400000000000001},{"interface":"front","average":{"1min":3.5299999999999998,"5min":4.4050000000000002,"15min":3.4620000000000002},"min":{"1min":0.56100000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":16.550999999999998,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.91200000000000003}]},{"osd":7,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":6.6379999999999999,"5min":3.7829999999999999,"15min":2.6190000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.42999999999999999},"max":{"1min":80.727999999999994,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.90200000000000002},{"interface":"front","average":{"1min":8.5060000000000002,"5min":5.069,"15min":3.1259999999999999},"min":{"1min":0.53100000000000003,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":92.790999999999997,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.96399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51855360,"data_stored":51843646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49127424,"data_stored":49120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92590080,"data_stored":92576431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.182 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.183 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.184 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.185 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.186 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.187 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.188 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.189 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-10T04:51:46.032259+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=46, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.190 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.191 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.192 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.193 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.194 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.195 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.195 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.195 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:37.195 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T05:18:43.403 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:18:43.408 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:18:57.196 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:18:57.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.481+0000 7f15ed800700 1 Processor -- start 2024-05-10T05:18:57.482 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.481+0000 7f15ed800700 1 -- start start 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.482+0000 7f15ed800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80c8030 0x7f15e80c3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.482+0000 7f15ed800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f15e80aa2d0 0x7f15e80aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.482+0000 7f15ed800700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15e8159170 con 0x7f15e80700b0 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.482+0000 7f15ed800700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15e81566f0 con 0x7f15e80aa2d0 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.482+0000 7f15ed800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e8156170 con 0x7f15e80c8030 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6000700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f15e80700b0 0x7f15e8159600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:46362/0 (socket says 172.21.15.47:46362) 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6000700 1 -- 172.21.15.47:0/4124203405 learned_addr learned my addr 172.21.15.47:0/4124203405 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:18:57.484 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6a00700 1 --2- 172.21.15.47:0/4124203405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80c8030 0x7f15e80c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:57.485 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e7400700 1 --2- 172.21.15.47:0/4124203405 >> v2:172.21.15.117:3300/0 conn(0x7f15e80aa2d0 0x7f15e80aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:57.486 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e5600700 1 -- 172.21.15.47:0/4124203405 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1985658386 0 0) 0x7f15e8159170 con 0x7f15e80700b0 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e5600700 1 -- 172.21.15.47:0/4124203405 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15cc0035b0 con 0x7f15e80700b0 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6a00700 1 -- 172.21.15.47:0/4124203405 >> v2:172.21.15.117:3300/0 conn(0x7f15e80aa2d0 msgr2=0x7f15e80aa6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6a00700 1 --2- 172.21.15.47:0/4124203405 >> v2:172.21.15.117:3300/0 conn(0x7f15e80aa2d0 0x7f15e80aa6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6a00700 1 -- 172.21.15.47:0/4124203405 >> v1:172.21.15.47:6789/0 conn(0x7f15e80700b0 legacy=0x7f15e8159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.483+0000 7f15e6a00700 1 -- 172.21.15.47:0/4124203405 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8156410 con 0x7f15e80c8030 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.484+0000 7f15e7400700 1 --2- 172.21.15.47:0/4124203405 >> v2:172.21.15.117:3300/0 conn(0x7f15e80aa2d0 0x7f15e80aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.484+0000 7f15e6a00700 1 --2- 172.21.15.47:0/4124203405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80c8030 0x7f15e80c3840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009840 tx=0x7f15d8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa925c7eb3a63438 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.484+0000 7f15e5600700 1 -- 172.21.15.47:0/4124203405 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011830 con 0x7f15e80c8030 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.484+0000 7f15e5600700 1 -- 172.21.15.47:0/4124203405 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d8011990 con 0x7f15e80c8030 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.484+0000 7f15e5600700 1 -- 172.21.15.47:0/4124203405 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8011d20 con 0x7f15e80c8030 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 -- 172.21.15.47:0/4124203405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80c8030 msgr2=0x7f15e80c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:57.487 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 --2- 172.21.15.47:0/4124203405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80c8030 0x7f15e80c3840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f15d8009840 tx=0x7f15d8009b50 comp rx=0 tx=0).stop 2024-05-10T05:18:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 -- 172.21.15.47:0/4124203405 shutdown_connections 2024-05-10T05:18:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 --2- 172.21.15.47:0/4124203405 >> v2:172.21.15.117:3300/0 conn(0x7f15e80aa2d0 0x7f15e80aa6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 --2- 172.21.15.47:0/4124203405 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80c8030 0x7f15e80c3840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.488 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 -- 172.21.15.47:0/4124203405 >> 172.21.15.47:0/4124203405 conn(0x7f15e80c86f0 msgr2=0x7f15e80c8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 -- 172.21.15.47:0/4124203405 shutdown_connections 2024-05-10T05:18:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.485+0000 7f15ed800700 1 -- 172.21.15.47:0/4124203405 wait complete. 2024-05-10T05:18:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.487+0000 7f15ed800700 1 Processor -- start 2024-05-10T05:18:57.489 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.487+0000 7f15ed800700 1 -- start start 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15ed800700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80700b0 0x7f15e8158020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15ed800700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80aa2d0 0x7f15e81eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15ed800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 0x7f15e81eb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15ed800700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e814c680 con 0x7f15e80c8030 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15ed800700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15e81ee7b0 con 0x7f15e80700b0 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15ed800700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15e814cf80 con 0x7f15e80aa2d0 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15e7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 0x7f15e81eb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15e7400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 0x7f15e81eb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:56494/0 (socket says 172.21.15.47:56494) 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15e7400700 1 -- 172.21.15.47:0/3313981641 learned_addr learned my addr 172.21.15.47:0/3313981641 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15e6a00700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80700b0 0x7f15e8158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.489+0000 7f15e6000700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80aa2d0 0x7f15e81eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15e7400700 1 -- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80aa2d0 msgr2=0x7f15e81eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:57.492 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15e7400700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80aa2d0 0x7f15e81eeea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15e7400700 1 -- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80700b0 msgr2=0x7f15e8158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15e7400700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80700b0 0x7f15e8158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15e7400700 1 -- 172.21.15.47:0/3313981641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e0009a70 con 0x7f15e80c8030 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15e7400700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 0x7f15e81eb620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f15e000efc0 tx=0x7f15e000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e000cc90 con 0x7f15e80c8030 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15e000f040 con 0x7f15e80c8030 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d80094a0 con 0x7f15e80c8030 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15e0014480 con 0x7f15e80c8030 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.490+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15e80c3690 con 0x7f15e80c8030 2024-05-10T05:18:57.493 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.491+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15e814c810 con 0x7f15e80c8030 2024-05-10T05:18:57.494 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.493+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15e00145e0 con 0x7f15e80c8030 2024-05-10T05:18:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.494+0000 7f15dea00700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:18:57.495 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.494+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f15e008a0d0 con 0x7f15e80c8030 2024-05-10T05:18:57.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.495+0000 7f15e6a00700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:18:57.496 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.495+0000 7f15e6a00700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f15d8000c00 tx=0x7f15d8008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:18:57.500 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.499+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f15e0054e50 con 0x7f15e80c8030 2024-05-10T05:18:57.710 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.709+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15e80c3510 con 0x7f15c806ac90 2024-05-10T05:18:57.722 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.721+0000 7f15dea00700 1 -- 172.21.15.47:0/3313981641 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+369998 (secure 0 0 0) 0x7f15d8011b00 con 0x7f15c806ac90 2024-05-10T05:18:57.727 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 msgr2=0x7f15c806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f15d8000c00 tx=0x7f15d8008030 comp rx=0 tx=0).stop 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 msgr2=0x7f15e81eb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 0x7f15e81eb620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f15e000efc0 tx=0x7f15e000c3a0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 shutdown_connections 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f15e80c8030 0x7f15e81eb620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f15e80700b0 0x7f15e8158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f15c806ac90 0x7f15c806d1a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 --2- 172.21.15.47:0/3313981641 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f15e80aa2d0 0x7f15e81eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 >> 172.21.15.47:0/3313981641 conn(0x7f15e80c86f0 msgr2=0x7f15e80707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 shutdown_connections 2024-05-10T05:18:57.731 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:18:57.726+0000 7f15ed800700 1 -- 172.21.15.47:0/3313981641 wait complete. 2024-05-10T05:18:57.732 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:18:57.757 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":837,"stamp":"2024-05-10T05:18:56.698740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235773933,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":4755,"num_read_kb":580569,"num_write":359369,"num_write_kb":31014503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6380,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529603,"ondisk_log_size":529603,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7006072,"kb_used_data":462904,"kb_used_omap":12,"kb_used_meta":6543091,"kb_avail":747968648,"statfs":{"total":773094113280,"available":765919895552,"internally_reserved":0,"allocated":474013696,"data_stored":472521330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6700125752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":822,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004036"},"pg_stats":[{"pgid":"3.3f","version":"28'1987","reported_seq":2016,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.970045+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T05:18:25.970045+0000","last_peered":"2024-05-10T05:18:25.970045+0000","last_clean":"2024-05-10T05:18:25.970045+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:18:25.970045+0000","last_undegraded":"2024-05-10T05:18:25.970045+0000","last_fullsized":"2024-05-10T05:18:25.970045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1980","reported_seq":2009,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.940590+0000","last_change":"2024-05-10T04:51:52.756766+0000","last_active":"2024-05-10T05:18:25.940590+0000","last_peered":"2024-05-10T05:18:25.940590+0000","last_clean":"2024-05-10T05:18:25.940590+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:25.940590+0000","last_undegraded":"2024-05-10T05:18:25.940590+0000","last_fullsized":"2024-05-10T05:18:25.940590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2129","reported_seq":2158,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.136920+0000","last_change":"2024-05-10T04:51:52.745978+0000","last_active":"2024-05-10T05:18:26.136920+0000","last_peered":"2024-05-10T05:18:26.136920+0000","last_clean":"2024-05-10T05:18:26.136920+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:18:26.136920+0000","last_undegraded":"2024-05-10T05:18:26.136920+0000","last_fullsized":"2024-05-10T05:18:26.136920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2129,"log_dups_size":0,"ondisk_log_size":2129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2105","reported_seq":2135,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.006878+0000","last_change":"2024-05-10T04:51:52.747871+0000","last_active":"2024-05-10T05:18:26.006878+0000","last_peered":"2024-05-10T05:18:26.006878+0000","last_clean":"2024-05-10T05:18:26.006878+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:18:26.006878+0000","last_undegraded":"2024-05-10T05:18:26.006878+0000","last_fullsized":"2024-05-10T05:18:26.006878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2061","reported_seq":2088,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.996930+0000","last_change":"2024-05-10T04:51:52.763146+0000","last_active":"2024-05-10T05:18:25.996930+0000","last_peered":"2024-05-10T05:18:25.996930+0000","last_clean":"2024-05-10T05:18:25.996930+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:18:25.996930+0000","last_undegraded":"2024-05-10T05:18:25.996930+0000","last_fullsized":"2024-05-10T05:18:25.996930+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2061,"log_dups_size":0,"ondisk_log_size":2061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1968","reported_seq":1995,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.023481+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T05:18:26.023481+0000","last_peered":"2024-05-10T05:18:26.023481+0000","last_clean":"2024-05-10T05:18:26.023481+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:18:26.023481+0000","last_undegraded":"2024-05-10T05:18:26.023481+0000","last_fullsized":"2024-05-10T05:18:26.023481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2006","reported_seq":2033,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.947746+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T05:18:25.947746+0000","last_peered":"2024-05-10T05:18:25.947746+0000","last_clean":"2024-05-10T05:18:25.947746+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:18:25.947746+0000","last_undegraded":"2024-05-10T05:18:25.947746+0000","last_fullsized":"2024-05-10T05:18:25.947746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2023","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.005140+0000","last_change":"2024-05-10T04:51:52.738926+0000","last_active":"2024-05-10T05:18:26.005140+0000","last_peered":"2024-05-10T05:18:26.005140+0000","last_clean":"2024-05-10T05:18:26.005140+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:18:26.005140+0000","last_undegraded":"2024-05-10T05:18:26.005140+0000","last_fullsized":"2024-05-10T05:18:26.005140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2083","reported_seq":2111,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.597435+0000","last_change":"2024-05-10T04:51:52.767503+0000","last_active":"2024-05-10T05:18:36.597435+0000","last_peered":"2024-05-10T05:18:36.597435+0000","last_clean":"2024-05-10T05:18:36.597435+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:18:36.597435+0000","last_undegraded":"2024-05-10T05:18:36.597435+0000","last_fullsized":"2024-05-10T05:18:36.597435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2091","reported_seq":2119,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:35.070259+0000","last_change":"2024-05-10T04:51:52.751953+0000","last_active":"2024-05-10T05:18:35.070259+0000","last_peered":"2024-05-10T05:18:35.070259+0000","last_clean":"2024-05-10T05:18:35.070259+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:18:35.070259+0000","last_undegraded":"2024-05-10T05:18:35.070259+0000","last_fullsized":"2024-05-10T05:18:35.070259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1958","reported_seq":1997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.363975+0000","last_change":"2024-05-10T05:18:52.364107+0000","last_active":"2024-05-10T05:18:52.363975+0000","last_peered":"2024-05-10T05:18:52.363975+0000","last_clean":"2024-05-10T05:18:52.363975+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:52.363975+0000","last_undegraded":"2024-05-10T05:18:52.363975+0000","last_fullsized":"2024-05-10T05:18:52.363975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1958","last_scrub_stamp":"2024-05-10T05:18:52.363948+0000","last_deep_scrub":"28'1958","last_deep_scrub_stamp":"2024-05-10T05:18:52.363948+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.363948+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:41.653986+0000","scrub_duration":0.018300833999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.921175+0000","last_change":"2024-05-10T05:18:36.921337+0000","last_active":"2024-05-10T05:18:36.921175+0000","last_peered":"2024-05-10T05:18:36.921175+0000","last_clean":"2024-05-10T05:18:36.921175+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:36.921175+0000","last_undegraded":"2024-05-10T05:18:36.921175+0000","last_fullsized":"2024-05-10T05:18:36.921175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1948","last_scrub_stamp":"2024-05-10T05:18:36.921148+0000","last_deep_scrub":"28'1948","last_deep_scrub_stamp":"2024-05-10T05:18:36.921148+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.921148+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:17.214023+0000","scrub_duration":0.0019686439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2029","reported_seq":2068,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.847677+0000","last_change":"2024-05-10T05:18:33.847792+0000","last_active":"2024-05-10T05:18:33.847677+0000","last_peered":"2024-05-10T05:18:33.847677+0000","last_clean":"2024-05-10T05:18:33.847677+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:33.847677+0000","last_undegraded":"2024-05-10T05:18:33.847677+0000","last_fullsized":"2024-05-10T05:18:33.847677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2029","last_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_deep_scrub":"28'2029","last_deep_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.847651+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:17.105998+0000","scrub_duration":0.018189367000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'2006","reported_seq":2034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.135282+0000","last_change":"2024-05-10T04:51:52.749969+0000","last_active":"2024-05-10T05:18:26.135282+0000","last_peered":"2024-05-10T05:18:26.135282+0000","last_clean":"2024-05-10T05:18:26.135282+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:18:26.135282+0000","last_undegraded":"2024-05-10T05:18:26.135282+0000","last_fullsized":"2024-05-10T05:18:26.135282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2108","reported_seq":2136,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980583+0000","last_change":"2024-05-10T04:51:52.741695+0000","last_active":"2024-05-10T05:18:25.980583+0000","last_peered":"2024-05-10T05:18:25.980583+0000","last_clean":"2024-05-10T05:18:25.980583+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:25.980583+0000","last_undegraded":"2024-05-10T05:18:25.980583+0000","last_fullsized":"2024-05-10T05:18:25.980583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2108,"log_dups_size":0,"ondisk_log_size":2108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1994","reported_seq":2022,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.134172+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T05:18:26.134172+0000","last_peered":"2024-05-10T05:18:26.134172+0000","last_clean":"2024-05-10T05:18:26.134172+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:18:26.134172+0000","last_undegraded":"2024-05-10T05:18:26.134172+0000","last_fullsized":"2024-05-10T05:18:26.134172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:38.044150+0000","last_change":"2024-05-10T05:18:38.044283+0000","last_active":"2024-05-10T05:18:38.044150+0000","last_peered":"2024-05-10T05:18:38.044150+0000","last_clean":"2024-05-10T05:18:38.044150+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:38.044150+0000","last_undegraded":"2024-05-10T05:18:38.044150+0000","last_fullsized":"2024-05-10T05:18:38.044150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:18:38.044115+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:18:38.044115+0000","last_clean_scrub_stamp":"2024-05-10T05:18:38.044115+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:54:20.224156+0000","scrub_duration":0.033850064999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1994","reported_seq":2033,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.488895+0000","last_change":"2024-05-10T05:18:48.489025+0000","last_active":"2024-05-10T05:18:48.488895+0000","last_peered":"2024-05-10T05:18:48.488895+0000","last_clean":"2024-05-10T05:18:48.488895+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:48.488895+0000","last_undegraded":"2024-05-10T05:18:48.488895+0000","last_fullsized":"2024-05-10T05:18:48.488895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:18:48.488869+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:18:48.488869+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.488869+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:42.641061+0000","scrub_duration":0.0021049350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2104","reported_seq":2132,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.132551+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T05:18:26.132551+0000","last_peered":"2024-05-10T05:18:26.132551+0000","last_clean":"2024-05-10T05:18:26.132551+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:18:26.132551+0000","last_undegraded":"2024-05-10T05:18:26.132551+0000","last_fullsized":"2024-05-10T05:18:26.132551+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.111143+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T05:18:33.111143+0000","last_peered":"2024-05-10T05:18:33.111143+0000","last_clean":"2024-05-10T05:18:33.111143+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:18:33.111143+0000","last_undegraded":"2024-05-10T05:18:33.111143+0000","last_fullsized":"2024-05-10T05:18:33.111143+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1893","reported_seq":1934,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.189774+0000","last_change":"2024-05-10T05:18:36.189902+0000","last_active":"2024-05-10T05:18:36.189774+0000","last_peered":"2024-05-10T05:18:36.189774+0000","last_clean":"2024-05-10T05:18:36.189774+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:36.189774+0000","last_undegraded":"2024-05-10T05:18:36.189774+0000","last_fullsized":"2024-05-10T05:18:36.189774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1893","last_scrub_stamp":"2024-05-10T05:18:36.189732+0000","last_deep_scrub":"28'1893","last_deep_scrub_stamp":"2024-05-10T05:18:36.189732+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.189732+0000","objects_scrubbed":2,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:57:40.485840+0000","scrub_duration":0.006777127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1915,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2039","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.932859+0000","last_change":"2024-05-10T04:51:52.756362+0000","last_active":"2024-05-10T05:18:25.932859+0000","last_peered":"2024-05-10T05:18:25.932859+0000","last_clean":"2024-05-10T05:18:25.932859+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:18:25.932859+0000","last_undegraded":"2024-05-10T05:18:25.932859+0000","last_fullsized":"2024-05-10T05:18:25.932859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.987680+0000","last_change":"2024-05-10T04:51:57.181023+0000","last_active":"2024-05-10T05:18:33.987680+0000","last_peered":"2024-05-10T05:18:33.987680+0000","last_clean":"2024-05-10T05:18:33.987680+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:18:33.987680+0000","last_undegraded":"2024-05-10T05:18:33.987680+0000","last_fullsized":"2024-05-10T05:18:33.987680+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6436","reported_seq":6478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.018633+0000","last_change":"2024-05-10T05:18:49.018746+0000","last_active":"2024-05-10T05:18:49.018633+0000","last_peered":"2024-05-10T05:18:49.018633+0000","last_clean":"2024-05-10T05:18:49.018633+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:49.018633+0000","last_undegraded":"2024-05-10T05:18:49.018633+0000","last_fullsized":"2024-05-10T05:18:49.018633+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6436","last_scrub_stamp":"2024-05-10T05:18:49.018608+0000","last_deep_scrub":"28'6436","last_deep_scrub_stamp":"2024-05-10T05:18:49.018608+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.018608+0000","objects_scrubbed":2,"log_size":6336,"log_dups_size":0,"ondisk_log_size":6336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:29.024164+0000","scrub_duration":0.035903804999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2041","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.129631+0000","last_change":"2024-05-10T04:51:52.754223+0000","last_active":"2024-05-10T05:18:26.129631+0000","last_peered":"2024-05-10T05:18:26.129631+0000","last_clean":"2024-05-10T05:18:26.129631+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:26.129631+0000","last_undegraded":"2024-05-10T05:18:26.129631+0000","last_fullsized":"2024-05-10T05:18:26.129631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7723,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.767377+0000","last_change":"2024-05-10T04:51:57.172234+0000","last_active":"2024-05-10T05:18:21.767377+0000","last_peered":"2024-05-10T05:18:21.767377+0000","last_clean":"2024-05-10T05:18:21.767377+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:18:21.767377+0000","last_undegraded":"2024-05-10T05:18:21.767377+0000","last_fullsized":"2024-05-10T05:18:21.767377+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9867","reported_seq":9895,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.295138+0000","last_change":"2024-05-10T04:51:52.147831+0000","last_active":"2024-05-10T05:18:23.295138+0000","last_peered":"2024-05-10T05:18:23.295138+0000","last_clean":"2024-05-10T05:18:23.295138+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:23.295138+0000","last_undegraded":"2024-05-10T05:18:23.295138+0000","last_fullsized":"2024-05-10T05:18:23.295138+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":7067,"log_dups_size":0,"ondisk_log_size":7067,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9870,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2094","reported_seq":2115,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.994347+0000","last_change":"2024-05-10T04:52:40.336526+0000","last_active":"2024-05-10T05:18:25.994347+0000","last_peered":"2024-05-10T05:18:25.994347+0000","last_clean":"2024-05-10T05:18:25.994347+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:18:25.994347+0000","last_undegraded":"2024-05-10T05:18:25.994347+0000","last_fullsized":"2024-05-10T05:18:25.994347+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:50.926158+0000","last_change":"2024-05-10T05:18:50.926397+0000","last_active":"2024-05-10T05:18:50.926158+0000","last_peered":"2024-05-10T05:18:50.926158+0000","last_clean":"2024-05-10T05:18:50.926158+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:50.926158+0000","last_undegraded":"2024-05-10T05:18:50.926158+0000","last_fullsized":"2024-05-10T05:18:50.926158+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7416","last_scrub_stamp":"2024-05-10T05:18:50.926128+0000","last_deep_scrub":"28'7416","last_deep_scrub_stamp":"2024-05-10T05:18:50.926128+0000","last_clean_scrub_stamp":"2024-05-10T05:18:50.926128+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:08.428647+0000","scrub_duration":0.048600009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5469","reported_seq":5497,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.277375+0000","last_change":"2024-05-10T04:51:52.149656+0000","last_active":"2024-05-10T05:18:23.277375+0000","last_peered":"2024-05-10T05:18:23.277375+0000","last_clean":"2024-05-10T05:18:23.277375+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:18:23.277375+0000","last_undegraded":"2024-05-10T05:18:23.277375+0000","last_fullsized":"2024-05-10T05:18:23.277375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5469,"log_dups_size":0,"ondisk_log_size":5469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5469,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2034","reported_seq":2061,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.025679+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T05:18:26.025679+0000","last_peered":"2024-05-10T05:18:26.025679+0000","last_clean":"2024-05-10T05:18:26.025679+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:18:26.025679+0000","last_undegraded":"2024-05-10T05:18:26.025679+0000","last_fullsized":"2024-05-10T05:18:26.025679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7514","reported_seq":7578,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.137852+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T05:18:26.137852+0000","last_peered":"2024-05-10T05:18:26.137852+0000","last_clean":"2024-05-10T05:18:26.137852+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:18:26.137852+0000","last_undegraded":"2024-05-10T05:18:26.137852+0000","last_fullsized":"2024-05-10T05:18:26.137852+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5295,"num_write_kb":976486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8794","reported_seq":8833,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.149854+0000","last_change":"2024-05-10T05:18:47.149956+0000","last_active":"2024-05-10T05:18:47.149854+0000","last_peered":"2024-05-10T05:18:47.149854+0000","last_clean":"2024-05-10T05:18:47.149854+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:47.149854+0000","last_undegraded":"2024-05-10T05:18:47.149854+0000","last_fullsized":"2024-05-10T05:18:47.149854+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8794","last_scrub_stamp":"2024-05-10T05:18:47.149826+0000","last_deep_scrub":"28'8794","last_deep_scrub_stamp":"2024-05-10T05:18:47.149826+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.149826+0000","objects_scrubbed":6,"log_size":6294,"log_dups_size":0,"ondisk_log_size":6294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:24.339435+0000","scrub_duration":0.095680271999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.891952+0000","last_change":"2024-05-10T05:18:40.892088+0000","last_active":"2024-05-10T05:18:40.891952+0000","last_peered":"2024-05-10T05:18:40.891952+0000","last_clean":"2024-05-10T05:18:40.891952+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:40.891952+0000","last_undegraded":"2024-05-10T05:18:40.891952+0000","last_fullsized":"2024-05-10T05:18:40.891952+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2072","last_scrub_stamp":"2024-05-10T05:18:40.891925+0000","last_deep_scrub":"28'2072","last_deep_scrub_stamp":"2024-05-10T05:18:40.891925+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.891925+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:47.245425+0000","scrub_duration":0.0121844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.254302+0000","last_change":"2024-05-10T04:52:40.388737+0000","last_active":"2024-05-10T05:18:23.254302+0000","last_peered":"2024-05-10T05:18:23.254302+0000","last_clean":"2024-05-10T05:18:23.254302+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:23.254302+0000","last_undegraded":"2024-05-10T05:18:23.254302+0000","last_fullsized":"2024-05-10T05:18:23.254302+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9793","reported_seq":9832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.398108+0000","last_change":"2024-05-10T05:18:44.398230+0000","last_active":"2024-05-10T05:18:44.398108+0000","last_peered":"2024-05-10T05:18:44.398108+0000","last_clean":"2024-05-10T05:18:44.398108+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:44.398108+0000","last_undegraded":"2024-05-10T05:18:44.398108+0000","last_fullsized":"2024-05-10T05:18:44.398108+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9793","last_scrub_stamp":"2024-05-10T05:18:44.398080+0000","last_deep_scrub":"28'9793","last_deep_scrub_stamp":"2024-05-10T05:18:44.398080+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.398080+0000","objects_scrubbed":5,"log_size":7993,"log_dups_size":0,"ondisk_log_size":7993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:44.122929+0000","scrub_duration":0.088564188000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2031","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.257657+0000","last_change":"2024-05-10T05:18:44.257816+0000","last_active":"2024-05-10T05:18:44.257657+0000","last_peered":"2024-05-10T05:18:44.257657+0000","last_clean":"2024-05-10T05:18:44.257657+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:44.257657+0000","last_undegraded":"2024-05-10T05:18:44.257657+0000","last_fullsized":"2024-05-10T05:18:44.257657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2031","last_scrub_stamp":"2024-05-10T05:18:44.257627+0000","last_deep_scrub":"28'2031","last_deep_scrub_stamp":"2024-05-10T05:18:44.257627+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.257627+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:43.057150+0000","scrub_duration":0.0094484070000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7236","reported_seq":7479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.136551+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T05:18:26.136551+0000","last_peered":"2024-05-10T05:18:26.136551+0000","last_clean":"2024-05-10T05:18:26.136551+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:18:26.136551+0000","last_undegraded":"2024-05-10T05:18:26.136551+0000","last_fullsized":"2024-05-10T05:18:26.136551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5149,"num_write_kb":870343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4835","reported_seq":4875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:45.041921+0000","last_change":"2024-05-10T05:18:45.042028+0000","last_active":"2024-05-10T05:18:45.041921+0000","last_peered":"2024-05-10T05:18:45.041921+0000","last_clean":"2024-05-10T05:18:45.041921+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:45.041921+0000","last_undegraded":"2024-05-10T05:18:45.041921+0000","last_fullsized":"2024-05-10T05:18:45.041921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4835","last_scrub_stamp":"2024-05-10T05:18:45.041892+0000","last_deep_scrub":"28'4835","last_deep_scrub_stamp":"2024-05-10T05:18:45.041892+0000","last_clean_scrub_stamp":"2024-05-10T05:18:45.041892+0000","objects_scrubbed":2,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:49.460665+0000","scrub_duration":0.031114352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2106","reported_seq":2145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.975043+0000","last_change":"2024-05-10T05:18:53.975155+0000","last_active":"2024-05-10T05:18:53.975043+0000","last_peered":"2024-05-10T05:18:53.975043+0000","last_clean":"2024-05-10T05:18:53.975043+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:53.975043+0000","last_undegraded":"2024-05-10T05:18:53.975043+0000","last_fullsized":"2024-05-10T05:18:53.975043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2106","last_scrub_stamp":"2024-05-10T05:18:53.975013+0000","last_deep_scrub":"28'2106","last_deep_scrub_stamp":"2024-05-10T05:18:53.975013+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.975013+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:32.059839+0000","scrub_duration":0.0019932040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7811,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.692175+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T05:18:21.692175+0000","last_peered":"2024-05-10T05:18:21.692175+0000","last_clean":"2024-05-10T05:18:21.692175+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:18:21.692175+0000","last_undegraded":"2024-05-10T05:18:21.692175+0000","last_fullsized":"2024-05-10T05:18:21.692175+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9720","reported_seq":9760,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.873540+0000","last_change":"2024-05-10T05:18:52.873661+0000","last_active":"2024-05-10T05:18:52.873540+0000","last_peered":"2024-05-10T05:18:52.873540+0000","last_clean":"2024-05-10T05:18:52.873540+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:18:52.873540+0000","last_undegraded":"2024-05-10T05:18:52.873540+0000","last_fullsized":"2024-05-10T05:18:52.873540+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9720","last_scrub_stamp":"2024-05-10T05:18:52.873508+0000","last_deep_scrub":"28'9720","last_deep_scrub_stamp":"2024-05-10T05:18:52.873508+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.873508+0000","objects_scrubbed":1,"log_size":7520,"log_dups_size":0,"ondisk_log_size":7520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:53.278672+0000","scrub_duration":0.023067694999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2011","reported_seq":2039,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:31.366430+0000","last_change":"2024-05-10T04:51:52.750746+0000","last_active":"2024-05-10T05:18:31.366430+0000","last_peered":"2024-05-10T05:18:31.366430+0000","last_clean":"2024-05-10T05:18:31.366430+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:31.366430+0000","last_undegraded":"2024-05-10T05:18:31.366430+0000","last_fullsized":"2024-05-10T05:18:31.366430+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.260791+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T05:18:23.260791+0000","last_peered":"2024-05-10T05:18:23.260791+0000","last_clean":"2024-05-10T05:18:23.260791+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:18:23.260791+0000","last_undegraded":"2024-05-10T05:18:23.260791+0000","last_fullsized":"2024-05-10T05:18:23.260791+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6187","reported_seq":6969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.342323+0000","last_change":"2024-05-10T05:18:48.342476+0000","last_active":"2024-05-10T05:18:48.342323+0000","last_peered":"2024-05-10T05:18:48.342323+0000","last_clean":"2024-05-10T05:18:48.342323+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:48.342323+0000","last_undegraded":"2024-05-10T05:18:48.342323+0000","last_fullsized":"2024-05-10T05:18:48.342323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6187","last_scrub_stamp":"2024-05-10T05:18:48.342269+0000","last_deep_scrub":"28'6187","last_deep_scrub_stamp":"2024-05-10T05:18:48.342269+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.342269+0000","objects_scrubbed":3,"log_size":6187,"log_dups_size":0,"ondisk_log_size":6187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:42.585826+0000","scrub_duration":0.053531205999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11372145,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6181,"num_write_kb":47965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2046","reported_seq":2074,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:28.029099+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T05:18:28.029099+0000","last_peered":"2024-05-10T05:18:28.029099+0000","last_clean":"2024-05-10T05:18:28.029099+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:18:28.029099+0000","last_undegraded":"2024-05-10T05:18:28.029099+0000","last_fullsized":"2024-05-10T05:18:28.029099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7408","reported_seq":7470,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.144245+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T05:18:26.144245+0000","last_peered":"2024-05-10T05:18:26.144245+0000","last_clean":"2024-05-10T05:18:26.144245+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:18:26.144245+0000","last_undegraded":"2024-05-10T05:18:26.144245+0000","last_fullsized":"2024-05-10T05:18:26.144245+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6304,"log_dups_size":0,"ondisk_log_size":6304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5304,"num_write_kb":989379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6457","reported_seq":6486,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:28.029077+0000","last_change":"2024-05-10T04:51:52.139794+0000","last_active":"2024-05-10T05:18:28.029077+0000","last_peered":"2024-05-10T05:18:28.029077+0000","last_clean":"2024-05-10T05:18:28.029077+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:18:28.029077+0000","last_undegraded":"2024-05-10T05:18:28.029077+0000","last_fullsized":"2024-05-10T05:18:28.029077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":6457,"log_dups_size":0,"ondisk_log_size":6457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6459,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2058","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.294133+0000","last_change":"2024-05-10T05:18:42.294264+0000","last_active":"2024-05-10T05:18:42.294133+0000","last_peered":"2024-05-10T05:18:42.294133+0000","last_clean":"2024-05-10T05:18:42.294133+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:42.294133+0000","last_undegraded":"2024-05-10T05:18:42.294133+0000","last_fullsized":"2024-05-10T05:18:42.294133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2058","last_scrub_stamp":"2024-05-10T05:18:42.294102+0000","last_deep_scrub":"28'2058","last_deep_scrub_stamp":"2024-05-10T05:18:42.294102+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.294102+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:19.483711+0000","scrub_duration":0.026468472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.896626+0000","last_change":"2024-05-10T05:18:55.896808+0000","last_active":"2024-05-10T05:18:55.896626+0000","last_peered":"2024-05-10T05:18:55.896626+0000","last_clean":"2024-05-10T05:18:55.896626+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:55.896626+0000","last_undegraded":"2024-05-10T05:18:55.896626+0000","last_fullsized":"2024-05-10T05:18:55.896626+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7585","last_scrub_stamp":"2024-05-10T05:18:55.896595+0000","last_deep_scrub":"28'7585","last_deep_scrub_stamp":"2024-05-10T05:18:55.896595+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.896595+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:42.760602+0000","scrub_duration":0.041604107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5960","reported_seq":5989,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.154248+0000","last_change":"2024-05-10T04:51:52.138184+0000","last_active":"2024-05-10T05:18:26.154248+0000","last_peered":"2024-05-10T05:18:26.154248+0000","last_clean":"2024-05-10T05:18:26.154248+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:26.154248+0000","last_undegraded":"2024-05-10T05:18:26.154248+0000","last_fullsized":"2024-05-10T05:18:26.154248+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":5960,"log_dups_size":0,"ondisk_log_size":5960,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":37127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:43.908832+0000","last_change":"2024-05-10T05:18:43.908970+0000","last_active":"2024-05-10T05:18:43.908832+0000","last_peered":"2024-05-10T05:18:43.908832+0000","last_clean":"2024-05-10T05:18:43.908832+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:43.908832+0000","last_undegraded":"2024-05-10T05:18:43.908832+0000","last_fullsized":"2024-05-10T05:18:43.908832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2047","last_scrub_stamp":"2024-05-10T05:18:43.908805+0000","last_deep_scrub":"28'2047","last_deep_scrub_stamp":"2024-05-10T05:18:43.908805+0000","last_clean_scrub_stamp":"2024-05-10T05:18:43.908805+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:53.670148+0000","scrub_duration":0.0019465979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7575","reported_seq":7641,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.143998+0000","last_change":"2024-05-10T04:51:57.166645+0000","last_active":"2024-05-10T05:18:26.143998+0000","last_peered":"2024-05-10T05:18:26.143998+0000","last_clean":"2024-05-10T05:18:26.143998+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:18:26.143998+0000","last_undegraded":"2024-05-10T05:18:26.143998+0000","last_fullsized":"2024-05-10T05:18:26.143998+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7375,"log_dups_size":0,"ondisk_log_size":7375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5441,"num_write_kb":923430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9434","reported_seq":10141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:39.429029+0000","last_change":"2024-05-10T05:18:39.429149+0000","last_active":"2024-05-10T05:18:39.429029+0000","last_peered":"2024-05-10T05:18:39.429029+0000","last_clean":"2024-05-10T05:18:39.429029+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:39.429029+0000","last_undegraded":"2024-05-10T05:18:39.429029+0000","last_fullsized":"2024-05-10T05:18:39.429029+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9434","last_scrub_stamp":"2024-05-10T05:18:39.429006+0000","last_deep_scrub":"28'9434","last_deep_scrub_stamp":"2024-05-10T05:18:39.429006+0000","last_clean_scrub_stamp":"2024-05-10T05:18:39.429006+0000","objects_scrubbed":8,"log_size":7934,"log_dups_size":0,"ondisk_log_size":7934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:06.400181+0000","scrub_duration":0.080354881000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9422,"num_write_kb":67821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1992","reported_seq":2020,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:31.882823+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T05:18:31.882823+0000","last_peered":"2024-05-10T05:18:31.882823+0000","last_clean":"2024-05-10T05:18:31.882823+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:18:31.882823+0000","last_undegraded":"2024-05-10T05:18:31.882823+0000","last_fullsized":"2024-05-10T05:18:31.882823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.028372+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T05:18:23.028372+0000","last_peered":"2024-05-10T05:18:23.028372+0000","last_clean":"2024-05-10T05:18:23.028372+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:18:23.028372+0000","last_undegraded":"2024-05-10T05:18:23.028372+0000","last_fullsized":"2024-05-10T05:18:23.028372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4835","reported_seq":4875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:35.257270+0000","last_change":"2024-05-10T05:18:35.257379+0000","last_active":"2024-05-10T05:18:35.257270+0000","last_peered":"2024-05-10T05:18:35.257270+0000","last_clean":"2024-05-10T05:18:35.257270+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:18:35.257270+0000","last_undegraded":"2024-05-10T05:18:35.257270+0000","last_fullsized":"2024-05-10T05:18:35.257270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4835","last_scrub_stamp":"2024-05-10T05:18:35.257245+0000","last_deep_scrub":"28'4835","last_deep_scrub_stamp":"2024-05-10T05:18:35.257245+0000","last_clean_scrub_stamp":"2024-05-10T05:18:35.257245+0000","objects_scrubbed":4,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:26.581951+0000","scrub_duration":0.037039299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4833,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2054","reported_seq":2093,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.334744+0000","last_change":"2024-05-10T05:18:49.334848+0000","last_active":"2024-05-10T05:18:49.334744+0000","last_peered":"2024-05-10T05:18:49.334744+0000","last_clean":"2024-05-10T05:18:49.334744+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:49.334744+0000","last_undegraded":"2024-05-10T05:18:49.334744+0000","last_fullsized":"2024-05-10T05:18:49.334744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2054","last_scrub_stamp":"2024-05-10T05:18:49.334712+0000","last_deep_scrub":"28'2054","last_deep_scrub_stamp":"2024-05-10T05:18:49.334712+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.334712+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:27.419539+0000","scrub_duration":0.002887634,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.780712+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T05:18:21.780712+0000","last_peered":"2024-05-10T05:18:21.780712+0000","last_clean":"2024-05-10T05:18:21.780712+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:18:21.780712+0000","last_undegraded":"2024-05-10T05:18:21.780712+0000","last_fullsized":"2024-05-10T05:18:21.780712+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2076","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.283768+0000","last_change":"2024-05-10T04:51:52.139987+0000","last_active":"2024-05-10T05:18:23.283768+0000","last_peered":"2024-05-10T05:18:23.283768+0000","last_clean":"2024-05-10T05:18:23.283768+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:18:23.283768+0000","last_undegraded":"2024-05-10T05:18:23.283768+0000","last_fullsized":"2024-05-10T05:18:23.283768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2076,"log_dups_size":0,"ondisk_log_size":2076,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2091,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2077","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.000219+0000","last_change":"2024-05-10T04:51:52.776068+0000","last_active":"2024-05-10T05:18:26.000219+0000","last_peered":"2024-05-10T05:18:26.000219+0000","last_clean":"2024-05-10T05:18:26.000219+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:26.000219+0000","last_undegraded":"2024-05-10T05:18:26.000219+0000","last_fullsized":"2024-05-10T05:18:26.000219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7643,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.111040+0000","last_change":"2024-05-10T04:52:41.239639+0000","last_active":"2024-05-10T05:18:33.111040+0000","last_peered":"2024-05-10T05:18:33.111040+0000","last_clean":"2024-05-10T05:18:33.111040+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:18:33.111040+0000","last_undegraded":"2024-05-10T05:18:33.111040+0000","last_fullsized":"2024-05-10T05:18:33.111040+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.358849+0000","last_change":"2024-05-10T05:18:40.358971+0000","last_active":"2024-05-10T05:18:40.358849+0000","last_peered":"2024-05-10T05:18:40.358849+0000","last_clean":"2024-05-10T05:18:40.358849+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:40.358849+0000","last_undegraded":"2024-05-10T05:18:40.358849+0000","last_fullsized":"2024-05-10T05:18:40.358849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2440","last_scrub_stamp":"2024-05-10T05:18:40.358819+0000","last_deep_scrub":"28'2440","last_deep_scrub_stamp":"2024-05-10T05:18:40.358819+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.358819+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:23.617166+0000","scrub_duration":0.0046993249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2008","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:51.331886+0000","last_change":"2024-05-10T05:18:51.332028+0000","last_active":"2024-05-10T05:18:51.331886+0000","last_peered":"2024-05-10T05:18:51.331886+0000","last_clean":"2024-05-10T05:18:51.331886+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:51.331886+0000","last_undegraded":"2024-05-10T05:18:51.331886+0000","last_fullsized":"2024-05-10T05:18:51.331886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2008","last_scrub_stamp":"2024-05-10T05:18:51.331859+0000","last_deep_scrub":"28'2008","last_deep_scrub_stamp":"2024-05-10T05:18:51.331859+0000","last_clean_scrub_stamp":"2024-05-10T05:18:51.331859+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:55.750632+0000","scrub_duration":0.0023987499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:30.498059+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T05:18:30.498059+0000","last_peered":"2024-05-10T05:18:30.498059+0000","last_clean":"2024-05-10T05:18:30.498059+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:18:30.498059+0000","last_undegraded":"2024-05-10T05:18:30.498059+0000","last_fullsized":"2024-05-10T05:18:30.498059+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3410","reported_seq":3450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.526731+0000","last_change":"2024-05-10T05:18:33.526835+0000","last_active":"2024-05-10T05:18:33.526731+0000","last_peered":"2024-05-10T05:18:33.526731+0000","last_clean":"2024-05-10T05:18:33.526731+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:33.526731+0000","last_undegraded":"2024-05-10T05:18:33.526731+0000","last_fullsized":"2024-05-10T05:18:33.526731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3410","last_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_deep_scrub":"28'3410","last_deep_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.526706+0000","objects_scrubbed":6,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:30.870417+0000","scrub_duration":0.035523645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3414,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2093","reported_seq":2115,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.994534+0000","last_change":"2024-05-10T04:52:40.334760+0000","last_active":"2024-05-10T05:18:25.994534+0000","last_peered":"2024-05-10T05:18:25.994534+0000","last_clean":"2024-05-10T05:18:25.994534+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:18:25.994534+0000","last_undegraded":"2024-05-10T05:18:25.994534+0000","last_fullsized":"2024-05-10T05:18:25.994534+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7497,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.702730+0000","last_change":"2024-05-10T04:51:57.175218+0000","last_active":"2024-05-10T05:18:21.702730+0000","last_peered":"2024-05-10T05:18:21.702730+0000","last_clean":"2024-05-10T05:18:21.702730+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:18:21.702730+0000","last_undegraded":"2024-05-10T05:18:21.702730+0000","last_fullsized":"2024-05-10T05:18:21.702730+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4732","reported_seq":4772,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.007304+0000","last_change":"2024-05-10T05:18:36.007422+0000","last_active":"2024-05-10T05:18:36.007304+0000","last_peered":"2024-05-10T05:18:36.007304+0000","last_clean":"2024-05-10T05:18:36.007304+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:36.007304+0000","last_undegraded":"2024-05-10T05:18:36.007304+0000","last_fullsized":"2024-05-10T05:18:36.007304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4732","last_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_deep_scrub":"28'4732","last_deep_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.007270+0000","objects_scrubbed":4,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:36.412434+0000","scrub_duration":0.047935197999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2048","reported_seq":2076,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.129715+0000","last_change":"2024-05-10T04:51:52.776341+0000","last_active":"2024-05-10T05:18:26.129715+0000","last_peered":"2024-05-10T05:18:26.129715+0000","last_clean":"2024-05-10T05:18:26.129715+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:18:26.129715+0000","last_undegraded":"2024-05-10T05:18:26.129715+0000","last_fullsized":"2024-05-10T05:18:26.129715+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7929,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.776491+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T05:18:21.776491+0000","last_peered":"2024-05-10T05:18:21.776491+0000","last_clean":"2024-05-10T05:18:21.776491+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:18:21.776491+0000","last_undegraded":"2024-05-10T05:18:21.776491+0000","last_fullsized":"2024-05-10T05:18:21.776491+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6065","reported_seq":6106,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.318353+0000","last_change":"2024-05-10T05:18:49.318485+0000","last_active":"2024-05-10T05:18:49.318353+0000","last_peered":"2024-05-10T05:18:49.318353+0000","last_clean":"2024-05-10T05:18:49.318353+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:49.318353+0000","last_undegraded":"2024-05-10T05:18:49.318353+0000","last_fullsized":"2024-05-10T05:18:49.318353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6065","last_scrub_stamp":"2024-05-10T05:18:49.318323+0000","last_deep_scrub":"28'6065","last_deep_scrub_stamp":"2024-05-10T05:18:49.318323+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.318323+0000","objects_scrubbed":2,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:32.576670+0000","scrub_duration":0.033539357999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6068,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2026","reported_seq":2055,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.024642+0000","last_change":"2024-05-10T04:51:52.737225+0000","last_active":"2024-05-10T05:18:26.024642+0000","last_peered":"2024-05-10T05:18:26.024642+0000","last_clean":"2024-05-10T05:18:26.024642+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:18:26.024642+0000","last_undegraded":"2024-05-10T05:18:26.024642+0000","last_fullsized":"2024-05-10T05:18:26.024642+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8412,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.773846+0000","last_change":"2024-05-10T04:51:57.179415+0000","last_active":"2024-05-10T05:18:21.773846+0000","last_peered":"2024-05-10T05:18:21.773846+0000","last_clean":"2024-05-10T05:18:21.773846+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:18:21.773846+0000","last_undegraded":"2024-05-10T05:18:21.773846+0000","last_fullsized":"2024-05-10T05:18:21.773846+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7063","reported_seq":7104,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.933766+0000","last_change":"2024-05-10T05:18:44.933890+0000","last_active":"2024-05-10T05:18:44.933766+0000","last_peered":"2024-05-10T05:18:44.933766+0000","last_clean":"2024-05-10T05:18:44.933766+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:18:44.933766+0000","last_undegraded":"2024-05-10T05:18:44.933766+0000","last_fullsized":"2024-05-10T05:18:44.933766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7063","last_scrub_stamp":"2024-05-10T05:18:44.933739+0000","last_deep_scrub":"28'7063","last_deep_scrub_stamp":"2024-05-10T05:18:44.933739+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.933739+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:39.085930+0000","scrub_duration":0.0063213080000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7059,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2111,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:46.916369+0000","last_change":"2024-05-10T05:18:46.916485+0000","last_active":"2024-05-10T05:18:46.916369+0000","last_peered":"2024-05-10T05:18:46.916369+0000","last_clean":"2024-05-10T05:18:46.916369+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:46.916369+0000","last_undegraded":"2024-05-10T05:18:46.916369+0000","last_fullsized":"2024-05-10T05:18:46.916369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2071","last_scrub_stamp":"2024-05-10T05:18:46.916337+0000","last_deep_scrub":"28'2071","last_deep_scrub_stamp":"2024-05-10T05:18:46.916337+0000","last_clean_scrub_stamp":"2024-05-10T05:18:46.916337+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:01.236515+0000","scrub_duration":0.0041311799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7589,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.717999+0000","last_change":"2024-05-10T04:51:57.183012+0000","last_active":"2024-05-10T05:18:21.717999+0000","last_peered":"2024-05-10T05:18:21.717999+0000","last_clean":"2024-05-10T05:18:21.717999+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:18:21.717999+0000","last_undegraded":"2024-05-10T05:18:21.717999+0000","last_fullsized":"2024-05-10T05:18:21.717999+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2059","reported_seq":2089,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.135178+0000","last_change":"2024-05-10T04:51:52.737948+0000","last_active":"2024-05-10T05:18:26.135178+0000","last_peered":"2024-05-10T05:18:26.135178+0000","last_clean":"2024-05-10T05:18:26.135178+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:26.135178+0000","last_undegraded":"2024-05-10T05:18:26.135178+0000","last_fullsized":"2024-05-10T05:18:26.135178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:43.442911+0000","last_change":"2024-05-10T05:18:43.443028+0000","last_active":"2024-05-10T05:18:43.442911+0000","last_peered":"2024-05-10T05:18:43.442911+0000","last_clean":"2024-05-10T05:18:43.442911+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:43.442911+0000","last_undegraded":"2024-05-10T05:18:43.442911+0000","last_fullsized":"2024-05-10T05:18:43.442911+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5855","last_scrub_stamp":"2024-05-10T05:18:43.442882+0000","last_deep_scrub":"28'5855","last_deep_scrub_stamp":"2024-05-10T05:18:43.442882+0000","last_clean_scrub_stamp":"2024-05-10T05:18:43.442882+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:57.851745+0000","scrub_duration":0.0054037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7597,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.771889+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T05:18:21.771889+0000","last_peered":"2024-05-10T05:18:21.771889+0000","last_clean":"2024-05-10T05:18:21.771889+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:18:21.771889+0000","last_undegraded":"2024-05-10T05:18:21.771889+0000","last_fullsized":"2024-05-10T05:18:21.771889+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2085","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.014533+0000","last_change":"2024-05-10T04:51:52.731716+0000","last_active":"2024-05-10T05:18:26.014533+0000","last_peered":"2024-05-10T05:18:26.014533+0000","last_clean":"2024-05-10T05:18:26.014533+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:18:26.014533+0000","last_undegraded":"2024-05-10T05:18:26.014533+0000","last_fullsized":"2024-05-10T05:18:26.014533+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4532","reported_seq":4573,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.036996+0000","last_change":"2024-05-10T05:18:41.037113+0000","last_active":"2024-05-10T05:18:41.036996+0000","last_peered":"2024-05-10T05:18:41.036996+0000","last_clean":"2024-05-10T05:18:41.036996+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:18:41.036996+0000","last_undegraded":"2024-05-10T05:18:41.036996+0000","last_fullsized":"2024-05-10T05:18:41.036996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4532","last_scrub_stamp":"2024-05-10T05:18:41.036968+0000","last_deep_scrub":"28'4532","last_deep_scrub_stamp":"2024-05-10T05:18:41.036968+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.036968+0000","objects_scrubbed":0,"log_size":4532,"log_dups_size":0,"ondisk_log_size":4532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:17.427232+0000","scrub_duration":0.0040866000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4533,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.548160+0000","last_change":"2024-05-10T05:18:44.548319+0000","last_active":"2024-05-10T05:18:44.548160+0000","last_peered":"2024-05-10T05:18:44.548160+0000","last_clean":"2024-05-10T05:18:44.548160+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:18:44.548160+0000","last_undegraded":"2024-05-10T05:18:44.548160+0000","last_fullsized":"2024-05-10T05:18:44.548160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-05-10T05:18:44.548136+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-05-10T05:18:44.548136+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.548136+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:11.519311+0000","scrub_duration":0.0075957919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.745711+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T05:18:21.745711+0000","last_peered":"2024-05-10T05:18:21.745711+0000","last_clean":"2024-05-10T05:18:21.745711+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:18:21.745711+0000","last_undegraded":"2024-05-10T05:18:21.745711+0000","last_fullsized":"2024-05-10T05:18:21.745711+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1994","reported_seq":2034,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.210435+0000","last_change":"2024-05-10T05:18:40.210587+0000","last_active":"2024-05-10T05:18:40.210435+0000","last_peered":"2024-05-10T05:18:40.210435+0000","last_clean":"2024-05-10T05:18:40.210435+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:40.210435+0000","last_undegraded":"2024-05-10T05:18:40.210435+0000","last_fullsized":"2024-05-10T05:18:40.210435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:18:40.210380+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:18:40.210380+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.210380+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:44.629153+0000","scrub_duration":0.002471778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6535","reported_seq":6577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:45.611659+0000","last_change":"2024-05-10T05:18:45.611799+0000","last_active":"2024-05-10T05:18:45.611659+0000","last_peered":"2024-05-10T05:18:45.611659+0000","last_clean":"2024-05-10T05:18:45.611659+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:18:45.611659+0000","last_undegraded":"2024-05-10T05:18:45.611659+0000","last_fullsized":"2024-05-10T05:18:45.611659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6535","last_scrub_stamp":"2024-05-10T05:18:45.611628+0000","last_deep_scrub":"28'6535","last_deep_scrub_stamp":"2024-05-10T05:18:45.611628+0000","last_clean_scrub_stamp":"2024-05-10T05:18:45.611628+0000","objects_scrubbed":1,"log_size":6535,"log_dups_size":0,"ondisk_log_size":6535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:28.869976+0000","scrub_duration":0.023044243999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6538,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7694,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.755717+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T05:18:21.755717+0000","last_peered":"2024-05-10T05:18:21.755717+0000","last_clean":"2024-05-10T05:18:21.755717+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:18:21.755717+0000","last_undegraded":"2024-05-10T05:18:21.755717+0000","last_fullsized":"2024-05-10T05:18:21.755717+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4967","reported_seq":4997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.286542+0000","last_change":"2024-05-10T04:51:52.147065+0000","last_active":"2024-05-10T05:18:23.286542+0000","last_peered":"2024-05-10T05:18:23.286542+0000","last_clean":"2024-05-10T05:18:23.286542+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:18:23.286542+0000","last_undegraded":"2024-05-10T05:18:23.286542+0000","last_fullsized":"2024-05-10T05:18:23.286542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":4967,"log_dups_size":0,"ondisk_log_size":4967,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4970,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2075","reported_seq":2115,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.267477+0000","last_change":"2024-05-10T05:18:33.267598+0000","last_active":"2024-05-10T05:18:33.267477+0000","last_peered":"2024-05-10T05:18:33.267477+0000","last_clean":"2024-05-10T05:18:33.267477+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:33.267477+0000","last_undegraded":"2024-05-10T05:18:33.267477+0000","last_fullsized":"2024-05-10T05:18:33.267477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2075","last_scrub_stamp":"2024-05-10T05:18:33.267453+0000","last_deep_scrub":"28'2075","last_deep_scrub_stamp":"2024-05-10T05:18:33.267453+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.267453+0000","objects_scrubbed":0,"log_size":2075,"log_dups_size":0,"ondisk_log_size":2075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:20.868771+0000","scrub_duration":0.017069349000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7178","reported_seq":7224,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.140873+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T05:18:26.140873+0000","last_peered":"2024-05-10T05:18:26.140873+0000","last_clean":"2024-05-10T05:18:26.140873+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:18:26.140873+0000","last_undegraded":"2024-05-10T05:18:26.140873+0000","last_fullsized":"2024-05-10T05:18:26.140873+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6276,"log_dups_size":0,"ondisk_log_size":6276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5018,"num_write_kb":931856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4519","reported_seq":4813,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.364492+0000","last_change":"2024-05-10T05:18:48.364602+0000","last_active":"2024-05-10T05:18:48.364492+0000","last_peered":"2024-05-10T05:18:48.364492+0000","last_clean":"2024-05-10T05:18:48.364492+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:48.364492+0000","last_undegraded":"2024-05-10T05:18:48.364492+0000","last_fullsized":"2024-05-10T05:18:48.364492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4519","last_scrub_stamp":"2024-05-10T05:18:48.364462+0000","last_deep_scrub":"28'4519","last_deep_scrub_stamp":"2024-05-10T05:18:48.364462+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.364462+0000","objects_scrubbed":3,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:15.335637+0000","scrub_duration":0.059862429000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5706142,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":1647,"num_write":5099,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1997","reported_seq":2037,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.008916+0000","last_change":"2024-05-10T05:18:42.009047+0000","last_active":"2024-05-10T05:18:42.008916+0000","last_peered":"2024-05-10T05:18:42.008916+0000","last_clean":"2024-05-10T05:18:42.008916+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:42.008916+0000","last_undegraded":"2024-05-10T05:18:42.008916+0000","last_fullsized":"2024-05-10T05:18:42.008916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1997","last_scrub_stamp":"2024-05-10T05:18:42.008888+0000","last_deep_scrub":"28'1997","last_deep_scrub_stamp":"2024-05-10T05:18:42.008888+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.008888+0000","objects_scrubbed":0,"log_size":1997,"log_dups_size":0,"ondisk_log_size":1997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:36.252444+0000","scrub_duration":0.016990521000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.977553+0000","last_change":"2024-05-10T05:18:47.977553+0000","last_active":"2024-05-10T05:18:47.977553+0000","last_peered":"2024-05-10T05:18:47.977553+0000","last_clean":"2024-05-10T05:18:47.977553+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:47.977553+0000","last_undegraded":"2024-05-10T05:18:47.977553+0000","last_fullsized":"2024-05-10T05:18:47.977553+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7757","last_scrub_stamp":"2024-05-10T05:18:47.977339+0000","last_deep_scrub":"28'7757","last_deep_scrub_stamp":"2024-05-10T05:18:47.977339+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.977339+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:43.761125+0000","scrub_duration":0.049427395999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2931","reported_seq":2972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.296272+0000","last_change":"2024-05-10T05:18:47.296396+0000","last_active":"2024-05-10T05:18:47.296272+0000","last_peered":"2024-05-10T05:18:47.296272+0000","last_clean":"2024-05-10T05:18:47.296272+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:47.296272+0000","last_undegraded":"2024-05-10T05:18:47.296272+0000","last_fullsized":"2024-05-10T05:18:47.296272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2931","last_scrub_stamp":"2024-05-10T05:18:47.296244+0000","last_deep_scrub":"28'2931","last_deep_scrub_stamp":"2024-05-10T05:18:47.296244+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.296244+0000","objects_scrubbed":2,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:46.247263+0000","scrub_duration":0.0070847059999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2041","reported_seq":2081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:50.301111+0000","last_change":"2024-05-10T05:18:50.301225+0000","last_active":"2024-05-10T05:18:50.301111+0000","last_peered":"2024-05-10T05:18:50.301111+0000","last_clean":"2024-05-10T05:18:50.301111+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:50.301111+0000","last_undegraded":"2024-05-10T05:18:50.301111+0000","last_fullsized":"2024-05-10T05:18:50.301111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2041","last_scrub_stamp":"2024-05-10T05:18:50.301080+0000","last_deep_scrub":"28'2041","last_deep_scrub_stamp":"2024-05-10T05:18:50.301080+0000","last_clean_scrub_stamp":"2024-05-10T05:18:50.301080+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:27.336905+0000","scrub_duration":0.011476890999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7570,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.138740+0000","last_change":"2024-05-10T04:51:57.177076+0000","last_active":"2024-05-10T05:18:26.138740+0000","last_peered":"2024-05-10T05:18:26.138740+0000","last_clean":"2024-05-10T05:18:26.138740+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:26.138740+0000","last_undegraded":"2024-05-10T05:18:26.138740+0000","last_fullsized":"2024-05-10T05:18:26.138740+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2707","reported_seq":2737,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.285823+0000","last_change":"2024-05-10T04:51:52.147663+0000","last_active":"2024-05-10T05:18:23.285823+0000","last_peered":"2024-05-10T05:18:23.285823+0000","last_clean":"2024-05-10T05:18:23.285823+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:18:23.285823+0000","last_undegraded":"2024-05-10T05:18:23.285823+0000","last_fullsized":"2024-05-10T05:18:23.285823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:51.097691+0000","last_clean_scrub_stamp":"2024-05-10T04:51:51.097691+0000","objects_scrubbed":0,"log_size":2707,"log_dups_size":0,"ondisk_log_size":2707,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2712,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:37.881619+0000","last_change":"2024-05-10T05:18:37.881727+0000","last_active":"2024-05-10T05:18:37.881619+0000","last_peered":"2024-05-10T05:18:37.881619+0000","last_clean":"2024-05-10T05:18:37.881619+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:37.881619+0000","last_undegraded":"2024-05-10T05:18:37.881619+0000","last_fullsized":"2024-05-10T05:18:37.881619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:18:37.881586+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:18:37.881586+0000","last_clean_scrub_stamp":"2024-05-10T05:18:37.881586+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:36:53.582798+0000","scrub_duration":0.002159762,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7374,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.715203+0000","last_change":"2024-05-10T04:51:57.218185+0000","last_active":"2024-05-10T05:18:21.715203+0000","last_peered":"2024-05-10T05:18:21.715203+0000","last_clean":"2024-05-10T05:18:21.715203+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:18:21.715203+0000","last_undegraded":"2024-05-10T05:18:21.715203+0000","last_fullsized":"2024-05-10T05:18:21.715203+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3613","reported_seq":3654,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:39.263553+0000","last_change":"2024-05-10T05:18:39.263719+0000","last_active":"2024-05-10T05:18:39.263553+0000","last_peered":"2024-05-10T05:18:39.263553+0000","last_clean":"2024-05-10T05:18:39.263553+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:18:39.263553+0000","last_undegraded":"2024-05-10T05:18:39.263553+0000","last_fullsized":"2024-05-10T05:18:39.263553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3613","last_scrub_stamp":"2024-05-10T05:18:39.263524+0000","last_deep_scrub":"28'3613","last_deep_scrub_stamp":"2024-05-10T05:18:39.263524+0000","last_clean_scrub_stamp":"2024-05-10T05:18:39.263524+0000","objects_scrubbed":1,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:02.820674+0000","scrub_duration":0.020627962999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3630,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2116","reported_seq":2156,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.975579+0000","last_change":"2024-05-10T05:18:40.975713+0000","last_active":"2024-05-10T05:18:40.975579+0000","last_peered":"2024-05-10T05:18:40.975579+0000","last_clean":"2024-05-10T05:18:40.975579+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:40.975579+0000","last_undegraded":"2024-05-10T05:18:40.975579+0000","last_fullsized":"2024-05-10T05:18:40.975579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2116","last_scrub_stamp":"2024-05-10T05:18:40.975550+0000","last_deep_scrub":"28'2116","last_deep_scrub_stamp":"2024-05-10T05:18:40.975550+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.975550+0000","objects_scrubbed":0,"log_size":2116,"log_dups_size":0,"ondisk_log_size":2116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:39.926569+0000","scrub_duration":0.011021167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7428,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.987593+0000","last_change":"2024-05-10T04:51:57.179473+0000","last_active":"2024-05-10T05:18:33.987593+0000","last_peered":"2024-05-10T05:18:33.987593+0000","last_clean":"2024-05-10T05:18:33.987593+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:18:33.987593+0000","last_undegraded":"2024-05-10T05:18:33.987593+0000","last_fullsized":"2024-05-10T05:18:33.987593+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6721","reported_seq":6762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.335234+0000","last_change":"2024-05-10T05:18:42.335383+0000","last_active":"2024-05-10T05:18:42.335234+0000","last_peered":"2024-05-10T05:18:42.335234+0000","last_clean":"2024-05-10T05:18:42.335234+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:18:42.335234+0000","last_undegraded":"2024-05-10T05:18:42.335234+0000","last_fullsized":"2024-05-10T05:18:42.335234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6721","last_scrub_stamp":"2024-05-10T05:18:42.335206+0000","last_deep_scrub":"28'6721","last_deep_scrub_stamp":"2024-05-10T05:18:42.335206+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.335206+0000","objects_scrubbed":3,"log_size":6721,"log_dups_size":0,"ondisk_log_size":6721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:29.735051+0000","scrub_duration":0.047016694999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6710,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2079","reported_seq":2101,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.953057+0000","last_change":"2024-05-10T04:52:40.335170+0000","last_active":"2024-05-10T05:18:25.953057+0000","last_peered":"2024-05-10T05:18:25.953057+0000","last_clean":"2024-05-10T05:18:25.953057+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:25.953057+0000","last_undegraded":"2024-05-10T05:18:25.953057+0000","last_fullsized":"2024-05-10T05:18:25.953057+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7871,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.987628+0000","last_change":"2024-05-10T04:51:57.165497+0000","last_active":"2024-05-10T05:18:33.987628+0000","last_peered":"2024-05-10T05:18:33.987628+0000","last_clean":"2024-05-10T05:18:33.987628+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:18:33.987628+0000","last_undegraded":"2024-05-10T05:18:33.987628+0000","last_fullsized":"2024-05-10T05:18:33.987628+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6912","reported_seq":6952,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.639619+0000","last_change":"2024-05-10T05:18:49.639748+0000","last_active":"2024-05-10T05:18:49.639619+0000","last_peered":"2024-05-10T05:18:49.639619+0000","last_clean":"2024-05-10T05:18:49.639619+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:18:49.639619+0000","last_undegraded":"2024-05-10T05:18:49.639619+0000","last_fullsized":"2024-05-10T05:18:49.639619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6912","last_scrub_stamp":"2024-05-10T05:18:49.639590+0000","last_deep_scrub":"28'6912","last_deep_scrub_stamp":"2024-05-10T05:18:49.639590+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.639590+0000","objects_scrubbed":1,"log_size":6912,"log_dups_size":0,"ondisk_log_size":6912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:49.364440+0000","scrub_duration":0.0094499939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6927,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2069","reported_seq":2098,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.947621+0000","last_change":"2024-05-10T04:51:52.751589+0000","last_active":"2024-05-10T05:18:25.947621+0000","last_peered":"2024-05-10T05:18:25.947621+0000","last_clean":"2024-05-10T05:18:25.947621+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:18:25.947621+0000","last_undegraded":"2024-05-10T05:18:25.947621+0000","last_fullsized":"2024-05-10T05:18:25.947621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7415,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.251986+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T05:18:23.251986+0000","last_peered":"2024-05-10T05:18:23.251986+0000","last_clean":"2024-05-10T05:18:23.251986+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:18:23.251986+0000","last_undegraded":"2024-05-10T05:18:23.251986+0000","last_fullsized":"2024-05-10T05:18:23.251986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5972","reported_seq":6013,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.480749+0000","last_change":"2024-05-10T05:18:41.480749+0000","last_active":"2024-05-10T05:18:41.480749+0000","last_peered":"2024-05-10T05:18:41.480749+0000","last_clean":"2024-05-10T05:18:41.480749+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:18:41.480749+0000","last_undegraded":"2024-05-10T05:18:41.480749+0000","last_fullsized":"2024-05-10T05:18:41.480749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5972","last_scrub_stamp":"2024-05-10T05:18:41.480563+0000","last_deep_scrub":"28'5972","last_deep_scrub_stamp":"2024-05-10T05:18:41.480563+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.480563+0000","objects_scrubbed":2,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:54:23.660604+0000","scrub_duration":0.035130757999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2043","reported_seq":2071,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.006659+0000","last_change":"2024-05-10T04:51:52.771885+0000","last_active":"2024-05-10T05:18:26.006659+0000","last_peered":"2024-05-10T05:18:26.006659+0000","last_clean":"2024-05-10T05:18:26.006659+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:26.006659+0000","last_undegraded":"2024-05-10T05:18:26.006659+0000","last_fullsized":"2024-05-10T05:18:26.006659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7895","reported_seq":8000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.134311+0000","last_change":"2024-05-10T04:52:40.389082+0000","last_active":"2024-05-10T05:18:26.134311+0000","last_peered":"2024-05-10T05:18:26.134311+0000","last_clean":"2024-05-10T05:18:26.134311+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:18:26.134311+0000","last_undegraded":"2024-05-10T05:18:26.134311+0000","last_fullsized":"2024-05-10T05:18:26.134311+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7189,"log_dups_size":0,"ondisk_log_size":7189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5700,"num_write_kb":1007695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7942","reported_seq":7982,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.318988+0000","last_change":"2024-05-10T05:18:41.319114+0000","last_active":"2024-05-10T05:18:41.318988+0000","last_peered":"2024-05-10T05:18:41.318988+0000","last_clean":"2024-05-10T05:18:41.318988+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:18:41.318988+0000","last_undegraded":"2024-05-10T05:18:41.318988+0000","last_fullsized":"2024-05-10T05:18:41.318988+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7942","last_scrub_stamp":"2024-05-10T05:18:41.318956+0000","last_deep_scrub":"28'7942","last_deep_scrub_stamp":"2024-05-10T05:18:41.318956+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.318956+0000","objects_scrubbed":2,"log_size":7342,"log_dups_size":0,"ondisk_log_size":7342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:03.935767+0000","scrub_duration":0.024728548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7935,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2034","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:34.854243+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T05:18:34.854243+0000","last_peered":"2024-05-10T05:18:34.854243+0000","last_clean":"2024-05-10T05:18:34.854243+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:18:34.854243+0000","last_undegraded":"2024-05-10T05:18:34.854243+0000","last_fullsized":"2024-05-10T05:18:34.854243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.742534+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T05:18:21.742534+0000","last_peered":"2024-05-10T05:18:21.742534+0000","last_clean":"2024-05-10T05:18:21.742534+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:18:21.742534+0000","last_undegraded":"2024-05-10T05:18:21.742534+0000","last_fullsized":"2024-05-10T05:18:21.742534+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5558","reported_seq":5599,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.500280+0000","last_change":"2024-05-10T05:18:44.500280+0000","last_active":"2024-05-10T05:18:44.500280+0000","last_peered":"2024-05-10T05:18:44.500280+0000","last_clean":"2024-05-10T05:18:44.500280+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:44.500280+0000","last_undegraded":"2024-05-10T05:18:44.500280+0000","last_fullsized":"2024-05-10T05:18:44.500280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5558","last_scrub_stamp":"2024-05-10T05:18:44.500139+0000","last_deep_scrub":"28'5558","last_deep_scrub_stamp":"2024-05-10T05:18:44.500139+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.500139+0000","objects_scrubbed":2,"log_size":5558,"log_dups_size":0,"ondisk_log_size":5558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:20.890403+0000","scrub_duration":0.025591222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1961","reported_seq":2000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.626558+0000","last_change":"2024-05-10T05:18:36.626709+0000","last_active":"2024-05-10T05:18:36.626558+0000","last_peered":"2024-05-10T05:18:36.626558+0000","last_clean":"2024-05-10T05:18:36.626558+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:36.626558+0000","last_undegraded":"2024-05-10T05:18:36.626558+0000","last_fullsized":"2024-05-10T05:18:36.626558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1961","last_scrub_stamp":"2024-05-10T05:18:36.626530+0000","last_deep_scrub":"28'1961","last_deep_scrub_stamp":"2024-05-10T05:18:36.626530+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.626530+0000","objects_scrubbed":0,"log_size":1961,"log_dups_size":0,"ondisk_log_size":1961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:06:49.597931+0000","scrub_duration":0.027198238999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1986","reported_seq":2015,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.941139+0000","last_change":"2024-05-10T04:51:52.753263+0000","last_active":"2024-05-10T05:18:25.941139+0000","last_peered":"2024-05-10T05:18:25.941139+0000","last_clean":"2024-05-10T05:18:25.941139+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:18:25.941139+0000","last_undegraded":"2024-05-10T05:18:25.941139+0000","last_fullsized":"2024-05-10T05:18:25.941139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2091","reported_seq":2120,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.997473+0000","last_change":"2024-05-10T04:51:52.745735+0000","last_active":"2024-05-10T05:18:25.997473+0000","last_peered":"2024-05-10T05:18:25.997473+0000","last_clean":"2024-05-10T05:18:25.997473+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:25.997473+0000","last_undegraded":"2024-05-10T05:18:25.997473+0000","last_fullsized":"2024-05-10T05:18:25.997473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1990","reported_seq":2019,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.023152+0000","last_change":"2024-05-10T04:51:52.737336+0000","last_active":"2024-05-10T05:18:26.023152+0000","last_peered":"2024-05-10T05:18:26.023152+0000","last_clean":"2024-05-10T05:18:26.023152+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:18:26.023152+0000","last_undegraded":"2024-05-10T05:18:26.023152+0000","last_fullsized":"2024-05-10T05:18:26.023152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2093","reported_seq":2133,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:32.141843+0000","last_change":"2024-05-10T05:18:32.141933+0000","last_active":"2024-05-10T05:18:32.141843+0000","last_peered":"2024-05-10T05:18:32.141843+0000","last_clean":"2024-05-10T05:18:32.141843+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:32.141843+0000","last_undegraded":"2024-05-10T05:18:32.141843+0000","last_fullsized":"2024-05-10T05:18:32.141843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2093","last_scrub_stamp":"2024-05-10T05:18:32.141812+0000","last_deep_scrub":"28'2093","last_deep_scrub_stamp":"2024-05-10T05:18:32.141812+0000","last_clean_scrub_stamp":"2024-05-10T05:18:32.141812+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:15.037300+0000","scrub_duration":0.0043493560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2063","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.980309+0000","last_change":"2024-05-10T04:51:52.743267+0000","last_active":"2024-05-10T05:18:25.980309+0000","last_peered":"2024-05-10T05:18:25.980309+0000","last_clean":"2024-05-10T05:18:25.980309+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:25.980309+0000","last_undegraded":"2024-05-10T05:18:25.980309+0000","last_fullsized":"2024-05-10T05:18:25.980309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1959","reported_seq":1988,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.930069+0000","last_change":"2024-05-10T04:51:52.750492+0000","last_active":"2024-05-10T05:18:25.930069+0000","last_peered":"2024-05-10T05:18:25.930069+0000","last_clean":"2024-05-10T05:18:25.930069+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:18:25.930069+0000","last_undegraded":"2024-05-10T05:18:25.930069+0000","last_fullsized":"2024-05-10T05:18:25.930069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2071","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.002000+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T05:18:26.002000+0000","last_peered":"2024-05-10T05:18:26.002000+0000","last_clean":"2024-05-10T05:18:26.002000+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:18:26.002000+0000","last_undegraded":"2024-05-10T05:18:26.002000+0000","last_fullsized":"2024-05-10T05:18:26.002000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2052","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:37.915644+0000","last_change":"2024-05-10T05:18:37.915765+0000","last_active":"2024-05-10T05:18:37.915644+0000","last_peered":"2024-05-10T05:18:37.915644+0000","last_clean":"2024-05-10T05:18:37.915644+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:37.915644+0000","last_undegraded":"2024-05-10T05:18:37.915644+0000","last_fullsized":"2024-05-10T05:18:37.915644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2052","last_scrub_stamp":"2024-05-10T05:18:37.915613+0000","last_deep_scrub":"28'2052","last_deep_scrub_stamp":"2024-05-10T05:18:37.915613+0000","last_clean_scrub_stamp":"2024-05-10T05:18:37.915613+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:37.640463+0000","scrub_duration":0.017714500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2006","reported_seq":2046,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.029717+0000","last_change":"2024-05-10T05:18:40.029835+0000","last_active":"2024-05-10T05:18:40.029717+0000","last_peered":"2024-05-10T05:18:40.029717+0000","last_clean":"2024-05-10T05:18:40.029717+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:40.029717+0000","last_undegraded":"2024-05-10T05:18:40.029717+0000","last_fullsized":"2024-05-10T05:18:40.029717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2006","last_scrub_stamp":"2024-05-10T05:18:40.029690+0000","last_deep_scrub":"28'2006","last_deep_scrub_stamp":"2024-05-10T05:18:40.029690+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.029690+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:54.438553+0000","scrub_duration":0.0028650809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2043","reported_seq":2072,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.110947+0000","last_change":"2024-05-10T04:51:52.742734+0000","last_active":"2024-05-10T05:18:33.110947+0000","last_peered":"2024-05-10T05:18:33.110947+0000","last_clean":"2024-05-10T05:18:33.110947+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:33.110947+0000","last_undegraded":"2024-05-10T05:18:33.110947+0000","last_fullsized":"2024-05-10T05:18:33.110947+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2070","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:34.854437+0000","last_change":"2024-05-10T04:51:52.744099+0000","last_active":"2024-05-10T05:18:34.854437+0000","last_peered":"2024-05-10T05:18:34.854437+0000","last_clean":"2024-05-10T05:18:34.854437+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:18:34.854437+0000","last_undegraded":"2024-05-10T05:18:34.854437+0000","last_fullsized":"2024-05-10T05:18:34.854437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2074","reported_seq":2102,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.126691+0000","last_change":"2024-05-10T04:51:52.748547+0000","last_active":"2024-05-10T05:18:26.126691+0000","last_peered":"2024-05-10T05:18:26.126691+0000","last_clean":"2024-05-10T05:18:26.126691+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:18:26.126691+0000","last_undegraded":"2024-05-10T05:18:26.126691+0000","last_fullsized":"2024-05-10T05:18:26.126691+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2051","reported_seq":2090,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:54.284276+0000","last_change":"2024-05-10T05:18:54.284504+0000","last_active":"2024-05-10T05:18:54.284276+0000","last_peered":"2024-05-10T05:18:54.284276+0000","last_clean":"2024-05-10T05:18:54.284276+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:54.284276+0000","last_undegraded":"2024-05-10T05:18:54.284276+0000","last_fullsized":"2024-05-10T05:18:54.284276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2051","last_scrub_stamp":"2024-05-10T05:18:54.284233+0000","last_deep_scrub":"28'2051","last_deep_scrub_stamp":"2024-05-10T05:18:54.284233+0000","last_clean_scrub_stamp":"2024-05-10T05:18:54.284233+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.289789+0000","scrub_duration":0.0020759820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173251,"num_write_kb":29661400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225990,"ondisk_log_size":225990,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130764,"ondisk_log_size":130764,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235183565,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2414,"num_read_kb":15319,"num_write":184839,"num_write_kb":1350687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6380,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":470433792,"data_stored":470367130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172730,"ondisk_log_size":172730,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542472,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":931700,"kb_used_data":70508,"kb_used_omap":1,"kb_used_meta":861182,"kb_avail":93440140,"statfs":{"total":96636764160,"available":95682703360,"internally_reserved":0,"allocated":72200192,"data_stored":72015801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":881850827},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.988,"15min":1.819},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":14.874000000000001,"5min":28.266999999999999,"15min":34.326999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.75,"5min":2.4319999999999999,"15min":1.851},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.31},"max":{"1min":15.058,"5min":28.968,"15min":28.968},"last":0.58899999999999997}]},{"osd":1,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":2.395,"15min":1.976},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.32900000000000001},"max":{"1min":14.84,"5min":34.805999999999997,"15min":34.805999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.8480000000000001,"5min":2.3769999999999998,"15min":2.3069999999999999},"min":{"1min":0.48399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.102,"5min":29.222000000000001,"15min":105.375},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":2.4260000000000002,"15min":2.077},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.35899999999999999},"max":{"1min":4.3029999999999999,"5min":39.965000000000003,"15min":52.515999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":2.1190000000000002,"5min":2.2229999999999999,"15min":1.804},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":14.782999999999999,"5min":34.756999999999998,"15min":35.595999999999997},"last":0.622}]},{"osd":3,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":2.6040000000000001,"15min":2.597},"min":{"1min":0.46300000000000002,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":8.5489999999999995,"5min":38.317999999999998,"15min":64.994},"last":0.77000000000000002},{"interface":"front","average":{"1min":3.1850000000000001,"5min":2.4590000000000001,"15min":1.978},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.907999999999999,"5min":34.841999999999999,"15min":43.789000000000001},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":3.1139999999999999,"15min":2.7109999999999999},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":15.217000000000001,"5min":40.978999999999999,"15min":52.252000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":1.47,"5min":2.746,"15min":3.157},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.36499999999999999},"max":{"1min":8.6969999999999992,"5min":34.289999999999999,"15min":134.07499999999999},"last":0.86499999999999999}]},{"osd":5,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":3.0640000000000001,"15min":2.4769999999999999},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":14.943,"5min":34.875,"15min":34.875},"last":0.80900000000000005},{"interface":"front","average":{"1min":2.5569999999999999,"5min":2.8639999999999999,"15min":2.3420000000000001},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":15.177,"5min":29.867000000000001,"15min":37.582999999999998},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":4.6219999999999999,"15min":3.2559999999999998},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":15.138999999999999,"5min":65.388999999999996,"15min":65.388999999999996},"last":0.879},{"interface":"front","average":{"1min":1.6830000000000001,"5min":4.5019999999999998,"15min":3.3980000000000001},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.4029999999999996,"5min":84.454999999999998,"15min":84.454999999999998},"last":0.999}]}]},{"osd":6,"up_from":14,"seq":60129542471,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":978144,"kb_used_data":90712,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93393696,"statfs":{"total":96636764160,"available":95635144704,"internally_reserved":0,"allocated":92889088,"data_stored":92698114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":2.5579999999999998,"15min":3.0569999999999999},"min":{"1min":0.47699999999999998,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":14.510999999999999,"5min":17.158000000000001,"15min":215.636},"last":0.58299999999999996},{"interface":"front","average":{"1min":2.5070000000000001,"5min":2.6080000000000001,"15min":2.8149999999999999},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":15.693,"5min":26.574000000000002,"15min":216.899},"last":0.996}]},{"osd":1,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":1.998,"5min":2.5150000000000001,"15min":3.6709999999999998},"min":{"1min":0.39000000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":9.8569999999999993,"5min":20.341999999999999,"15min":283.584},"last":0.64100000000000001},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5590000000000002,"15min":3.3559999999999999},"min":{"1min":0.57799999999999996,"5min":0.39500000000000002,"15min":0.33500000000000002},"max":{"1min":14.353999999999999,"5min":21.161999999999999,"15min":226.642},"last":0.90600000000000003}]},{"osd":2,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.3220000000000001,"15min":2.6339999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38200000000000001},"max":{"1min":15.625999999999999,"5min":15.625999999999999,"15min":204.20099999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.9430000000000001,"15min":2.262},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":14.115,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.78900000000000003}]},{"osd":3,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4470000000000001,"5min":2.3639999999999999,"15min":2.9390000000000001},"min":{"1min":0.54300000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":14.478999999999999,"5min":21.224,"15min":211.06999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.181,"15min":2.8660000000000001},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":15.923,"5min":15.923,"15min":216.947},"last":1.0409999999999999}]},{"osd":4,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.3340000000000001,"5min":2.9980000000000002,"15min":2.653},"min":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":14.304,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":3.4409999999999998,"5min":3.2200000000000002,"15min":2.4710000000000001},"min":{"1min":0.497,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":16.417000000000002,"5min":37.195,"15min":37.195},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0840000000000001,"15min":2.343},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":11.1,"5min":46.448999999999998,"15min":46.448999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":2.6160000000000001,"5min":2.9079999999999999,"15min":2.589},"min":{"1min":0.58099999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":14.760999999999999,"5min":18.962,"15min":35.591999999999999},"last":0.97799999999999998}]},{"osd":7,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":2.9359999999999999,"15min":2.3210000000000002},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":15.662000000000001,"5min":58.857999999999997,"15min":58.857999999999997},"last":0.92800000000000005},{"interface":"front","average":{"1min":2.9319999999999999,"5min":4.0650000000000004,"15min":2.7160000000000002},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":11.148,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.94799999999999995}]}]},{"osd":0,"up_from":14,"seq":60129542472,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752828,"kb_used_data":45940,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93619012,"statfs":{"total":96636764160,"available":95865868288,"internally_reserved":0,"allocated":47042560,"data_stored":46850033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.379,"15min":1.4390000000000001},"min":{"1min":0.32400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":8.7910000000000004,"5min":39.710000000000001,"15min":40.371000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.8200000000000001,"15min":1.9279999999999999},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.7290000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":0.59299999999999997}]},{"osd":2,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":1.1719999999999999,"15min":1.181},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":1.863,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.282,"15min":1.4099999999999999},"min":{"1min":0.39000000000000001,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":1.7050000000000001,"5min":17.998000000000001,"15min":37.643999999999998},"last":0.62}]},{"osd":3,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.6080000000000001,"15min":2.0880000000000001},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":4.7089999999999996,"5min":51.646999999999998,"15min":108.407},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.752,"5min":1.367,"15min":1.4810000000000001},"min":{"1min":0.48399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.173,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":2.331,"15min":2.347},"min":{"1min":0.52400000000000002,"5min":0.438,"15min":0.38400000000000001},"max":{"1min":4.6619999999999999,"5min":52.307000000000002,"15min":52.307000000000002},"last":1.169},{"interface":"front","average":{"1min":1.1419999999999999,"5min":2.0539999999999998,"15min":2.0350000000000001},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":3.6549999999999998,"5min":17.518999999999998,"15min":32.276000000000003},"last":0.91900000000000004}]},{"osd":5,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.8740000000000001,"15min":1.889},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1989999999999998,"5min":18.966000000000001,"15min":37.572000000000003},"last":0.93500000000000005},{"interface":"front","average":{"1min":1.3779999999999999,"5min":2.2280000000000002,"15min":2.3100000000000001},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.44600000000000001},"max":{"1min":7.6829999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":1.2050000000000001}]},{"osd":6,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.919,"15min":2.1720000000000002},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":3.052,"5min":13.968,"15min":41.270000000000003},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":2.1259999999999999,"15min":2.286},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":3.0630000000000002,"5min":18.013000000000002,"15min":41.043999999999997},"last":1.0549999999999999}]},{"osd":7,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":2.1930000000000001,"15min":2.2719999999999998},"min":{"1min":0.68000000000000005,"5min":0.50800000000000001,"15min":0.45900000000000002},"max":{"1min":1.8200000000000001,"5min":22.251000000000001,"15min":37.850000000000001},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.615,"5min":2.2490000000000001,"15min":2.4220000000000002},"min":{"1min":0.70699999999999996,"5min":0.503,"15min":0.503},"max":{"1min":9.9499999999999993,"5min":39.850000000000001,"15min":46.118000000000002},"last":1.111}]}]},{"osd":2,"up_from":13,"seq":55834575178,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":539116,"kb_used_data":20772,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93832724,"statfs":{"total":96636764160,"available":96084709376,"internally_reserved":0,"allocated":21270528,"data_stored":21093203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.1439999999999999,"15min":1.22},"min":{"1min":0.29999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":8.1189999999999998,"5min":11.212,"15min":24.271000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.897,"5min":1.244,"15min":1.4279999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":16.366,"5min":16.366,"15min":30.734999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.008,"15min":1.444},"min":{"1min":0.40699999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3079999999999998,"5min":9.9079999999999995,"15min":105.28},"last":0.77800000000000002},{"interface":"front","average":{"1min":2.23,"5min":2.23,"15min":2.577},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":16.309000000000001,"5min":73.775999999999996,"15min":105.255},"last":0.67500000000000004}]},{"osd":3,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":1.343,"15min":1.629},"min":{"1min":0.34699999999999998,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.557,"5min":13.557,"15min":60.387999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":1.758,"5min":1.347,"15min":1.4450000000000001},"min":{"1min":0.45400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":14.116,"5min":14.116,"15min":22.358000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":4.2350000000000003,"15min":2.7890000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":12.548999999999999,"5min":249.88,"15min":249.88},"last":1.147},{"interface":"front","average":{"1min":3.5179999999999998,"5min":4.6390000000000002,"15min":3.1779999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":20.428999999999998,"5min":249.82300000000001,"15min":249.82300000000001},"last":1.125}]},{"osd":5,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":4.0250000000000004,"15min":2.7170000000000001},"min":{"1min":0.442,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":15.917999999999999,"5min":256.38600000000002,"15min":256.38600000000002},"last":1.054},{"interface":"front","average":{"1min":2.3679999999999999,"5min":3.9020000000000001,"15min":2.3769999999999998},"min":{"1min":0.59099999999999997,"5min":0.42899999999999999,"15min":0.42799999999999999},"max":{"1min":14.08,"5min":255.04499999999999,"15min":255.04499999999999},"last":1.0840000000000001}]},{"osd":6,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":3.1190000000000002,"5min":4.9669999999999996,"15min":3.0369999999999999},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":20.393999999999998,"5min":255.06999999999999,"15min":255.06999999999999},"last":0.99399999999999999},{"interface":"front","average":{"1min":3.327,"5min":4.9809999999999999,"15min":3.1400000000000001},"min":{"1min":0.505,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":18.178000000000001,"5min":253.095,"15min":253.095},"last":1.109}]},{"osd":7,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":4.2649999999999997,"5min":4.1109999999999998,"15min":3.008},"min":{"1min":0.65600000000000003,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":24.565000000000001,"5min":249.90799999999999,"15min":249.90799999999999},"last":1.163},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.4390000000000001,"15min":3.2029999999999998},"min":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.44400000000000001},"max":{"1min":8.5760000000000005,"5min":256.97699999999998,"15min":256.97699999999998},"last":0.98399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542471,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":966332,"kb_used_data":50932,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93405508,"statfs":{"total":96636764160,"available":95647240192,"internally_reserved":0,"allocated":52154368,"data_stored":51965329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":2.391,"5min":2.4849999999999999,"15min":2.5089999999999999},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":16.178000000000001,"5min":50.100000000000001,"15min":192.745},"last":0.39200000000000002},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.867,"15min":2.2320000000000002},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.30499999999999999},"max":{"1min":10.452999999999999,"5min":50.145000000000003,"15min":192.62799999999999},"last":0.54200000000000004}]},{"osd":2,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.411,"15min":1.665},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":5.375,"5min":14.263999999999999,"15min":71.727999999999994},"last":0.443},{"interface":"front","average":{"1min":2.1760000000000002,"5min":1.9399999999999999,"15min":2.0129999999999999},"min":{"1min":0.47499999999999998,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":22.484999999999999,"5min":32.435000000000002,"15min":95.793000000000006},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":2.2210000000000001,"5min":2.2909999999999999,"15min":2.0950000000000002},"min":{"1min":0.437,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":16.245999999999999,"5min":21.994,"15min":125.41200000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":2.1019999999999999,"15min":1.829},"min":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":9.8640000000000008,"5min":26.085000000000001,"15min":111.134},"last":0.59999999999999998}]},{"osd":4,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":11.686,"5min":4.8959999999999999,"15min":3.1880000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":180.386,"5min":180.386,"15min":180.386},"last":0.86399999999999999},{"interface":"front","average":{"1min":11.231,"5min":5.3250000000000002,"15min":3.7040000000000002},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":183.21299999999999,"5min":183.21299999999999,"15min":183.21299999999999},"last":0.76900000000000002}]},{"osd":5,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":10.397,"5min":3.988,"15min":2.6280000000000001},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":162.23099999999999,"5min":162.23099999999999,"15min":162.23099999999999},"last":0.84099999999999997},{"interface":"front","average":{"1min":10.180999999999999,"5min":4.5730000000000004,"15min":2.7429999999999999},"min":{"1min":0.46100000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":167.78100000000001,"5min":167.78100000000001,"15min":167.78100000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":9.8179999999999996,"5min":4.5359999999999996,"15min":4.2930000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":160.99600000000001,"5min":160.99600000000001,"15min":289.625},"last":0.81200000000000006},{"interface":"front","average":{"1min":10.183,"5min":4.4379999999999997,"15min":4.6799999999999997},"min":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":163.37200000000001,"5min":163.37200000000001,"15min":289.608},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":10.803000000000001,"5min":3.7320000000000002,"15min":2.5369999999999999},"min":{"1min":0.51600000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":168.459,"5min":168.459,"15min":168.459},"last":0.88100000000000001},{"interface":"front","average":{"1min":10.798999999999999,"5min":4.4740000000000002,"15min":2.7509999999999999},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":166.607,"5min":166.607,"15min":166.607},"last":0.79200000000000004}]}]},{"osd":3,"up_from":14,"seq":60129542472,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077940,"kb_used_data":86316,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293900,"statfs":{"total":96636764160,"available":95532953600,"internally_reserved":0,"allocated":88387584,"data_stored":88202739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":1.528,"15min":1.488},"min":{"1min":0.315,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":22.021000000000001,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":2.2189999999999999,"5min":1.5009999999999999,"15min":1.8740000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":23.219999999999999,"5min":23.219999999999999,"15min":119.66200000000001},"last":0.64600000000000002}]},{"osd":1,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.948,"5min":1.7629999999999999,"15min":1.4219999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":10.342000000000001,"5min":25.995000000000001,"15min":26.573},"last":0.71899999999999997},{"interface":"front","average":{"1min":2.2549999999999999,"5min":1.714,"15min":1.7210000000000001},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.068999999999999,"5min":32.93,"15min":32.93},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.6499999999999999,"15min":1.371},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":9.9819999999999993,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":2.1230000000000002,"5min":1.3939999999999999,"15min":1.365},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":22.123000000000001,"5min":22.123000000000001,"15min":29.568999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":4.2030000000000003,"15min":4.1020000000000003},"min":{"1min":0.45500000000000002,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":23.181999999999999,"5min":101.81399999999999,"15min":157.47},"last":1.294},{"interface":"front","average":{"1min":2.7120000000000002,"5min":3.9689999999999999,"15min":3.6339999999999999},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":25.175999999999998,"5min":102.501,"15min":189.161},"last":1.429}]},{"osd":5,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":2.2109999999999999,"15min":2.488},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.40799999999999997},"max":{"1min":3.9550000000000001,"5min":22.468,"15min":150.14500000000001},"last":1.3799999999999999},{"interface":"front","average":{"1min":2.6640000000000001,"5min":2.851,"15min":3.2759999999999998},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":23.141999999999999,"5min":50.697000000000003,"15min":165.47},"last":1.4039999999999999}]},{"osd":6,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.1520000000000001,"5min":3.1110000000000002,"15min":3.0449999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":10.287000000000001,"5min":43.024999999999999,"15min":179.703},"last":1.349},{"interface":"front","average":{"1min":1.1619999999999999,"5min":2.0640000000000001,"15min":2.6509999999999998},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":4.0309999999999997,"5min":17.460000000000001,"15min":135.15899999999999},"last":1.456}]},{"osd":7,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5329999999999999,"5min":2.0830000000000002,"15min":3.1600000000000001},"min":{"1min":0.57499999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":23.079000000000001,"5min":23.079000000000001,"15min":148.93899999999999},"last":1.488},{"interface":"front","average":{"1min":2.4319999999999999,"5min":3.113,"15min":3.2650000000000001},"min":{"1min":0.62,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":12.063000000000001,"5min":59.588999999999999,"15min":215.81299999999999},"last":1.51}]}]},{"osd":4,"up_from":14,"seq":60129542470,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":928504,"kb_used_data":49456,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93443336,"statfs":{"total":96636764160,"available":95685976064,"internally_reserved":0,"allocated":50642944,"data_stored":50453457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2869999999999999,"5min":2.3149999999999999,"15min":5.0179999999999998},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":51.966000000000001,"5min":51.966000000000001,"15min":440.25299999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":2.3929999999999998,"15min":2.6850000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":6.5229999999999997,"5min":33.819000000000003,"15min":94.004999999999995},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":2.302,"15min":3.532},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":5.0990000000000002,"5min":30.404,"15min":112.73699999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.95,"15min":2.0459999999999998},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":5,"5min":14.278,"15min":32.863},"last":0.96399999999999997}]},{"osd":2,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.7230000000000001,"5min":1.839,"15min":5.2889999999999997},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":13.967000000000001,"5min":13.967000000000001,"15min":440.32400000000001},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.405,"5min":2.2120000000000002,"15min":3.1339999999999999},"min":{"1min":0.442,"5min":0.438,"15min":0.40899999999999997},"max":{"1min":5.1520000000000001,"5min":17.382999999999999,"15min":161.42699999999999},"last":0.94999999999999996}]},{"osd":3,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":2.6299999999999999,"15min":2.4889999999999999},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.41799999999999998},"max":{"1min":9.4949999999999992,"5min":32.715000000000003,"15min":44.515999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.9139999999999999,"5min":2.3279999999999998,"15min":5.0579999999999998},"min":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":13.728,"5min":19.661999999999999,"15min":440.197},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":2.379,"15min":3.3599999999999999},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":6.6059999999999999,"5min":25.640999999999998,"15min":215.369},"last":0.70399999999999996},{"interface":"front","average":{"1min":1.163,"5min":2.7330000000000001,"15min":3.3730000000000002},"min":{"1min":0.51500000000000001,"5min":0.439,"15min":0.38},"max":{"1min":4.9500000000000002,"5min":32.659999999999997,"15min":212.42599999999999},"last":0.77500000000000002}]},{"osd":6,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":2.7519999999999998,"15min":5.5860000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32100000000000001},"max":{"1min":14.042,"5min":30.117999999999999,"15min":440.358},"last":0.83899999999999997},{"interface":"front","average":{"1min":2.371,"5min":2.71,"15min":4.125},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":15.471,"5min":15.471,"15min":215.42099999999999},"last":0.85899999999999999}]},{"osd":7,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":3.5979999999999999,"15min":3.3860000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42499999999999999},"max":{"1min":5.3049999999999997,"5min":45.661000000000001,"15min":121.637},"last":1.0860000000000001},{"interface":"front","average":{"1min":3.7999999999999998,"5min":3.8679999999999999,"15min":5.6479999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":52.021999999999998,"5min":60.430999999999997,"15min":440.291},"last":0.98399999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542471,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":831508,"kb_used_data":48268,"kb_used_omap":1,"kb_used_meta":783230,"kb_avail":93540332,"statfs":{"total":96636764160,"available":95785299968,"internally_reserved":0,"allocated":49426432,"data_stored":49242654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":802027974},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.4969999999999999,"5min":2.915,"15min":1.9750000000000001},"min":{"1min":0.34599999999999997,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":13.369,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":2.4260000000000002,"5min":2.286,"15min":1.736},"min":{"1min":0.373,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":15.297000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.753}]},{"osd":1,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6019999999999999,"5min":2.3599999999999999,"15min":1.7},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":16.277000000000001,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.92100000000000004},{"interface":"front","average":{"1min":2.4279999999999999,"5min":2.6240000000000001,"15min":1.861},"min":{"1min":0.45000000000000001,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":16.321999999999999,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.83499999999999996}]},{"osd":2,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":1.647,"5min":2.4750000000000001,"15min":1.825},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":13.664999999999999,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.84399999999999997},{"interface":"front","average":{"1min":2.9119999999999999,"5min":3.266,"15min":2.2549999999999999},"min":{"1min":0.46500000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":15.089,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.85999999999999999}]},{"osd":3,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":2.6469999999999998,"5min":2.6589999999999998,"15min":1.9870000000000001},"min":{"1min":0.51500000000000001,"5min":0.42399999999999999,"15min":0.41199999999999998},"max":{"1min":16.359000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.871},{"interface":"front","average":{"1min":1.8879999999999999,"5min":2.6459999999999999,"15min":2.0390000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":13.775,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.93700000000000006}]},{"osd":4,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.1579999999999999,"5min":5.8890000000000002,"15min":4.2229999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":13.646000000000001,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":2.9860000000000002,"5min":3.4940000000000002,"15min":3.1560000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":22.885999999999999,"5min":55.484999999999999,"15min":174.684},"last":0.58699999999999997}]},{"osd":6,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":3.4300000000000002,"5min":3.7639999999999998,"15min":2.8769999999999998},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":28.108000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":3.5299999999999998,"5min":4.4050000000000002,"15min":3.4620000000000002},"min":{"1min":0.56100000000000005,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":16.550999999999998,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.61399999999999999}]},{"osd":7,"last update":"Fri May 10 05:17:54 2024","interfaces":[{"interface":"back","average":{"1min":6.6379999999999999,"5min":3.7829999999999999,"15min":2.6190000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.42999999999999999},"max":{"1min":80.727999999999994,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.77300000000000002},{"interface":"front","average":{"1min":8.5060000000000002,"5min":5.069,"15min":3.1259999999999999},"min":{"1min":0.53100000000000003,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":92.790999999999997,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.73999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51855360,"data_stored":51843646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49127424,"data_stored":49120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92590080,"data_stored":92576431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.765 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.766 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.767 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.768 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.769 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.770 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-10T04:51:51.097691+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=51, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.771 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.772 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.773 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.774 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:18:57.774 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T05:19:13.515 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:19:13.520 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:19:17.775 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:19:18.058 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.058+0000 7f25a6400700 1 Processor -- start 2024-05-10T05:19:18.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.058+0000 7f25a6400700 1 -- start start 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a6400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a0158fe0 0x7f25a01529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a6400700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25a00c8ba0 0x7f25a00c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a6400700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a006cbd0 con 0x7f25a00c5a00 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a6400700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a01593f0 con 0x7f25a00c8ba0 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a6400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a00ca500 con 0x7f25a0158fe0 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a5a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25a00c8ba0 0x7f25a00c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a5a00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f25a00c8ba0 0x7f25a00c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58820/0 (socket says 172.21.15.47:58820) 2024-05-10T05:19:18.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f25a5a00700 1 -- 172.21.15.47:0/1356554434 learned_addr learned my addr 172.21.15.47:0/1356554434 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.060+0000 7f259fe00700 1 --2- 172.21.15.47:0/1356554434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a0158fe0 0x7f25a01529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f25a5a00700 1 -- 172.21.15.47:0/1356554434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a0158fe0 msgr2=0x7f25a01529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f25a5a00700 1 --2- 172.21.15.47:0/1356554434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a0158fe0 0x7f25a01529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f25a5a00700 1 -- 172.21.15.47:0/1356554434 >> v1:172.21.15.117:6789/0 conn(0x7f25a00c5a00 legacy=0x7f25a01588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f25a5a00700 1 -- 172.21.15.47:0/1356554434 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0159660 con 0x7f25a00c8ba0 2024-05-10T05:19:18.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f25a5a00700 1 --2- 172.21.15.47:0/1356554434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a00c8ba0 0x7f25a00c8fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2598009e50 tx=0x7f259800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fb239e9dd321fc server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f259f400700 1 -- 172.21.15.47:0/1356554434 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800e070 con 0x7f25a00c8ba0 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f259f400700 1 -- 172.21.15.47:0/1356554434 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259800b9c0 con 0x7f25a00c8ba0 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.061+0000 7f259f400700 1 -- 172.21.15.47:0/1356554434 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259800bd70 con 0x7f25a00c8ba0 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 -- 172.21.15.47:0/1356554434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a00c8ba0 msgr2=0x7f25a00c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 --2- 172.21.15.47:0/1356554434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a00c8ba0 0x7f25a00c8fb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2598009e50 tx=0x7f259800b330 comp rx=0 tx=0).stop 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 -- 172.21.15.47:0/1356554434 shutdown_connections 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 --2- 172.21.15.47:0/1356554434 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a00c8ba0 0x7f25a00c8fb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.063 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 --2- 172.21.15.47:0/1356554434 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a0158fe0 0x7f25a01529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 -- 172.21.15.47:0/1356554434 >> 172.21.15.47:0/1356554434 conn(0x7f25a00ca700 msgr2=0x7f25a00cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 -- 172.21.15.47:0/1356554434 shutdown_connections 2024-05-10T05:19:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.062+0000 7f25a6400700 1 -- 172.21.15.47:0/1356554434 wait complete. 2024-05-10T05:19:18.064 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.064+0000 7f25a6400700 1 Processor -- start 2024-05-10T05:19:18.065 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.064+0000 7f25a6400700 1 -- start start 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a6400700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a00c5a00 0x7f25a01ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a6400700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a00c8ba0 0x7f25a0157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a6400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 0x7f25a014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a6400700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a01eb690 con 0x7f25a0158fe0 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a6400700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a014da40 con 0x7f25a00c8ba0 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a6400700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a014dd20 con 0x7f25a00c5a00 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a5a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 0x7f25a014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a5a00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 0x7f25a014ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58822/0 (socket says 172.21.15.47:58822) 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a5a00700 1 -- 172.21.15.47:0/1334913883 learned_addr learned my addr 172.21.15.47:0/1334913883 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f25a5000700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a00c5a00 0x7f25a01ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.066+0000 7f259fe00700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a00c8ba0 0x7f25a0157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:18.068 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a5a00700 1 -- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a00c5a00 msgr2=0x7f25a01ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a5a00700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a00c5a00 0x7f25a01ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a5a00700 1 -- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a00c8ba0 msgr2=0x7f25a0157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a5a00700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a00c8ba0 0x7f25a0157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a5a00700 1 -- 172.21.15.47:0/1334913883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009b30 con 0x7f25a0158fe0 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a5a00700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 0x7f25a014ccf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f25a008b600 tx=0x7f2598004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2598004800 con 0x7f25a0158fe0 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2598004960 con 0x7f25a0158fe0 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259801b670 con 0x7f25a0158fe0 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a00c3390 con 0x7f25a0158fe0 2024-05-10T05:19:18.069 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.067+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a01eee20 con 0x7f25a0158fe0 2024-05-10T05:19:18.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.068+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a0074720 con 0x7f25a0158fe0 2024-05-10T05:19:18.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.069+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f259801b7d0 con 0x7f25a0158fe0 2024-05-10T05:19:18.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.070+0000 7f259cc00700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f258006acc0 0x7f258006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:18.070 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.070+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f259808aec0 con 0x7f25a0158fe0 2024-05-10T05:19:18.071 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.071+0000 7f25a5000700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f258006acc0 0x7f258006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:18.072 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.072+0000 7f25a5000700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f258006acc0 0x7f258006d1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2594007fd0 tx=0x7f2594009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:18.076 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.076+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2598055cd0 con 0x7f25a0158fe0 2024-05-10T05:19:18.288 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.288+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f25a006d3e0 con 0x7f258006acc0 2024-05-10T05:19:18.299 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.299+0000 7f259cc00700 1 -- 172.21.15.47:0/1334913883 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+373073 (secure 0 0 0) 0x7f2594001cc0 con 0x7f258006acc0 2024-05-10T05:19:18.305 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:19:18.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f258006acc0 msgr2=0x7f258006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:18.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f258006acc0 0x7f258006d1d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2594007fd0 tx=0x7f2594009040 comp rx=0 tx=0).stop 2024-05-10T05:19:18.308 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 msgr2=0x7f25a014ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 0x7f25a014ccf0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f25a008b600 tx=0x7f2598004ad0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 shutdown_connections 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f25a0158fe0 0x7f25a014ccf0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f258006acc0 0x7f258006d1d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f25a00c5a00 0x7f25a01ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 --2- 172.21.15.47:0/1334913883 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f25a00c8ba0 0x7f25a0157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 >> 172.21.15.47:0/1334913883 conn(0x7f25a00ca700 msgr2=0x7f25a01508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 shutdown_connections 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:18.304+0000 7f25a6400700 1 -- 172.21.15.47:0/1334913883 wait complete. 2024-05-10T05:19:18.309 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:19:18.331 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":847,"stamp":"2024-05-10T05:19:16.705371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235773933,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":4755,"num_read_kb":580569,"num_write":359369,"num_write_kb":31014503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6380,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529619,"ondisk_log_size":529619,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7006072,"kb_used_data":462904,"kb_used_omap":12,"kb_used_meta":6543091,"kb_avail":747968648,"statfs":{"total":773094113280,"available":765919895552,"internally_reserved":0,"allocated":474013696,"data_stored":472521330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6700125752},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003901"},"pg_stats":[{"pgid":"3.3f","version":"28'1987","reported_seq":2017,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.597522+0000","last_change":"2024-05-10T04:51:52.766964+0000","last_active":"2024-05-10T05:18:36.597522+0000","last_peered":"2024-05-10T05:18:36.597522+0000","last_clean":"2024-05-10T05:18:36.597522+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:18:36.597522+0000","last_undegraded":"2024-05-10T05:18:36.597522+0000","last_fullsized":"2024-05-10T05:18:36.597522+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1980","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:58.234884+0000","last_change":"2024-05-10T05:18:58.234884+0000","last_active":"2024-05-10T05:18:58.234884+0000","last_peered":"2024-05-10T05:18:58.234884+0000","last_clean":"2024-05-10T05:18:58.234884+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:58.234884+0000","last_undegraded":"2024-05-10T05:18:58.234884+0000","last_fullsized":"2024-05-10T05:18:58.234884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1980","last_scrub_stamp":"2024-05-10T05:18:58.234747+0000","last_deep_scrub":"28'1980","last_deep_scrub_stamp":"2024-05-10T05:18:58.234747+0000","last_clean_scrub_stamp":"2024-05-10T05:18:58.234747+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:09.502049+0000","scrub_duration":0.015462225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2129","reported_seq":2170,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.252553+0000","last_change":"2024-05-10T05:19:09.252684+0000","last_active":"2024-05-10T05:19:09.252553+0000","last_peered":"2024-05-10T05:19:09.252553+0000","last_clean":"2024-05-10T05:19:09.252553+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:19:09.252553+0000","last_undegraded":"2024-05-10T05:19:09.252553+0000","last_fullsized":"2024-05-10T05:19:09.252553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2129","last_scrub_stamp":"2024-05-10T05:19:09.252524+0000","last_deep_scrub":"28'2129","last_deep_scrub_stamp":"2024-05-10T05:19:09.252524+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.252524+0000","objects_scrubbed":0,"log_size":2129,"log_dups_size":0,"ondisk_log_size":2129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:33.793032+0000","scrub_duration":0.014282459000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2105","reported_seq":2146,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:06.949721+0000","last_change":"2024-05-10T05:19:06.949847+0000","last_active":"2024-05-10T05:19:06.949721+0000","last_peered":"2024-05-10T05:19:06.949721+0000","last_clean":"2024-05-10T05:19:06.949721+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:19:06.949721+0000","last_undegraded":"2024-05-10T05:19:06.949721+0000","last_fullsized":"2024-05-10T05:19:06.949721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2105","last_scrub_stamp":"2024-05-10T05:19:06.949693+0000","last_deep_scrub":"28'2105","last_deep_scrub_stamp":"2024-05-10T05:19:06.949693+0000","last_clean_scrub_stamp":"2024-05-10T05:19:06.949693+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:02.733480+0000","scrub_duration":0.002472222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2061","reported_seq":2099,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:06.539983+0000","last_change":"2024-05-10T05:19:06.540114+0000","last_active":"2024-05-10T05:19:06.539983+0000","last_peered":"2024-05-10T05:19:06.539983+0000","last_clean":"2024-05-10T05:19:06.539983+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:19:06.539983+0000","last_undegraded":"2024-05-10T05:19:06.539983+0000","last_fullsized":"2024-05-10T05:19:06.539983+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2061","last_scrub_stamp":"2024-05-10T05:19:06.539949+0000","last_deep_scrub":"28'2061","last_deep_scrub_stamp":"2024-05-10T05:19:06.539949+0000","last_clean_scrub_stamp":"2024-05-10T05:19:06.539949+0000","objects_scrubbed":0,"log_size":2061,"log_dups_size":0,"ondisk_log_size":2061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:43.575774+0000","scrub_duration":0.027233351999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1968","reported_seq":1995,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.023481+0000","last_change":"2024-05-10T04:51:52.754887+0000","last_active":"2024-05-10T05:18:26.023481+0000","last_peered":"2024-05-10T05:18:26.023481+0000","last_clean":"2024-05-10T05:18:26.023481+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:18:26.023481+0000","last_undegraded":"2024-05-10T05:18:26.023481+0000","last_fullsized":"2024-05-10T05:18:26.023481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2006","reported_seq":2033,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:25.947746+0000","last_change":"2024-05-10T04:51:52.763319+0000","last_active":"2024-05-10T05:18:25.947746+0000","last_peered":"2024-05-10T05:18:25.947746+0000","last_clean":"2024-05-10T05:18:25.947746+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:18:25.947746+0000","last_undegraded":"2024-05-10T05:18:25.947746+0000","last_fullsized":"2024-05-10T05:18:25.947746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2023","reported_seq":2061,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:14.048185+0000","last_change":"2024-05-10T05:19:14.048300+0000","last_active":"2024-05-10T05:19:14.048185+0000","last_peered":"2024-05-10T05:19:14.048185+0000","last_clean":"2024-05-10T05:19:14.048185+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:19:14.048185+0000","last_undegraded":"2024-05-10T05:19:14.048185+0000","last_fullsized":"2024-05-10T05:19:14.048185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2023","last_scrub_stamp":"2024-05-10T05:19:14.048154+0000","last_deep_scrub":"28'2023","last_deep_scrub_stamp":"2024-05-10T05:19:14.048154+0000","last_clean_scrub_stamp":"2024-05-10T05:19:14.048154+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:53.475598+0000","scrub_duration":0.002738739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2083","reported_seq":2122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:11.439671+0000","last_change":"2024-05-10T05:19:11.439798+0000","last_active":"2024-05-10T05:19:11.439671+0000","last_peered":"2024-05-10T05:19:11.439671+0000","last_clean":"2024-05-10T05:19:11.439671+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:19:11.439671+0000","last_undegraded":"2024-05-10T05:19:11.439671+0000","last_fullsized":"2024-05-10T05:19:11.439671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2083","last_scrub_stamp":"2024-05-10T05:19:11.439645+0000","last_deep_scrub":"28'2083","last_deep_scrub_stamp":"2024-05-10T05:19:11.439645+0000","last_clean_scrub_stamp":"2024-05-10T05:19:11.439645+0000","objects_scrubbed":0,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:39.267148+0000","scrub_duration":0.017916062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2091","reported_seq":2130,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.330233+0000","last_change":"2024-05-10T05:19:01.330399+0000","last_active":"2024-05-10T05:19:01.330233+0000","last_peered":"2024-05-10T05:19:01.330233+0000","last_clean":"2024-05-10T05:19:01.330233+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:19:01.330233+0000","last_undegraded":"2024-05-10T05:19:01.330233+0000","last_fullsized":"2024-05-10T05:19:01.330233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2091","last_scrub_stamp":"2024-05-10T05:19:01.330205+0000","last_deep_scrub":"28'2091","last_deep_scrub_stamp":"2024-05-10T05:19:01.330205+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.330205+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:38.366030+0000","scrub_duration":0.0063731329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1958","reported_seq":1997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.363975+0000","last_change":"2024-05-10T05:18:52.364107+0000","last_active":"2024-05-10T05:18:52.363975+0000","last_peered":"2024-05-10T05:18:52.363975+0000","last_clean":"2024-05-10T05:18:52.363975+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:52.363975+0000","last_undegraded":"2024-05-10T05:18:52.363975+0000","last_fullsized":"2024-05-10T05:18:52.363975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1958","last_scrub_stamp":"2024-05-10T05:18:52.363948+0000","last_deep_scrub":"28'1958","last_deep_scrub_stamp":"2024-05-10T05:18:52.363948+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.363948+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:41.653986+0000","scrub_duration":0.018300833999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.921175+0000","last_change":"2024-05-10T05:18:36.921337+0000","last_active":"2024-05-10T05:18:36.921175+0000","last_peered":"2024-05-10T05:18:36.921175+0000","last_clean":"2024-05-10T05:18:36.921175+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:36.921175+0000","last_undegraded":"2024-05-10T05:18:36.921175+0000","last_fullsized":"2024-05-10T05:18:36.921175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1948","last_scrub_stamp":"2024-05-10T05:18:36.921148+0000","last_deep_scrub":"28'1948","last_deep_scrub_stamp":"2024-05-10T05:18:36.921148+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.921148+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:17.214023+0000","scrub_duration":0.0019686439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2029","reported_seq":2068,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.847677+0000","last_change":"2024-05-10T05:18:33.847792+0000","last_active":"2024-05-10T05:18:33.847677+0000","last_peered":"2024-05-10T05:18:33.847677+0000","last_clean":"2024-05-10T05:18:33.847677+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:33.847677+0000","last_undegraded":"2024-05-10T05:18:33.847677+0000","last_fullsized":"2024-05-10T05:18:33.847677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2029","last_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_deep_scrub":"28'2029","last_deep_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.847651+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:17.105998+0000","scrub_duration":0.018189367000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'2006","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:10.278699+0000","last_change":"2024-05-10T05:19:10.278823+0000","last_active":"2024-05-10T05:19:10.278699+0000","last_peered":"2024-05-10T05:19:10.278699+0000","last_clean":"2024-05-10T05:19:10.278699+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:19:10.278699+0000","last_undegraded":"2024-05-10T05:19:10.278699+0000","last_fullsized":"2024-05-10T05:19:10.278699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2006","last_scrub_stamp":"2024-05-10T05:19:10.278668+0000","last_deep_scrub":"28'2006","last_deep_scrub_stamp":"2024-05-10T05:19:10.278668+0000","last_clean_scrub_stamp":"2024-05-10T05:19:10.278668+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:49.706112+0000","scrub_duration":0.0020059499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2108","reported_seq":2147,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.275942+0000","last_change":"2024-05-10T05:18:59.276069+0000","last_active":"2024-05-10T05:18:59.275942+0000","last_peered":"2024-05-10T05:18:59.275942+0000","last_clean":"2024-05-10T05:18:59.275942+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:59.275942+0000","last_undegraded":"2024-05-10T05:18:59.275942+0000","last_fullsized":"2024-05-10T05:18:59.275942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2108","last_scrub_stamp":"2024-05-10T05:18:59.275911+0000","last_deep_scrub":"28'2108","last_deep_scrub_stamp":"2024-05-10T05:18:59.275911+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.275911+0000","objects_scrubbed":0,"log_size":2108,"log_dups_size":0,"ondisk_log_size":2108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:03.694684+0000","scrub_duration":0.019024083000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1994","reported_seq":2022,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.134172+0000","last_change":"2024-05-10T04:51:52.757618+0000","last_active":"2024-05-10T05:18:26.134172+0000","last_peered":"2024-05-10T05:18:26.134172+0000","last_clean":"2024-05-10T05:18:26.134172+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:18:26.134172+0000","last_undegraded":"2024-05-10T05:18:26.134172+0000","last_fullsized":"2024-05-10T05:18:26.134172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:38.044150+0000","last_change":"2024-05-10T05:18:38.044283+0000","last_active":"2024-05-10T05:18:38.044150+0000","last_peered":"2024-05-10T05:18:38.044150+0000","last_clean":"2024-05-10T05:18:38.044150+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:38.044150+0000","last_undegraded":"2024-05-10T05:18:38.044150+0000","last_fullsized":"2024-05-10T05:18:38.044150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:18:38.044115+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:18:38.044115+0000","last_clean_scrub_stamp":"2024-05-10T05:18:38.044115+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:54:20.224156+0000","scrub_duration":0.033850064999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1994","reported_seq":2033,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.488895+0000","last_change":"2024-05-10T05:18:48.489025+0000","last_active":"2024-05-10T05:18:48.488895+0000","last_peered":"2024-05-10T05:18:48.488895+0000","last_clean":"2024-05-10T05:18:48.488895+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:48.488895+0000","last_undegraded":"2024-05-10T05:18:48.488895+0000","last_fullsized":"2024-05-10T05:18:48.488895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:18:48.488869+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:18:48.488869+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.488869+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:42.641061+0000","scrub_duration":0.0021049350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2104","reported_seq":2133,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.597589+0000","last_change":"2024-05-10T04:51:52.769083+0000","last_active":"2024-05-10T05:18:36.597589+0000","last_peered":"2024-05-10T05:18:36.597589+0000","last_clean":"2024-05-10T05:18:36.597589+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:18:36.597589+0000","last_undegraded":"2024-05-10T05:18:36.597589+0000","last_fullsized":"2024-05-10T05:18:36.597589+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7883,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.111143+0000","last_change":"2024-05-10T04:51:57.223079+0000","last_active":"2024-05-10T05:18:33.111143+0000","last_peered":"2024-05-10T05:18:33.111143+0000","last_clean":"2024-05-10T05:18:33.111143+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:18:33.111143+0000","last_undegraded":"2024-05-10T05:18:33.111143+0000","last_fullsized":"2024-05-10T05:18:33.111143+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1893","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.189902+0000","last_change":"2024-05-10T05:18:36.189902+0000","last_active":"2024-05-10T05:18:36.189902+0000","last_peered":"2024-05-10T05:18:36.189902+0000","last_clean":"2024-05-10T05:18:36.189902+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:36.189902+0000","last_undegraded":"2024-05-10T05:18:36.189902+0000","last_fullsized":"2024-05-10T05:18:36.189902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1893","last_scrub_stamp":"2024-05-10T05:18:36.189732+0000","last_deep_scrub":"28'1893","last_deep_scrub_stamp":"2024-05-10T05:18:36.189732+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.189732+0000","objects_scrubbed":2,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:57:40.485840+0000","scrub_duration":0.006777127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1915,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2039","reported_seq":2080,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:13.026233+0000","last_change":"2024-05-10T05:19:13.026377+0000","last_active":"2024-05-10T05:19:13.026233+0000","last_peered":"2024-05-10T05:19:13.026233+0000","last_clean":"2024-05-10T05:19:13.026233+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:19:13.026233+0000","last_undegraded":"2024-05-10T05:19:13.026233+0000","last_fullsized":"2024-05-10T05:19:13.026233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2039","last_scrub_stamp":"2024-05-10T05:19:13.026206+0000","last_deep_scrub":"28'2039","last_deep_scrub_stamp":"2024-05-10T05:19:13.026206+0000","last_clean_scrub_stamp":"2024-05-10T05:19:13.026206+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:32.238640+0000","scrub_duration":0.012113007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7662,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.855509+0000","last_change":"2024-05-10T05:19:09.855734+0000","last_active":"2024-05-10T05:19:09.855509+0000","last_peered":"2024-05-10T05:19:09.855509+0000","last_clean":"2024-05-10T05:19:09.855509+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:19:09.855509+0000","last_undegraded":"2024-05-10T05:19:09.855509+0000","last_fullsized":"2024-05-10T05:19:09.855509+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7466","last_scrub_stamp":"2024-05-10T05:19:09.855482+0000","last_deep_scrub":"28'7466","last_deep_scrub_stamp":"2024-05-10T05:19:09.855482+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.855482+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:23:29.788871+0000","scrub_duration":0.042030791999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6436","reported_seq":6478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.018633+0000","last_change":"2024-05-10T05:18:49.018746+0000","last_active":"2024-05-10T05:18:49.018633+0000","last_peered":"2024-05-10T05:18:49.018633+0000","last_clean":"2024-05-10T05:18:49.018633+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:49.018633+0000","last_undegraded":"2024-05-10T05:18:49.018633+0000","last_fullsized":"2024-05-10T05:18:49.018633+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6436","last_scrub_stamp":"2024-05-10T05:18:49.018608+0000","last_deep_scrub":"28'6436","last_deep_scrub_stamp":"2024-05-10T05:18:49.018608+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.018608+0000","objects_scrubbed":2,"log_size":6336,"log_dups_size":0,"ondisk_log_size":6336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:29.024164+0000","scrub_duration":0.035903804999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2041","reported_seq":2082,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.310495+0000","last_change":"2024-05-10T05:18:55.310495+0000","last_active":"2024-05-10T05:18:55.310495+0000","last_peered":"2024-05-10T05:18:55.310495+0000","last_clean":"2024-05-10T05:18:55.310495+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:55.310495+0000","last_undegraded":"2024-05-10T05:18:55.310495+0000","last_fullsized":"2024-05-10T05:18:55.310495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2041","last_scrub_stamp":"2024-05-10T05:18:55.310319+0000","last_deep_scrub":"28'2041","last_deep_scrub_stamp":"2024-05-10T05:18:55.310319+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.310319+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:23.137822+0000","scrub_duration":0.029729122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7734,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:02.843990+0000","last_change":"2024-05-10T05:19:02.844173+0000","last_active":"2024-05-10T05:19:02.843990+0000","last_peered":"2024-05-10T05:19:02.843990+0000","last_clean":"2024-05-10T05:19:02.843990+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:19:02.843990+0000","last_undegraded":"2024-05-10T05:19:02.843990+0000","last_fullsized":"2024-05-10T05:19:02.843990+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7590","last_scrub_stamp":"2024-05-10T05:19:02.843960+0000","last_deep_scrub":"28'7590","last_deep_scrub_stamp":"2024-05-10T05:19:02.843960+0000","last_clean_scrub_stamp":"2024-05-10T05:19:02.843960+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:14:28.510783+0000","scrub_duration":0.040026500999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9873","reported_seq":9912,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.610470+0000","last_change":"2024-05-10T05:18:57.610579+0000","last_active":"2024-05-10T05:18:57.610470+0000","last_peered":"2024-05-10T05:18:57.610470+0000","last_clean":"2024-05-10T05:18:57.610470+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:57.610470+0000","last_undegraded":"2024-05-10T05:18:57.610470+0000","last_fullsized":"2024-05-10T05:18:57.610470+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9873","last_scrub_stamp":"2024-05-10T05:18:57.610445+0000","last_deep_scrub":"28'9873","last_deep_scrub_stamp":"2024-05-10T05:18:57.610445+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.610445+0000","objects_scrubbed":6,"log_size":7073,"log_dups_size":0,"ondisk_log_size":7073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:20.490810+0000","scrub_duration":0.083117143000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9870,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2094","reported_seq":2126,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:03.505624+0000","last_change":"2024-05-10T05:19:03.505751+0000","last_active":"2024-05-10T05:19:03.505624+0000","last_peered":"2024-05-10T05:19:03.505624+0000","last_clean":"2024-05-10T05:19:03.505624+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:19:03.505624+0000","last_undegraded":"2024-05-10T05:19:03.505624+0000","last_fullsized":"2024-05-10T05:19:03.505624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2094","last_scrub_stamp":"2024-05-10T05:19:03.505597+0000","last_deep_scrub":"28'2094","last_deep_scrub_stamp":"2024-05-10T05:19:03.505597+0000","last_clean_scrub_stamp":"2024-05-10T05:19:03.505597+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:13.266940+0000","scrub_duration":0.0023624420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:50.926158+0000","last_change":"2024-05-10T05:18:50.926397+0000","last_active":"2024-05-10T05:18:50.926158+0000","last_peered":"2024-05-10T05:18:50.926158+0000","last_clean":"2024-05-10T05:18:50.926158+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:50.926158+0000","last_undegraded":"2024-05-10T05:18:50.926158+0000","last_fullsized":"2024-05-10T05:18:50.926158+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7416","last_scrub_stamp":"2024-05-10T05:18:50.926128+0000","last_deep_scrub":"28'7416","last_deep_scrub_stamp":"2024-05-10T05:18:50.926128+0000","last_clean_scrub_stamp":"2024-05-10T05:18:50.926128+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:08.428647+0000","scrub_duration":0.048600009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5472","reported_seq":5511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.638540+0000","last_change":"2024-05-10T05:18:52.638670+0000","last_active":"2024-05-10T05:18:52.638540+0000","last_peered":"2024-05-10T05:18:52.638540+0000","last_clean":"2024-05-10T05:18:52.638540+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:18:52.638540+0000","last_undegraded":"2024-05-10T05:18:52.638540+0000","last_fullsized":"2024-05-10T05:18:52.638540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5472","last_scrub_stamp":"2024-05-10T05:18:52.638511+0000","last_deep_scrub":"28'5472","last_deep_scrub_stamp":"2024-05-10T05:18:52.638511+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.638511+0000","objects_scrubbed":3,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:43.963218+0000","scrub_duration":0.039925167999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5469,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2034","reported_seq":2061,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.025679+0000","last_change":"2024-05-10T04:51:52.749371+0000","last_active":"2024-05-10T05:18:26.025679+0000","last_peered":"2024-05-10T05:18:26.025679+0000","last_clean":"2024-05-10T05:18:26.025679+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:18:26.025679+0000","last_undegraded":"2024-05-10T05:18:26.025679+0000","last_fullsized":"2024-05-10T05:18:26.025679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7514","reported_seq":7578,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.137852+0000","last_change":"2024-05-10T04:51:57.175361+0000","last_active":"2024-05-10T05:18:26.137852+0000","last_peered":"2024-05-10T05:18:26.137852+0000","last_clean":"2024-05-10T05:18:26.137852+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:18:26.137852+0000","last_undegraded":"2024-05-10T05:18:26.137852+0000","last_fullsized":"2024-05-10T05:18:26.137852+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5295,"num_write_kb":976486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8794","reported_seq":8833,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.149854+0000","last_change":"2024-05-10T05:18:47.149956+0000","last_active":"2024-05-10T05:18:47.149854+0000","last_peered":"2024-05-10T05:18:47.149854+0000","last_clean":"2024-05-10T05:18:47.149854+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:47.149854+0000","last_undegraded":"2024-05-10T05:18:47.149854+0000","last_fullsized":"2024-05-10T05:18:47.149854+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8794","last_scrub_stamp":"2024-05-10T05:18:47.149826+0000","last_deep_scrub":"28'8794","last_deep_scrub_stamp":"2024-05-10T05:18:47.149826+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.149826+0000","objects_scrubbed":6,"log_size":6294,"log_dups_size":0,"ondisk_log_size":6294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:24.339435+0000","scrub_duration":0.095680271999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2111,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.892088+0000","last_change":"2024-05-10T05:18:40.892088+0000","last_active":"2024-05-10T05:18:40.892088+0000","last_peered":"2024-05-10T05:18:40.892088+0000","last_clean":"2024-05-10T05:18:40.892088+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:40.892088+0000","last_undegraded":"2024-05-10T05:18:40.892088+0000","last_fullsized":"2024-05-10T05:18:40.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2072","last_scrub_stamp":"2024-05-10T05:18:40.891925+0000","last_deep_scrub":"28'2072","last_deep_scrub_stamp":"2024-05-10T05:18:40.891925+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.891925+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:47.245425+0000","scrub_duration":0.0121844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7557,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:56.491884+0000","last_change":"2024-05-10T05:18:56.492046+0000","last_active":"2024-05-10T05:18:56.491884+0000","last_peered":"2024-05-10T05:18:56.491884+0000","last_clean":"2024-05-10T05:18:56.491884+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:56.491884+0000","last_undegraded":"2024-05-10T05:18:56.491884+0000","last_fullsized":"2024-05-10T05:18:56.491884+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7470","last_scrub_stamp":"2024-05-10T05:18:56.491859+0000","last_deep_scrub":"28'7470","last_deep_scrub_stamp":"2024-05-10T05:18:56.491859+0000","last_clean_scrub_stamp":"2024-05-10T05:18:56.491859+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:36.784734+0000","scrub_duration":0.040445502000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9793","reported_seq":9832,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.398108+0000","last_change":"2024-05-10T05:18:44.398230+0000","last_active":"2024-05-10T05:18:44.398108+0000","last_peered":"2024-05-10T05:18:44.398108+0000","last_clean":"2024-05-10T05:18:44.398108+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:44.398108+0000","last_undegraded":"2024-05-10T05:18:44.398108+0000","last_fullsized":"2024-05-10T05:18:44.398108+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9793","last_scrub_stamp":"2024-05-10T05:18:44.398080+0000","last_deep_scrub":"28'9793","last_deep_scrub_stamp":"2024-05-10T05:18:44.398080+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.398080+0000","objects_scrubbed":5,"log_size":7993,"log_dups_size":0,"ondisk_log_size":7993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:44.122929+0000","scrub_duration":0.088564188000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2031","reported_seq":2069,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.257657+0000","last_change":"2024-05-10T05:18:44.257816+0000","last_active":"2024-05-10T05:18:44.257657+0000","last_peered":"2024-05-10T05:18:44.257657+0000","last_clean":"2024-05-10T05:18:44.257657+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:44.257657+0000","last_undegraded":"2024-05-10T05:18:44.257657+0000","last_fullsized":"2024-05-10T05:18:44.257657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2031","last_scrub_stamp":"2024-05-10T05:18:44.257627+0000","last_deep_scrub":"28'2031","last_deep_scrub_stamp":"2024-05-10T05:18:44.257627+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.257627+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:43.057150+0000","scrub_duration":0.0094484070000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7236","reported_seq":7480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:35.725306+0000","last_change":"2024-05-10T04:51:57.171595+0000","last_active":"2024-05-10T05:18:35.725306+0000","last_peered":"2024-05-10T05:18:35.725306+0000","last_clean":"2024-05-10T05:18:35.725306+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:18:35.725306+0000","last_undegraded":"2024-05-10T05:18:35.725306+0000","last_fullsized":"2024-05-10T05:18:35.725306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5149,"num_write_kb":870343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4835","reported_seq":4875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:45.041921+0000","last_change":"2024-05-10T05:18:45.042028+0000","last_active":"2024-05-10T05:18:45.041921+0000","last_peered":"2024-05-10T05:18:45.041921+0000","last_clean":"2024-05-10T05:18:45.041921+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:45.041921+0000","last_undegraded":"2024-05-10T05:18:45.041921+0000","last_fullsized":"2024-05-10T05:18:45.041921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4835","last_scrub_stamp":"2024-05-10T05:18:45.041892+0000","last_deep_scrub":"28'4835","last_deep_scrub_stamp":"2024-05-10T05:18:45.041892+0000","last_clean_scrub_stamp":"2024-05-10T05:18:45.041892+0000","objects_scrubbed":2,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:49.460665+0000","scrub_duration":0.031114352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2106","reported_seq":2145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.975043+0000","last_change":"2024-05-10T05:18:53.975155+0000","last_active":"2024-05-10T05:18:53.975043+0000","last_peered":"2024-05-10T05:18:53.975043+0000","last_clean":"2024-05-10T05:18:53.975043+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:53.975043+0000","last_undegraded":"2024-05-10T05:18:53.975043+0000","last_fullsized":"2024-05-10T05:18:53.975043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2106","last_scrub_stamp":"2024-05-10T05:18:53.975013+0000","last_deep_scrub":"28'2106","last_deep_scrub_stamp":"2024-05-10T05:18:53.975013+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.975013+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:32.059839+0000","scrub_duration":0.0019932040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7811,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.692175+0000","last_change":"2024-05-10T04:51:57.218084+0000","last_active":"2024-05-10T05:18:21.692175+0000","last_peered":"2024-05-10T05:18:21.692175+0000","last_clean":"2024-05-10T05:18:21.692175+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:18:21.692175+0000","last_undegraded":"2024-05-10T05:18:21.692175+0000","last_fullsized":"2024-05-10T05:18:21.692175+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9720","reported_seq":9760,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.873540+0000","last_change":"2024-05-10T05:18:52.873661+0000","last_active":"2024-05-10T05:18:52.873540+0000","last_peered":"2024-05-10T05:18:52.873540+0000","last_clean":"2024-05-10T05:18:52.873540+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:18:52.873540+0000","last_undegraded":"2024-05-10T05:18:52.873540+0000","last_fullsized":"2024-05-10T05:18:52.873540+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9720","last_scrub_stamp":"2024-05-10T05:18:52.873508+0000","last_deep_scrub":"28'9720","last_deep_scrub_stamp":"2024-05-10T05:18:52.873508+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.873508+0000","objects_scrubbed":1,"log_size":7520,"log_dups_size":0,"ondisk_log_size":7520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:53.278672+0000","scrub_duration":0.023067694999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2011","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:56.298417+0000","last_change":"2024-05-10T05:18:56.298549+0000","last_active":"2024-05-10T05:18:56.298417+0000","last_peered":"2024-05-10T05:18:56.298417+0000","last_clean":"2024-05-10T05:18:56.298417+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:56.298417+0000","last_undegraded":"2024-05-10T05:18:56.298417+0000","last_fullsized":"2024-05-10T05:18:56.298417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2011","last_scrub_stamp":"2024-05-10T05:18:56.298376+0000","last_deep_scrub":"28'2011","last_deep_scrub_stamp":"2024-05-10T05:18:56.298376+0000","last_clean_scrub_stamp":"2024-05-10T05:18:56.298376+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:47.623083+0000","scrub_duration":0.017952936999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7746,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.260791+0000","last_change":"2024-05-10T04:51:57.222127+0000","last_active":"2024-05-10T05:18:23.260791+0000","last_peered":"2024-05-10T05:18:23.260791+0000","last_clean":"2024-05-10T05:18:23.260791+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:18:23.260791+0000","last_undegraded":"2024-05-10T05:18:23.260791+0000","last_fullsized":"2024-05-10T05:18:23.260791+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6187","reported_seq":6969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.342323+0000","last_change":"2024-05-10T05:18:48.342476+0000","last_active":"2024-05-10T05:18:48.342323+0000","last_peered":"2024-05-10T05:18:48.342323+0000","last_clean":"2024-05-10T05:18:48.342323+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:48.342323+0000","last_undegraded":"2024-05-10T05:18:48.342323+0000","last_fullsized":"2024-05-10T05:18:48.342323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6187","last_scrub_stamp":"2024-05-10T05:18:48.342269+0000","last_deep_scrub":"28'6187","last_deep_scrub_stamp":"2024-05-10T05:18:48.342269+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.342269+0000","objects_scrubbed":3,"log_size":6187,"log_dups_size":0,"ondisk_log_size":6187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:42.585826+0000","scrub_duration":0.053531205999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11372145,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6181,"num_write_kb":47965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2046","reported_seq":2074,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:28.029099+0000","last_change":"2024-05-10T04:51:52.758521+0000","last_active":"2024-05-10T05:18:28.029099+0000","last_peered":"2024-05-10T05:18:28.029099+0000","last_clean":"2024-05-10T05:18:28.029099+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:18:28.029099+0000","last_undegraded":"2024-05-10T05:18:28.029099+0000","last_fullsized":"2024-05-10T05:18:28.029099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7408","reported_seq":7470,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.144245+0000","last_change":"2024-05-10T04:51:57.177179+0000","last_active":"2024-05-10T05:18:26.144245+0000","last_peered":"2024-05-10T05:18:26.144245+0000","last_clean":"2024-05-10T05:18:26.144245+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:18:26.144245+0000","last_undegraded":"2024-05-10T05:18:26.144245+0000","last_fullsized":"2024-05-10T05:18:26.144245+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6304,"log_dups_size":0,"ondisk_log_size":6304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5304,"num_write_kb":989379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6458","reported_seq":6498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.896966+0000","last_change":"2024-05-10T05:18:53.897089+0000","last_active":"2024-05-10T05:18:53.896966+0000","last_peered":"2024-05-10T05:18:53.896966+0000","last_clean":"2024-05-10T05:18:53.896966+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:18:53.896966+0000","last_undegraded":"2024-05-10T05:18:53.896966+0000","last_fullsized":"2024-05-10T05:18:53.896966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6458","last_scrub_stamp":"2024-05-10T05:18:53.896937+0000","last_deep_scrub":"28'6458","last_deep_scrub_stamp":"2024-05-10T05:18:53.896937+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.896937+0000","objects_scrubbed":1,"log_size":6458,"log_dups_size":0,"ondisk_log_size":6458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:34.189812+0000","scrub_duration":0.02504234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6459,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2058","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.294133+0000","last_change":"2024-05-10T05:18:42.294264+0000","last_active":"2024-05-10T05:18:42.294133+0000","last_peered":"2024-05-10T05:18:42.294133+0000","last_clean":"2024-05-10T05:18:42.294133+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:42.294133+0000","last_undegraded":"2024-05-10T05:18:42.294133+0000","last_fullsized":"2024-05-10T05:18:42.294133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2058","last_scrub_stamp":"2024-05-10T05:18:42.294102+0000","last_deep_scrub":"28'2058","last_deep_scrub_stamp":"2024-05-10T05:18:42.294102+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.294102+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:19.483711+0000","scrub_duration":0.026468472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.896626+0000","last_change":"2024-05-10T05:18:55.896808+0000","last_active":"2024-05-10T05:18:55.896626+0000","last_peered":"2024-05-10T05:18:55.896626+0000","last_clean":"2024-05-10T05:18:55.896626+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:55.896626+0000","last_undegraded":"2024-05-10T05:18:55.896626+0000","last_fullsized":"2024-05-10T05:18:55.896626+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7585","last_scrub_stamp":"2024-05-10T05:18:55.896595+0000","last_deep_scrub":"28'7585","last_deep_scrub_stamp":"2024-05-10T05:18:55.896595+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.896595+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:42.760602+0000","scrub_duration":0.041604107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5962","reported_seq":6002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.349719+0000","last_change":"2024-05-10T05:18:53.349832+0000","last_active":"2024-05-10T05:18:53.349719+0000","last_peered":"2024-05-10T05:18:53.349719+0000","last_clean":"2024-05-10T05:18:53.349719+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:53.349719+0000","last_undegraded":"2024-05-10T05:18:53.349719+0000","last_fullsized":"2024-05-10T05:18:53.349719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5962","last_scrub_stamp":"2024-05-10T05:18:53.349691+0000","last_deep_scrub":"28'5962","last_deep_scrub_stamp":"2024-05-10T05:18:53.349691+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.349691+0000","objects_scrubbed":3,"log_size":5962,"log_dups_size":0,"ondisk_log_size":5962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:53.074540+0000","scrub_duration":0.025746323000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":37127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:43.908832+0000","last_change":"2024-05-10T05:18:43.908970+0000","last_active":"2024-05-10T05:18:43.908832+0000","last_peered":"2024-05-10T05:18:43.908832+0000","last_clean":"2024-05-10T05:18:43.908832+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:43.908832+0000","last_undegraded":"2024-05-10T05:18:43.908832+0000","last_fullsized":"2024-05-10T05:18:43.908832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2047","last_scrub_stamp":"2024-05-10T05:18:43.908805+0000","last_deep_scrub":"28'2047","last_deep_scrub_stamp":"2024-05-10T05:18:43.908805+0000","last_clean_scrub_stamp":"2024-05-10T05:18:43.908805+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:53.670148+0000","scrub_duration":0.0019465979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7575","reported_seq":7652,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.334081+0000","last_change":"2024-05-10T05:19:09.334250+0000","last_active":"2024-05-10T05:19:09.334081+0000","last_peered":"2024-05-10T05:19:09.334081+0000","last_clean":"2024-05-10T05:19:09.334081+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:19:09.334081+0000","last_undegraded":"2024-05-10T05:19:09.334081+0000","last_fullsized":"2024-05-10T05:19:09.334081+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7575","last_scrub_stamp":"2024-05-10T05:19:09.334055+0000","last_deep_scrub":"28'7575","last_deep_scrub_stamp":"2024-05-10T05:19:09.334055+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.334055+0000","objects_scrubbed":0,"log_size":7375,"log_dups_size":0,"ondisk_log_size":7375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:46.369880+0000","scrub_duration":0.040651574000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5441,"num_write_kb":923430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9434","reported_seq":10141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:39.429029+0000","last_change":"2024-05-10T05:18:39.429149+0000","last_active":"2024-05-10T05:18:39.429029+0000","last_peered":"2024-05-10T05:18:39.429029+0000","last_clean":"2024-05-10T05:18:39.429029+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:39.429029+0000","last_undegraded":"2024-05-10T05:18:39.429029+0000","last_fullsized":"2024-05-10T05:18:39.429029+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9434","last_scrub_stamp":"2024-05-10T05:18:39.429006+0000","last_deep_scrub":"28'9434","last_deep_scrub_stamp":"2024-05-10T05:18:39.429006+0000","last_clean_scrub_stamp":"2024-05-10T05:18:39.429006+0000","objects_scrubbed":8,"log_size":7934,"log_dups_size":0,"ondisk_log_size":7934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:06.400181+0000","scrub_duration":0.080354881000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9422,"num_write_kb":67821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1992","reported_seq":2020,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:31.882823+0000","last_change":"2024-05-10T04:51:52.769714+0000","last_active":"2024-05-10T05:18:31.882823+0000","last_peered":"2024-05-10T05:18:31.882823+0000","last_clean":"2024-05-10T05:18:31.882823+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:18:31.882823+0000","last_undegraded":"2024-05-10T05:18:31.882823+0000","last_fullsized":"2024-05-10T05:18:31.882823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7644,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.028372+0000","last_change":"2024-05-10T04:51:57.219647+0000","last_active":"2024-05-10T05:18:23.028372+0000","last_peered":"2024-05-10T05:18:23.028372+0000","last_clean":"2024-05-10T05:18:23.028372+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:18:23.028372+0000","last_undegraded":"2024-05-10T05:18:23.028372+0000","last_fullsized":"2024-05-10T05:18:23.028372+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4835","reported_seq":4875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:35.257270+0000","last_change":"2024-05-10T05:18:35.257379+0000","last_active":"2024-05-10T05:18:35.257270+0000","last_peered":"2024-05-10T05:18:35.257270+0000","last_clean":"2024-05-10T05:18:35.257270+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:18:35.257270+0000","last_undegraded":"2024-05-10T05:18:35.257270+0000","last_fullsized":"2024-05-10T05:18:35.257270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4835","last_scrub_stamp":"2024-05-10T05:18:35.257245+0000","last_deep_scrub":"28'4835","last_deep_scrub_stamp":"2024-05-10T05:18:35.257245+0000","last_clean_scrub_stamp":"2024-05-10T05:18:35.257245+0000","objects_scrubbed":4,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:26.581951+0000","scrub_duration":0.037039299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4833,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2054","reported_seq":2093,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.334744+0000","last_change":"2024-05-10T05:18:49.334848+0000","last_active":"2024-05-10T05:18:49.334744+0000","last_peered":"2024-05-10T05:18:49.334744+0000","last_clean":"2024-05-10T05:18:49.334744+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:49.334744+0000","last_undegraded":"2024-05-10T05:18:49.334744+0000","last_fullsized":"2024-05-10T05:18:49.334744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2054","last_scrub_stamp":"2024-05-10T05:18:49.334712+0000","last_deep_scrub":"28'2054","last_deep_scrub_stamp":"2024-05-10T05:18:49.334712+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.334712+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:27.419539+0000","scrub_duration":0.002887634,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.780712+0000","last_change":"2024-05-10T04:51:57.216211+0000","last_active":"2024-05-10T05:18:21.780712+0000","last_peered":"2024-05-10T05:18:21.780712+0000","last_clean":"2024-05-10T05:18:21.780712+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:18:21.780712+0000","last_undegraded":"2024-05-10T05:18:21.780712+0000","last_fullsized":"2024-05-10T05:18:21.780712+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2078","reported_seq":2118,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.978768+0000","last_change":"2024-05-10T05:18:59.978883+0000","last_active":"2024-05-10T05:18:59.978768+0000","last_peered":"2024-05-10T05:18:59.978768+0000","last_clean":"2024-05-10T05:18:59.978768+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:18:59.978768+0000","last_undegraded":"2024-05-10T05:18:59.978768+0000","last_fullsized":"2024-05-10T05:18:59.978768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2078","last_scrub_stamp":"2024-05-10T05:18:59.978739+0000","last_deep_scrub":"28'2078","last_deep_scrub_stamp":"2024-05-10T05:18:59.978739+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.978739+0000","objects_scrubbed":2,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:35.925245+0000","scrub_duration":0.030891707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2091,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2077","reported_seq":2116,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.504489+0000","last_change":"2024-05-10T05:18:59.504609+0000","last_active":"2024-05-10T05:18:59.504489+0000","last_peered":"2024-05-10T05:18:59.504489+0000","last_clean":"2024-05-10T05:18:59.504489+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:59.504489+0000","last_undegraded":"2024-05-10T05:18:59.504489+0000","last_fullsized":"2024-05-10T05:18:59.504489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2077","last_scrub_stamp":"2024-05-10T05:18:59.504466+0000","last_deep_scrub":"28'2077","last_deep_scrub_stamp":"2024-05-10T05:18:59.504466+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.504466+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:39.510022+0000","scrub_duration":0.0036729250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7643,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.111040+0000","last_change":"2024-05-10T04:52:41.239639+0000","last_active":"2024-05-10T05:18:33.111040+0000","last_peered":"2024-05-10T05:18:33.111040+0000","last_clean":"2024-05-10T05:18:33.111040+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:18:33.111040+0000","last_undegraded":"2024-05-10T05:18:33.111040+0000","last_fullsized":"2024-05-10T05:18:33.111040+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.358849+0000","last_change":"2024-05-10T05:18:40.358971+0000","last_active":"2024-05-10T05:18:40.358849+0000","last_peered":"2024-05-10T05:18:40.358849+0000","last_clean":"2024-05-10T05:18:40.358849+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:40.358849+0000","last_undegraded":"2024-05-10T05:18:40.358849+0000","last_fullsized":"2024-05-10T05:18:40.358849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2440","last_scrub_stamp":"2024-05-10T05:18:40.358819+0000","last_deep_scrub":"28'2440","last_deep_scrub_stamp":"2024-05-10T05:18:40.358819+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.358819+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:23.617166+0000","scrub_duration":0.0046993249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2008","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:51.331886+0000","last_change":"2024-05-10T05:18:51.332028+0000","last_active":"2024-05-10T05:18:51.331886+0000","last_peered":"2024-05-10T05:18:51.331886+0000","last_clean":"2024-05-10T05:18:51.331886+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:51.331886+0000","last_undegraded":"2024-05-10T05:18:51.331886+0000","last_fullsized":"2024-05-10T05:18:51.331886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2008","last_scrub_stamp":"2024-05-10T05:18:51.331859+0000","last_deep_scrub":"28'2008","last_deep_scrub_stamp":"2024-05-10T05:18:51.331859+0000","last_clean_scrub_stamp":"2024-05-10T05:18:51.331859+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:55.750632+0000","scrub_duration":0.0023987499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:30.498059+0000","last_change":"2024-05-10T04:51:57.175430+0000","last_active":"2024-05-10T05:18:30.498059+0000","last_peered":"2024-05-10T05:18:30.498059+0000","last_clean":"2024-05-10T05:18:30.498059+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:18:30.498059+0000","last_undegraded":"2024-05-10T05:18:30.498059+0000","last_fullsized":"2024-05-10T05:18:30.498059+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3410","reported_seq":3450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.526731+0000","last_change":"2024-05-10T05:18:33.526835+0000","last_active":"2024-05-10T05:18:33.526731+0000","last_peered":"2024-05-10T05:18:33.526731+0000","last_clean":"2024-05-10T05:18:33.526731+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:33.526731+0000","last_undegraded":"2024-05-10T05:18:33.526731+0000","last_fullsized":"2024-05-10T05:18:33.526731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3410","last_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_deep_scrub":"28'3410","last_deep_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.526706+0000","objects_scrubbed":6,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:30.870417+0000","scrub_duration":0.035523645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3414,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2093","reported_seq":2126,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.501519+0000","last_change":"2024-05-10T05:19:01.501659+0000","last_active":"2024-05-10T05:19:01.501519+0000","last_peered":"2024-05-10T05:19:01.501519+0000","last_clean":"2024-05-10T05:19:01.501519+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:19:01.501519+0000","last_undegraded":"2024-05-10T05:19:01.501519+0000","last_fullsized":"2024-05-10T05:19:01.501519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2093","last_scrub_stamp":"2024-05-10T05:19:01.501471+0000","last_deep_scrub":"28'2093","last_deep_scrub_stamp":"2024-05-10T05:19:01.501471+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.501471+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:37.447977+0000","scrub_duration":0.0025676319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7508,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:03.787873+0000","last_change":"2024-05-10T05:19:03.788074+0000","last_active":"2024-05-10T05:19:03.787873+0000","last_peered":"2024-05-10T05:19:03.787873+0000","last_clean":"2024-05-10T05:19:03.787873+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:19:03.787873+0000","last_undegraded":"2024-05-10T05:19:03.787873+0000","last_fullsized":"2024-05-10T05:19:03.787873+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7434","last_scrub_stamp":"2024-05-10T05:19:03.787843+0000","last_deep_scrub":"28'7434","last_deep_scrub_stamp":"2024-05-10T05:19:03.787843+0000","last_clean_scrub_stamp":"2024-05-10T05:19:03.787843+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:25.238453+0000","scrub_duration":0.031043378999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4732","reported_seq":4773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.007422+0000","last_change":"2024-05-10T05:18:36.007422+0000","last_active":"2024-05-10T05:18:36.007422+0000","last_peered":"2024-05-10T05:18:36.007422+0000","last_clean":"2024-05-10T05:18:36.007422+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:36.007422+0000","last_undegraded":"2024-05-10T05:18:36.007422+0000","last_fullsized":"2024-05-10T05:18:36.007422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4732","last_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_deep_scrub":"28'4732","last_deep_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.007270+0000","objects_scrubbed":4,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:36.412434+0000","scrub_duration":0.047935197999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2048","reported_seq":2088,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:05.564105+0000","last_change":"2024-05-10T05:19:05.564231+0000","last_active":"2024-05-10T05:19:05.564105+0000","last_peered":"2024-05-10T05:19:05.564105+0000","last_clean":"2024-05-10T05:19:05.564105+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:19:05.564105+0000","last_undegraded":"2024-05-10T05:19:05.564105+0000","last_fullsized":"2024-05-10T05:19:05.564105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2048","last_scrub_stamp":"2024-05-10T05:19:05.564071+0000","last_deep_scrub":"28'2048","last_deep_scrub_stamp":"2024-05-10T05:19:05.564071+0000","last_clean_scrub_stamp":"2024-05-10T05:19:05.564071+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:08:04.125916+0000","scrub_duration":0.0019698820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7930,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:31.366407+0000","last_change":"2024-05-10T04:51:57.166758+0000","last_active":"2024-05-10T05:18:31.366407+0000","last_peered":"2024-05-10T05:18:31.366407+0000","last_clean":"2024-05-10T05:18:31.366407+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:18:31.366407+0000","last_undegraded":"2024-05-10T05:18:31.366407+0000","last_fullsized":"2024-05-10T05:18:31.366407+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6065","reported_seq":6107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.318485+0000","last_change":"2024-05-10T05:18:49.318485+0000","last_active":"2024-05-10T05:18:49.318485+0000","last_peered":"2024-05-10T05:18:49.318485+0000","last_clean":"2024-05-10T05:18:49.318485+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:49.318485+0000","last_undegraded":"2024-05-10T05:18:49.318485+0000","last_fullsized":"2024-05-10T05:18:49.318485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6065","last_scrub_stamp":"2024-05-10T05:18:49.318323+0000","last_deep_scrub":"28'6065","last_deep_scrub_stamp":"2024-05-10T05:18:49.318323+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.318323+0000","objects_scrubbed":2,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:32.576670+0000","scrub_duration":0.033539357999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6068,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2026","reported_seq":2067,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:05.904631+0000","last_change":"2024-05-10T05:19:05.904631+0000","last_active":"2024-05-10T05:19:05.904631+0000","last_peered":"2024-05-10T05:19:05.904631+0000","last_clean":"2024-05-10T05:19:05.904631+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:19:05.904631+0000","last_undegraded":"2024-05-10T05:19:05.904631+0000","last_fullsized":"2024-05-10T05:19:05.904631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2026","last_scrub_stamp":"2024-05-10T05:19:05.904474+0000","last_deep_scrub":"28'2026","last_deep_scrub_stamp":"2024-05-10T05:19:05.904474+0000","last_clean_scrub_stamp":"2024-05-10T05:19:05.904474+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:20.224651+0000","scrub_duration":0.0063328960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.342062+0000","last_change":"2024-05-10T05:19:01.342062+0000","last_active":"2024-05-10T05:19:01.342062+0000","last_peered":"2024-05-10T05:19:01.342062+0000","last_clean":"2024-05-10T05:19:01.342062+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:19:01.342062+0000","last_undegraded":"2024-05-10T05:19:01.342062+0000","last_fullsized":"2024-05-10T05:19:01.342062+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8319","last_scrub_stamp":"2024-05-10T05:19:01.341867+0000","last_deep_scrub":"28'8319","last_deep_scrub_stamp":"2024-05-10T05:19:01.341867+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.341867+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:22.189005+0000","scrub_duration":0.044138001000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7063","reported_seq":7105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.933890+0000","last_change":"2024-05-10T05:18:44.933890+0000","last_active":"2024-05-10T05:18:44.933890+0000","last_peered":"2024-05-10T05:18:44.933890+0000","last_clean":"2024-05-10T05:18:44.933890+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:18:44.933890+0000","last_undegraded":"2024-05-10T05:18:44.933890+0000","last_fullsized":"2024-05-10T05:18:44.933890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7063","last_scrub_stamp":"2024-05-10T05:18:44.933739+0000","last_deep_scrub":"28'7063","last_deep_scrub_stamp":"2024-05-10T05:18:44.933739+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.933739+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:39.085930+0000","scrub_duration":0.0063213080000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7059,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2112,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:46.916485+0000","last_change":"2024-05-10T05:18:46.916485+0000","last_active":"2024-05-10T05:18:46.916485+0000","last_peered":"2024-05-10T05:18:46.916485+0000","last_clean":"2024-05-10T05:18:46.916485+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:46.916485+0000","last_undegraded":"2024-05-10T05:18:46.916485+0000","last_fullsized":"2024-05-10T05:18:46.916485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2071","last_scrub_stamp":"2024-05-10T05:18:46.916337+0000","last_deep_scrub":"28'2071","last_deep_scrub_stamp":"2024-05-10T05:18:46.916337+0000","last_clean_scrub_stamp":"2024-05-10T05:18:46.916337+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:01.236515+0000","scrub_duration":0.0041311799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7600,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:08.345716+0000","last_change":"2024-05-10T05:19:08.345879+0000","last_active":"2024-05-10T05:19:08.345716+0000","last_peered":"2024-05-10T05:19:08.345716+0000","last_clean":"2024-05-10T05:19:08.345716+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:19:08.345716+0000","last_undegraded":"2024-05-10T05:19:08.345716+0000","last_fullsized":"2024-05-10T05:19:08.345716+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7419","last_scrub_stamp":"2024-05-10T05:19:08.345687+0000","last_deep_scrub":"28'7419","last_deep_scrub_stamp":"2024-05-10T05:19:08.345687+0000","last_clean_scrub_stamp":"2024-05-10T05:19:08.345687+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:46.430513+0000","scrub_duration":0.039549005999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2059","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.256655+0000","last_change":"2024-05-10T05:18:57.256759+0000","last_active":"2024-05-10T05:18:57.256655+0000","last_peered":"2024-05-10T05:18:57.256655+0000","last_clean":"2024-05-10T05:18:57.256655+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:57.256655+0000","last_undegraded":"2024-05-10T05:18:57.256655+0000","last_fullsized":"2024-05-10T05:18:57.256655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2059","last_scrub_stamp":"2024-05-10T05:18:57.256622+0000","last_deep_scrub":"28'2059","last_deep_scrub_stamp":"2024-05-10T05:18:57.256622+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.256622+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:01.552730+0000","scrub_duration":0.0023702509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6621,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:43.443028+0000","last_change":"2024-05-10T05:18:43.443028+0000","last_active":"2024-05-10T05:18:43.443028+0000","last_peered":"2024-05-10T05:18:43.443028+0000","last_clean":"2024-05-10T05:18:43.443028+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:43.443028+0000","last_undegraded":"2024-05-10T05:18:43.443028+0000","last_fullsized":"2024-05-10T05:18:43.443028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5855","last_scrub_stamp":"2024-05-10T05:18:43.442882+0000","last_deep_scrub":"28'5855","last_deep_scrub_stamp":"2024-05-10T05:18:43.442882+0000","last_clean_scrub_stamp":"2024-05-10T05:18:43.442882+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:57.851745+0000","scrub_duration":0.0054037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:35.725312+0000","last_change":"2024-05-10T04:51:57.216344+0000","last_active":"2024-05-10T05:18:35.725312+0000","last_peered":"2024-05-10T05:18:35.725312+0000","last_clean":"2024-05-10T05:18:35.725312+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:18:35.725312+0000","last_undegraded":"2024-05-10T05:18:35.725312+0000","last_fullsized":"2024-05-10T05:18:35.725312+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2085","reported_seq":2126,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:11.978282+0000","last_change":"2024-05-10T05:19:11.978482+0000","last_active":"2024-05-10T05:19:11.978282+0000","last_peered":"2024-05-10T05:19:11.978282+0000","last_clean":"2024-05-10T05:19:11.978282+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:19:11.978282+0000","last_undegraded":"2024-05-10T05:19:11.978282+0000","last_fullsized":"2024-05-10T05:19:11.978282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2085","last_scrub_stamp":"2024-05-10T05:19:11.978235+0000","last_deep_scrub":"28'2085","last_deep_scrub_stamp":"2024-05-10T05:19:11.978235+0000","last_clean_scrub_stamp":"2024-05-10T05:19:11.978235+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:50.491529+0000","scrub_duration":0.0025443800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4532","reported_seq":4574,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.037113+0000","last_change":"2024-05-10T05:18:41.037113+0000","last_active":"2024-05-10T05:18:41.037113+0000","last_peered":"2024-05-10T05:18:41.037113+0000","last_clean":"2024-05-10T05:18:41.037113+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:18:41.037113+0000","last_undegraded":"2024-05-10T05:18:41.037113+0000","last_fullsized":"2024-05-10T05:18:41.037113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4532","last_scrub_stamp":"2024-05-10T05:18:41.036968+0000","last_deep_scrub":"28'4532","last_deep_scrub_stamp":"2024-05-10T05:18:41.036968+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.036968+0000","objects_scrubbed":0,"log_size":4532,"log_dups_size":0,"ondisk_log_size":4532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:17.427232+0000","scrub_duration":0.0040866000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4533,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.548160+0000","last_change":"2024-05-10T05:18:44.548319+0000","last_active":"2024-05-10T05:18:44.548160+0000","last_peered":"2024-05-10T05:18:44.548160+0000","last_clean":"2024-05-10T05:18:44.548160+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:18:44.548160+0000","last_undegraded":"2024-05-10T05:18:44.548160+0000","last_fullsized":"2024-05-10T05:18:44.548160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-05-10T05:18:44.548136+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-05-10T05:18:44.548136+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.548136+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:11.519311+0000","scrub_duration":0.0075957919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7841,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.745711+0000","last_change":"2024-05-10T04:51:57.220061+0000","last_active":"2024-05-10T05:18:21.745711+0000","last_peered":"2024-05-10T05:18:21.745711+0000","last_clean":"2024-05-10T05:18:21.745711+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:18:21.745711+0000","last_undegraded":"2024-05-10T05:18:21.745711+0000","last_fullsized":"2024-05-10T05:18:21.745711+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1994","reported_seq":2035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.210587+0000","last_change":"2024-05-10T05:18:40.210587+0000","last_active":"2024-05-10T05:18:40.210587+0000","last_peered":"2024-05-10T05:18:40.210587+0000","last_clean":"2024-05-10T05:18:40.210587+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:40.210587+0000","last_undegraded":"2024-05-10T05:18:40.210587+0000","last_fullsized":"2024-05-10T05:18:40.210587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:18:40.210380+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:18:40.210380+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.210380+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:44.629153+0000","scrub_duration":0.002471778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6535","reported_seq":6577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:45.611659+0000","last_change":"2024-05-10T05:18:45.611799+0000","last_active":"2024-05-10T05:18:45.611659+0000","last_peered":"2024-05-10T05:18:45.611659+0000","last_clean":"2024-05-10T05:18:45.611659+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:18:45.611659+0000","last_undegraded":"2024-05-10T05:18:45.611659+0000","last_fullsized":"2024-05-10T05:18:45.611659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6535","last_scrub_stamp":"2024-05-10T05:18:45.611628+0000","last_deep_scrub":"28'6535","last_deep_scrub_stamp":"2024-05-10T05:18:45.611628+0000","last_clean_scrub_stamp":"2024-05-10T05:18:45.611628+0000","objects_scrubbed":1,"log_size":6535,"log_dups_size":0,"ondisk_log_size":6535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:28.869976+0000","scrub_duration":0.023044243999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6538,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7695,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:30.498027+0000","last_change":"2024-05-10T04:51:57.219472+0000","last_active":"2024-05-10T05:18:30.498027+0000","last_peered":"2024-05-10T05:18:30.498027+0000","last_clean":"2024-05-10T05:18:30.498027+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:18:30.498027+0000","last_undegraded":"2024-05-10T05:18:30.498027+0000","last_fullsized":"2024-05-10T05:18:30.498027+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4968","reported_seq":5010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.652387+0000","last_change":"2024-05-10T05:18:53.652387+0000","last_active":"2024-05-10T05:18:53.652387+0000","last_peered":"2024-05-10T05:18:53.652387+0000","last_clean":"2024-05-10T05:18:53.652387+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:18:53.652387+0000","last_undegraded":"2024-05-10T05:18:53.652387+0000","last_fullsized":"2024-05-10T05:18:53.652387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4968","last_scrub_stamp":"2024-05-10T05:18:53.652243+0000","last_deep_scrub":"28'4968","last_deep_scrub_stamp":"2024-05-10T05:18:53.652243+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.652243+0000","objects_scrubbed":1,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:57:57.948351+0000","scrub_duration":0.020192067000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4970,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2075","reported_seq":2116,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.267598+0000","last_change":"2024-05-10T05:18:33.267598+0000","last_active":"2024-05-10T05:18:33.267598+0000","last_peered":"2024-05-10T05:18:33.267598+0000","last_clean":"2024-05-10T05:18:33.267598+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:33.267598+0000","last_undegraded":"2024-05-10T05:18:33.267598+0000","last_fullsized":"2024-05-10T05:18:33.267598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2075","last_scrub_stamp":"2024-05-10T05:18:33.267453+0000","last_deep_scrub":"28'2075","last_deep_scrub_stamp":"2024-05-10T05:18:33.267453+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.267453+0000","objects_scrubbed":0,"log_size":2075,"log_dups_size":0,"ondisk_log_size":2075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:20.868771+0000","scrub_duration":0.017069349000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7178","reported_seq":7224,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.140873+0000","last_change":"2024-05-10T04:51:57.220942+0000","last_active":"2024-05-10T05:18:26.140873+0000","last_peered":"2024-05-10T05:18:26.140873+0000","last_clean":"2024-05-10T05:18:26.140873+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:18:26.140873+0000","last_undegraded":"2024-05-10T05:18:26.140873+0000","last_fullsized":"2024-05-10T05:18:26.140873+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":6276,"log_dups_size":0,"ondisk_log_size":6276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5018,"num_write_kb":931856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4519","reported_seq":4813,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.364492+0000","last_change":"2024-05-10T05:18:48.364602+0000","last_active":"2024-05-10T05:18:48.364492+0000","last_peered":"2024-05-10T05:18:48.364492+0000","last_clean":"2024-05-10T05:18:48.364492+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:48.364492+0000","last_undegraded":"2024-05-10T05:18:48.364492+0000","last_fullsized":"2024-05-10T05:18:48.364492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4519","last_scrub_stamp":"2024-05-10T05:18:48.364462+0000","last_deep_scrub":"28'4519","last_deep_scrub_stamp":"2024-05-10T05:18:48.364462+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.364462+0000","objects_scrubbed":3,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:15.335637+0000","scrub_duration":0.059862429000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5706142,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":1647,"num_write":5099,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1997","reported_seq":2037,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.008916+0000","last_change":"2024-05-10T05:18:42.009047+0000","last_active":"2024-05-10T05:18:42.008916+0000","last_peered":"2024-05-10T05:18:42.008916+0000","last_clean":"2024-05-10T05:18:42.008916+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:42.008916+0000","last_undegraded":"2024-05-10T05:18:42.008916+0000","last_fullsized":"2024-05-10T05:18:42.008916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1997","last_scrub_stamp":"2024-05-10T05:18:42.008888+0000","last_deep_scrub":"28'1997","last_deep_scrub_stamp":"2024-05-10T05:18:42.008888+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.008888+0000","objects_scrubbed":0,"log_size":1997,"log_dups_size":0,"ondisk_log_size":1997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:36.252444+0000","scrub_duration":0.016990521000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.977553+0000","last_change":"2024-05-10T05:18:47.977553+0000","last_active":"2024-05-10T05:18:47.977553+0000","last_peered":"2024-05-10T05:18:47.977553+0000","last_clean":"2024-05-10T05:18:47.977553+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:47.977553+0000","last_undegraded":"2024-05-10T05:18:47.977553+0000","last_fullsized":"2024-05-10T05:18:47.977553+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7757","last_scrub_stamp":"2024-05-10T05:18:47.977339+0000","last_deep_scrub":"28'7757","last_deep_scrub_stamp":"2024-05-10T05:18:47.977339+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.977339+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:43.761125+0000","scrub_duration":0.049427395999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2931","reported_seq":2972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.296272+0000","last_change":"2024-05-10T05:18:47.296396+0000","last_active":"2024-05-10T05:18:47.296272+0000","last_peered":"2024-05-10T05:18:47.296272+0000","last_clean":"2024-05-10T05:18:47.296272+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:47.296272+0000","last_undegraded":"2024-05-10T05:18:47.296272+0000","last_fullsized":"2024-05-10T05:18:47.296272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2931","last_scrub_stamp":"2024-05-10T05:18:47.296244+0000","last_deep_scrub":"28'2931","last_deep_scrub_stamp":"2024-05-10T05:18:47.296244+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.296244+0000","objects_scrubbed":2,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:46.247263+0000","scrub_duration":0.0070847059999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2041","reported_seq":2081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:50.301111+0000","last_change":"2024-05-10T05:18:50.301225+0000","last_active":"2024-05-10T05:18:50.301111+0000","last_peered":"2024-05-10T05:18:50.301111+0000","last_clean":"2024-05-10T05:18:50.301111+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:50.301111+0000","last_undegraded":"2024-05-10T05:18:50.301111+0000","last_fullsized":"2024-05-10T05:18:50.301111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2041","last_scrub_stamp":"2024-05-10T05:18:50.301080+0000","last_deep_scrub":"28'2041","last_deep_scrub_stamp":"2024-05-10T05:18:50.301080+0000","last_clean_scrub_stamp":"2024-05-10T05:18:50.301080+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:27.336905+0000","scrub_duration":0.011476890999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7582,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.863073+0000","last_change":"2024-05-10T05:18:57.863073+0000","last_active":"2024-05-10T05:18:57.863073+0000","last_peered":"2024-05-10T05:18:57.863073+0000","last_clean":"2024-05-10T05:18:57.863073+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:57.863073+0000","last_undegraded":"2024-05-10T05:18:57.863073+0000","last_fullsized":"2024-05-10T05:18:57.863073+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7497","last_scrub_stamp":"2024-05-10T05:18:57.862888+0000","last_deep_scrub":"28'7497","last_deep_scrub_stamp":"2024-05-10T05:18:57.862888+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.862888+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:45.044046+0000","scrub_duration":0.040099164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2708","reported_seq":2749,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:54.649392+0000","last_change":"2024-05-10T05:18:54.649532+0000","last_active":"2024-05-10T05:18:54.649392+0000","last_peered":"2024-05-10T05:18:54.649392+0000","last_clean":"2024-05-10T05:18:54.649392+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:18:54.649392+0000","last_undegraded":"2024-05-10T05:18:54.649392+0000","last_fullsized":"2024-05-10T05:18:54.649392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2708","last_scrub_stamp":"2024-05-10T05:18:54.649367+0000","last_deep_scrub":"28'2708","last_deep_scrub_stamp":"2024-05-10T05:18:54.649367+0000","last_clean_scrub_stamp":"2024-05-10T05:18:54.649367+0000","objects_scrubbed":1,"log_size":2708,"log_dups_size":0,"ondisk_log_size":2708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:05.916668+0000","scrub_duration":0.017949637000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2712,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:37.881619+0000","last_change":"2024-05-10T05:18:37.881727+0000","last_active":"2024-05-10T05:18:37.881619+0000","last_peered":"2024-05-10T05:18:37.881619+0000","last_clean":"2024-05-10T05:18:37.881619+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:37.881619+0000","last_undegraded":"2024-05-10T05:18:37.881619+0000","last_fullsized":"2024-05-10T05:18:37.881619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:18:37.881586+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:18:37.881586+0000","last_clean_scrub_stamp":"2024-05-10T05:18:37.881586+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:36:53.582798+0000","scrub_duration":0.002159762,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7386,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:02.362902+0000","last_change":"2024-05-10T05:19:02.362902+0000","last_active":"2024-05-10T05:19:02.362902+0000","last_peered":"2024-05-10T05:19:02.362902+0000","last_clean":"2024-05-10T05:19:02.362902+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:19:02.362902+0000","last_undegraded":"2024-05-10T05:19:02.362902+0000","last_fullsized":"2024-05-10T05:19:02.362902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7287","last_scrub_stamp":"2024-05-10T05:19:02.362713+0000","last_deep_scrub":"28'7287","last_deep_scrub_stamp":"2024-05-10T05:19:02.362713+0000","last_clean_scrub_stamp":"2024-05-10T05:19:02.362713+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:42.368270+0000","scrub_duration":0.045147409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3613","reported_seq":3654,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:39.263553+0000","last_change":"2024-05-10T05:18:39.263719+0000","last_active":"2024-05-10T05:18:39.263553+0000","last_peered":"2024-05-10T05:18:39.263553+0000","last_clean":"2024-05-10T05:18:39.263553+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:18:39.263553+0000","last_undegraded":"2024-05-10T05:18:39.263553+0000","last_fullsized":"2024-05-10T05:18:39.263553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3613","last_scrub_stamp":"2024-05-10T05:18:39.263524+0000","last_deep_scrub":"28'3613","last_deep_scrub_stamp":"2024-05-10T05:18:39.263524+0000","last_clean_scrub_stamp":"2024-05-10T05:18:39.263524+0000","objects_scrubbed":1,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:02.820674+0000","scrub_duration":0.020627962999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3630,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2116","reported_seq":2156,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.975579+0000","last_change":"2024-05-10T05:18:40.975713+0000","last_active":"2024-05-10T05:18:40.975579+0000","last_peered":"2024-05-10T05:18:40.975579+0000","last_clean":"2024-05-10T05:18:40.975579+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:40.975579+0000","last_undegraded":"2024-05-10T05:18:40.975579+0000","last_fullsized":"2024-05-10T05:18:40.975579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2116","last_scrub_stamp":"2024-05-10T05:18:40.975550+0000","last_deep_scrub":"28'2116","last_deep_scrub_stamp":"2024-05-10T05:18:40.975550+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.975550+0000","objects_scrubbed":0,"log_size":2116,"log_dups_size":0,"ondisk_log_size":2116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:39.926569+0000","scrub_duration":0.011021167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7439,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:10.891130+0000","last_change":"2024-05-10T05:19:10.891326+0000","last_active":"2024-05-10T05:19:10.891130+0000","last_peered":"2024-05-10T05:19:10.891130+0000","last_clean":"2024-05-10T05:19:10.891130+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:19:10.891130+0000","last_undegraded":"2024-05-10T05:19:10.891130+0000","last_fullsized":"2024-05-10T05:19:10.891130+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7396","last_scrub_stamp":"2024-05-10T05:19:10.891101+0000","last_deep_scrub":"28'7396","last_deep_scrub_stamp":"2024-05-10T05:19:10.891101+0000","last_clean_scrub_stamp":"2024-05-10T05:19:10.891101+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:10.388954+0000","scrub_duration":0.049185287000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6721","reported_seq":6762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.335234+0000","last_change":"2024-05-10T05:18:42.335383+0000","last_active":"2024-05-10T05:18:42.335234+0000","last_peered":"2024-05-10T05:18:42.335234+0000","last_clean":"2024-05-10T05:18:42.335234+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:18:42.335234+0000","last_undegraded":"2024-05-10T05:18:42.335234+0000","last_fullsized":"2024-05-10T05:18:42.335234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6721","last_scrub_stamp":"2024-05-10T05:18:42.335206+0000","last_deep_scrub":"28'6721","last_deep_scrub_stamp":"2024-05-10T05:18:42.335206+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.335206+0000","objects_scrubbed":3,"log_size":6721,"log_dups_size":0,"ondisk_log_size":6721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:29.735051+0000","scrub_duration":0.047016694999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6710,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2079","reported_seq":2112,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.494095+0000","last_change":"2024-05-10T05:18:57.494216+0000","last_active":"2024-05-10T05:18:57.494095+0000","last_peered":"2024-05-10T05:18:57.494095+0000","last_clean":"2024-05-10T05:18:57.494095+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:57.494095+0000","last_undegraded":"2024-05-10T05:18:57.494095+0000","last_fullsized":"2024-05-10T05:18:57.494095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2079","last_scrub_stamp":"2024-05-10T05:18:57.494070+0000","last_deep_scrub":"28'2079","last_deep_scrub_stamp":"2024-05-10T05:18:57.494070+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.494070+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:37:13.195282+0000","scrub_duration":0.031925811999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7882,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:08.840996+0000","last_change":"2024-05-10T05:19:08.841154+0000","last_active":"2024-05-10T05:19:08.840996+0000","last_peered":"2024-05-10T05:19:08.840996+0000","last_clean":"2024-05-10T05:19:08.840996+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:19:08.840996+0000","last_undegraded":"2024-05-10T05:19:08.840996+0000","last_fullsized":"2024-05-10T05:19:08.840996+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7752","last_scrub_stamp":"2024-05-10T05:19:08.840966+0000","last_deep_scrub":"28'7752","last_deep_scrub_stamp":"2024-05-10T05:19:08.840966+0000","last_clean_scrub_stamp":"2024-05-10T05:19:08.840966+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:38:25.754207+0000","scrub_duration":0.044890948999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6912","reported_seq":6953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.639748+0000","last_change":"2024-05-10T05:18:49.639748+0000","last_active":"2024-05-10T05:18:49.639748+0000","last_peered":"2024-05-10T05:18:49.639748+0000","last_clean":"2024-05-10T05:18:49.639748+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:18:49.639748+0000","last_undegraded":"2024-05-10T05:18:49.639748+0000","last_fullsized":"2024-05-10T05:18:49.639748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6912","last_scrub_stamp":"2024-05-10T05:18:49.639590+0000","last_deep_scrub":"28'6912","last_deep_scrub_stamp":"2024-05-10T05:18:49.639590+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.639590+0000","objects_scrubbed":1,"log_size":6912,"log_dups_size":0,"ondisk_log_size":6912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:49.364440+0000","scrub_duration":0.0094499939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6927,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2069","reported_seq":2109,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:00.307433+0000","last_change":"2024-05-10T05:19:00.307558+0000","last_active":"2024-05-10T05:19:00.307433+0000","last_peered":"2024-05-10T05:19:00.307433+0000","last_clean":"2024-05-10T05:19:00.307433+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:19:00.307433+0000","last_undegraded":"2024-05-10T05:19:00.307433+0000","last_fullsized":"2024-05-10T05:19:00.307433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2069","last_scrub_stamp":"2024-05-10T05:19:00.307404+0000","last_deep_scrub":"28'2069","last_deep_scrub_stamp":"2024-05-10T05:19:00.307404+0000","last_clean_scrub_stamp":"2024-05-10T05:19:00.307404+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:38.392230+0000","scrub_duration":0.0020700440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7415,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:23.251986+0000","last_change":"2024-05-10T04:51:57.222969+0000","last_active":"2024-05-10T05:18:23.251986+0000","last_peered":"2024-05-10T05:18:23.251986+0000","last_clean":"2024-05-10T05:18:23.251986+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:18:23.251986+0000","last_undegraded":"2024-05-10T05:18:23.251986+0000","last_fullsized":"2024-05-10T05:18:23.251986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5972","reported_seq":6013,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.480749+0000","last_change":"2024-05-10T05:18:41.480749+0000","last_active":"2024-05-10T05:18:41.480749+0000","last_peered":"2024-05-10T05:18:41.480749+0000","last_clean":"2024-05-10T05:18:41.480749+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:18:41.480749+0000","last_undegraded":"2024-05-10T05:18:41.480749+0000","last_fullsized":"2024-05-10T05:18:41.480749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5972","last_scrub_stamp":"2024-05-10T05:18:41.480563+0000","last_deep_scrub":"28'5972","last_deep_scrub_stamp":"2024-05-10T05:18:41.480563+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.480563+0000","objects_scrubbed":2,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:54:23.660604+0000","scrub_duration":0.035130757999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2043","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:58.534619+0000","last_change":"2024-05-10T05:18:58.534743+0000","last_active":"2024-05-10T05:18:58.534619+0000","last_peered":"2024-05-10T05:18:58.534619+0000","last_clean":"2024-05-10T05:18:58.534619+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:58.534619+0000","last_undegraded":"2024-05-10T05:18:58.534619+0000","last_fullsized":"2024-05-10T05:18:58.534619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2043","last_scrub_stamp":"2024-05-10T05:18:58.534593+0000","last_deep_scrub":"28'2043","last_deep_scrub_stamp":"2024-05-10T05:18:58.534593+0000","last_clean_scrub_stamp":"2024-05-10T05:18:58.534593+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:35.724201+0000","scrub_duration":0.0048393849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7895","reported_seq":8001,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:30.498063+0000","last_change":"2024-05-10T04:52:40.389082+0000","last_active":"2024-05-10T05:18:30.498063+0000","last_peered":"2024-05-10T05:18:30.498063+0000","last_clean":"2024-05-10T05:18:30.498063+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:18:30.498063+0000","last_undegraded":"2024-05-10T05:18:30.498063+0000","last_fullsized":"2024-05-10T05:18:30.498063+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7189,"log_dups_size":0,"ondisk_log_size":7189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5700,"num_write_kb":1007695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7942","reported_seq":7983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.319114+0000","last_change":"2024-05-10T05:18:41.319114+0000","last_active":"2024-05-10T05:18:41.319114+0000","last_peered":"2024-05-10T05:18:41.319114+0000","last_clean":"2024-05-10T05:18:41.319114+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:18:41.319114+0000","last_undegraded":"2024-05-10T05:18:41.319114+0000","last_fullsized":"2024-05-10T05:18:41.319114+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7942","last_scrub_stamp":"2024-05-10T05:18:41.318956+0000","last_deep_scrub":"28'7942","last_deep_scrub_stamp":"2024-05-10T05:18:41.318956+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.318956+0000","objects_scrubbed":2,"log_size":7342,"log_dups_size":0,"ondisk_log_size":7342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:03.935767+0000","scrub_duration":0.024728548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7935,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2034","reported_seq":2063,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:34.854243+0000","last_change":"2024-05-10T04:51:52.731416+0000","last_active":"2024-05-10T05:18:34.854243+0000","last_peered":"2024-05-10T05:18:34.854243+0000","last_clean":"2024-05-10T05:18:34.854243+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:18:34.854243+0000","last_undegraded":"2024-05-10T05:18:34.854243+0000","last_fullsized":"2024-05-10T05:18:34.854243+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7868,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:21.742534+0000","last_change":"2024-05-10T04:51:57.216353+0000","last_active":"2024-05-10T05:18:21.742534+0000","last_peered":"2024-05-10T05:18:21.742534+0000","last_clean":"2024-05-10T05:18:21.742534+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:18:21.742534+0000","last_undegraded":"2024-05-10T05:18:21.742534+0000","last_fullsized":"2024-05-10T05:18:21.742534+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:56.127962+0000","last_clean_scrub_stamp":"2024-05-10T04:51:56.127962+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5558","reported_seq":5599,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.500280+0000","last_change":"2024-05-10T05:18:44.500280+0000","last_active":"2024-05-10T05:18:44.500280+0000","last_peered":"2024-05-10T05:18:44.500280+0000","last_clean":"2024-05-10T05:18:44.500280+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:44.500280+0000","last_undegraded":"2024-05-10T05:18:44.500280+0000","last_fullsized":"2024-05-10T05:18:44.500280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5558","last_scrub_stamp":"2024-05-10T05:18:44.500139+0000","last_deep_scrub":"28'5558","last_deep_scrub_stamp":"2024-05-10T05:18:44.500139+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.500139+0000","objects_scrubbed":2,"log_size":5558,"log_dups_size":0,"ondisk_log_size":5558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:20.890403+0000","scrub_duration":0.025591222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1961","reported_seq":2001,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.626709+0000","last_change":"2024-05-10T05:18:36.626709+0000","last_active":"2024-05-10T05:18:36.626709+0000","last_peered":"2024-05-10T05:18:36.626709+0000","last_clean":"2024-05-10T05:18:36.626709+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:36.626709+0000","last_undegraded":"2024-05-10T05:18:36.626709+0000","last_fullsized":"2024-05-10T05:18:36.626709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1961","last_scrub_stamp":"2024-05-10T05:18:36.626530+0000","last_deep_scrub":"28'1961","last_deep_scrub_stamp":"2024-05-10T05:18:36.626530+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.626530+0000","objects_scrubbed":0,"log_size":1961,"log_dups_size":0,"ondisk_log_size":1961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:06:49.597931+0000","scrub_duration":0.027198238999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1986","reported_seq":2027,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:06.235362+0000","last_change":"2024-05-10T05:19:06.235483+0000","last_active":"2024-05-10T05:19:06.235362+0000","last_peered":"2024-05-10T05:19:06.235362+0000","last_clean":"2024-05-10T05:19:06.235362+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:19:06.235362+0000","last_undegraded":"2024-05-10T05:19:06.235362+0000","last_fullsized":"2024-05-10T05:19:06.235362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1986","last_scrub_stamp":"2024-05-10T05:19:06.235334+0000","last_deep_scrub":"28'1986","last_deep_scrub_stamp":"2024-05-10T05:19:06.235334+0000","last_clean_scrub_stamp":"2024-05-10T05:19:06.235334+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:34.062837+0000","scrub_duration":0.0024130810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2091","reported_seq":2132,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.494048+0000","last_change":"2024-05-10T05:18:55.494048+0000","last_active":"2024-05-10T05:18:55.494048+0000","last_peered":"2024-05-10T05:18:55.494048+0000","last_clean":"2024-05-10T05:18:55.494048+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:55.494048+0000","last_undegraded":"2024-05-10T05:18:55.494048+0000","last_fullsized":"2024-05-10T05:18:55.494048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2091","last_scrub_stamp":"2024-05-10T05:18:55.493882+0000","last_deep_scrub":"28'2091","last_deep_scrub_stamp":"2024-05-10T05:18:55.493882+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.493882+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:55.899046+0000","scrub_duration":0.0058309420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1990","reported_seq":2031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.962510+0000","last_change":"2024-05-10T05:19:01.962510+0000","last_active":"2024-05-10T05:19:01.962510+0000","last_peered":"2024-05-10T05:19:01.962510+0000","last_clean":"2024-05-10T05:19:01.962510+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:19:01.962510+0000","last_undegraded":"2024-05-10T05:19:01.962510+0000","last_fullsized":"2024-05-10T05:19:01.962510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1990","last_scrub_stamp":"2024-05-10T05:19:01.962351+0000","last_deep_scrub":"28'1990","last_deep_scrub_stamp":"2024-05-10T05:19:01.962351+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.962351+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:11.723694+0000","scrub_duration":0.0023731070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2093","reported_seq":2134,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:32.141933+0000","last_change":"2024-05-10T05:18:32.141933+0000","last_active":"2024-05-10T05:18:32.141933+0000","last_peered":"2024-05-10T05:18:32.141933+0000","last_clean":"2024-05-10T05:18:32.141933+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:32.141933+0000","last_undegraded":"2024-05-10T05:18:32.141933+0000","last_fullsized":"2024-05-10T05:18:32.141933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2093","last_scrub_stamp":"2024-05-10T05:18:32.141812+0000","last_deep_scrub":"28'2093","last_deep_scrub_stamp":"2024-05-10T05:18:32.141812+0000","last_clean_scrub_stamp":"2024-05-10T05:18:32.141812+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:15.037300+0000","scrub_duration":0.0043493560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2063","reported_seq":2103,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.002743+0000","last_change":"2024-05-10T05:18:55.002865+0000","last_active":"2024-05-10T05:18:55.002743+0000","last_peered":"2024-05-10T05:18:55.002743+0000","last_clean":"2024-05-10T05:18:55.002743+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:55.002743+0000","last_undegraded":"2024-05-10T05:18:55.002743+0000","last_fullsized":"2024-05-10T05:18:55.002743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2063","last_scrub_stamp":"2024-05-10T05:18:55.002712+0000","last_deep_scrub":"28'2063","last_deep_scrub_stamp":"2024-05-10T05:18:55.002712+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.002712+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:32.038537+0000","scrub_duration":0.002817253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1959","reported_seq":1999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:00.291226+0000","last_change":"2024-05-10T05:19:00.291352+0000","last_active":"2024-05-10T05:19:00.291226+0000","last_peered":"2024-05-10T05:19:00.291226+0000","last_clean":"2024-05-10T05:19:00.291226+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:19:00.291226+0000","last_undegraded":"2024-05-10T05:19:00.291226+0000","last_fullsized":"2024-05-10T05:19:00.291226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1959","last_scrub_stamp":"2024-05-10T05:19:00.291197+0000","last_deep_scrub":"28'1959","last_deep_scrub_stamp":"2024-05-10T05:19:00.291197+0000","last_clean_scrub_stamp":"2024-05-10T05:19:00.291197+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:49.581235+0000","scrub_duration":0.027644953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2071","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:26.002000+0000","last_change":"2024-05-10T04:51:52.761093+0000","last_active":"2024-05-10T05:18:26.002000+0000","last_peered":"2024-05-10T05:18:26.002000+0000","last_clean":"2024-05-10T05:18:26.002000+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:18:26.002000+0000","last_undegraded":"2024-05-10T05:18:26.002000+0000","last_fullsized":"2024-05-10T05:18:26.002000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-10T04:51:52.105100+0000","last_clean_scrub_stamp":"2024-05-10T04:51:52.105100+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2052","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:37.915644+0000","last_change":"2024-05-10T05:18:37.915765+0000","last_active":"2024-05-10T05:18:37.915644+0000","last_peered":"2024-05-10T05:18:37.915644+0000","last_clean":"2024-05-10T05:18:37.915644+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:37.915644+0000","last_undegraded":"2024-05-10T05:18:37.915644+0000","last_fullsized":"2024-05-10T05:18:37.915644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2052","last_scrub_stamp":"2024-05-10T05:18:37.915613+0000","last_deep_scrub":"28'2052","last_deep_scrub_stamp":"2024-05-10T05:18:37.915613+0000","last_clean_scrub_stamp":"2024-05-10T05:18:37.915613+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:37.640463+0000","scrub_duration":0.017714500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2006","reported_seq":2046,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.029717+0000","last_change":"2024-05-10T05:18:40.029835+0000","last_active":"2024-05-10T05:18:40.029717+0000","last_peered":"2024-05-10T05:18:40.029717+0000","last_clean":"2024-05-10T05:18:40.029717+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:40.029717+0000","last_undegraded":"2024-05-10T05:18:40.029717+0000","last_fullsized":"2024-05-10T05:18:40.029717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2006","last_scrub_stamp":"2024-05-10T05:18:40.029690+0000","last_deep_scrub":"28'2006","last_deep_scrub_stamp":"2024-05-10T05:18:40.029690+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.029690+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:54.438553+0000","scrub_duration":0.0028650809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2043","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.963920+0000","last_change":"2024-05-10T05:18:59.964032+0000","last_active":"2024-05-10T05:18:59.963920+0000","last_peered":"2024-05-10T05:18:59.963920+0000","last_clean":"2024-05-10T05:18:59.963920+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:59.963920+0000","last_undegraded":"2024-05-10T05:18:59.963920+0000","last_fullsized":"2024-05-10T05:18:59.963920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2043","last_scrub_stamp":"2024-05-10T05:18:59.963894+0000","last_deep_scrub":"28'2043","last_deep_scrub_stamp":"2024-05-10T05:18:59.963894+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.963894+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:27.791396+0000","scrub_duration":0.0037174199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.919956+0000","last_change":"2024-05-10T05:19:09.920064+0000","last_active":"2024-05-10T05:19:09.919956+0000","last_peered":"2024-05-10T05:19:09.919956+0000","last_clean":"2024-05-10T05:19:09.919956+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:19:09.919956+0000","last_undegraded":"2024-05-10T05:19:09.919956+0000","last_fullsized":"2024-05-10T05:19:09.919956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:19:09.919928+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:19:09.919928+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.919928+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:27.422447+0000","scrub_duration":0.0017856079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2074","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:11.236578+0000","last_change":"2024-05-10T05:19:11.236711+0000","last_active":"2024-05-10T05:19:11.236578+0000","last_peered":"2024-05-10T05:19:11.236578+0000","last_clean":"2024-05-10T05:19:11.236578+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:19:11.236578+0000","last_undegraded":"2024-05-10T05:19:11.236578+0000","last_fullsized":"2024-05-10T05:19:11.236578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2074","last_scrub_stamp":"2024-05-10T05:19:11.236548+0000","last_deep_scrub":"28'2074","last_deep_scrub_stamp":"2024-05-10T05:19:11.236548+0000","last_clean_scrub_stamp":"2024-05-10T05:19:11.236548+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:59:19.462632+0000","scrub_duration":0.0091204319999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2051","reported_seq":2091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:54.284504+0000","last_change":"2024-05-10T05:18:54.284504+0000","last_active":"2024-05-10T05:18:54.284504+0000","last_peered":"2024-05-10T05:18:54.284504+0000","last_clean":"2024-05-10T05:18:54.284504+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:54.284504+0000","last_undegraded":"2024-05-10T05:18:54.284504+0000","last_fullsized":"2024-05-10T05:18:54.284504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2051","last_scrub_stamp":"2024-05-10T05:18:54.284233+0000","last_deep_scrub":"28'2051","last_deep_scrub_stamp":"2024-05-10T05:18:54.284233+0000","last_clean_scrub_stamp":"2024-05-10T05:18:54.284233+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.289789+0000","scrub_duration":0.0020759820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173251,"num_write_kb":29661400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225990,"ondisk_log_size":225990,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130764,"ondisk_log_size":130764,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235183565,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2414,"num_read_kb":15319,"num_write":184839,"num_write_kb":1350687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6380,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":470433792,"data_stored":470367130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172746,"ondisk_log_size":172746,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542476,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":931700,"kb_used_data":70508,"kb_used_omap":1,"kb_used_meta":861182,"kb_avail":93440140,"statfs":{"total":96636764160,"available":95682703360,"internally_reserved":0,"allocated":72200192,"data_stored":72015801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":881850827},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.988,"15min":1.819},"min":{"1min":0.32900000000000001,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":14.874000000000001,"5min":28.266999999999999,"15min":34.326999999999998},"last":1.004},{"interface":"front","average":{"1min":1.75,"5min":2.4319999999999999,"15min":1.851},"min":{"1min":0.35399999999999998,"5min":0.317,"15min":0.31},"max":{"1min":15.058,"5min":28.968,"15min":28.968},"last":0.91500000000000004}]},{"osd":1,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":3.056,"5min":2.395,"15min":1.976},"min":{"1min":0.38200000000000001,"5min":0.33000000000000002,"15min":0.32900000000000001},"max":{"1min":14.84,"5min":34.805999999999997,"15min":34.805999999999997},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.8480000000000001,"5min":2.3769999999999998,"15min":2.3069999999999999},"min":{"1min":0.48399999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":15.102,"5min":29.222000000000001,"15min":105.375},"last":0.98599999999999999}]},{"osd":2,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":2.4260000000000002,"15min":2.077},"min":{"1min":0.45800000000000002,"5min":0.40899999999999997,"15min":0.35899999999999999},"max":{"1min":4.3029999999999999,"5min":39.965000000000003,"15min":52.515999999999998},"last":0.89700000000000002},{"interface":"front","average":{"1min":2.1190000000000002,"5min":2.2229999999999999,"15min":1.804},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":14.782999999999999,"5min":34.756999999999998,"15min":35.595999999999997},"last":0.755}]},{"osd":3,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":1.6930000000000001,"5min":2.6040000000000001,"15min":2.597},"min":{"1min":0.46300000000000002,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":8.5489999999999995,"5min":38.317999999999998,"15min":64.994},"last":0.72899999999999998},{"interface":"front","average":{"1min":3.1850000000000001,"5min":2.4590000000000001,"15min":1.978},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":14.907999999999999,"5min":34.841999999999999,"15min":43.789000000000001},"last":1.0649999999999999}]},{"osd":4,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.2719999999999998,"5min":3.1139999999999999,"15min":2.7109999999999999},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":15.217000000000001,"5min":40.978999999999999,"15min":52.252000000000002},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.47,"5min":2.746,"15min":3.157},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.36499999999999999},"max":{"1min":8.6969999999999992,"5min":34.289999999999999,"15min":134.07499999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.847,"5min":3.0640000000000001,"15min":2.4769999999999999},"min":{"1min":0.47499999999999998,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":14.943,"5min":34.875,"15min":34.875},"last":0.94899999999999995},{"interface":"front","average":{"1min":2.5569999999999999,"5min":2.8639999999999999,"15min":2.3420000000000001},"min":{"1min":0.42399999999999999,"5min":0.39900000000000002,"15min":0.38300000000000001},"max":{"1min":15.177,"5min":29.867000000000001,"15min":37.582999999999998},"last":1.1279999999999999}]},{"osd":6,"last update":"Fri May 10 05:18:23 2024","interfaces":[{"interface":"back","average":{"1min":2.9660000000000002,"5min":4.6219999999999999,"15min":3.2559999999999998},"min":{"1min":0.57499999999999996,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":15.138999999999999,"5min":65.388999999999996,"15min":65.388999999999996},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.6830000000000001,"5min":4.5019999999999998,"15min":3.3980000000000001},"min":{"1min":0.48899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":7.4029999999999996,"5min":84.454999999999998,"15min":84.454999999999998},"last":0.85999999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542475,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":978144,"kb_used_data":90712,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93393696,"statfs":{"total":96636764160,"available":95635144704,"internally_reserved":0,"allocated":92889088,"data_stored":92698114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":2.5579999999999998,"15min":3.0569999999999999},"min":{"1min":0.47699999999999998,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":14.510999999999999,"5min":17.158000000000001,"15min":215.636},"last":0.72899999999999998},{"interface":"front","average":{"1min":2.5070000000000001,"5min":2.6080000000000001,"15min":2.8149999999999999},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":15.693,"5min":26.574000000000002,"15min":216.899},"last":0.996}]},{"osd":1,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":1.998,"5min":2.5150000000000001,"15min":3.6709999999999998},"min":{"1min":0.39000000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":9.8569999999999993,"5min":20.341999999999999,"15min":283.584},"last":0.97599999999999998},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5590000000000002,"15min":3.3559999999999999},"min":{"1min":0.57799999999999996,"5min":0.39500000000000002,"15min":0.33500000000000002},"max":{"1min":14.353999999999999,"5min":21.161999999999999,"15min":226.642},"last":0.80100000000000005}]},{"osd":2,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.3220000000000001,"15min":2.6339999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38200000000000001},"max":{"1min":15.625999999999999,"5min":15.625999999999999,"15min":204.20099999999999},"last":0.77800000000000002},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.9430000000000001,"15min":2.262},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":14.115,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4470000000000001,"5min":2.3639999999999999,"15min":2.9390000000000001},"min":{"1min":0.54300000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":14.478999999999999,"5min":21.224,"15min":211.06999999999999},"last":0.95099999999999996},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.181,"15min":2.8660000000000001},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":15.923,"5min":15.923,"15min":216.947},"last":0.92700000000000005}]},{"osd":4,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.3340000000000001,"5min":2.9980000000000002,"15min":2.653},"min":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":14.304,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":3.4409999999999998,"5min":3.2200000000000002,"15min":2.4710000000000001},"min":{"1min":0.497,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":16.417000000000002,"5min":37.195,"15min":37.195},"last":0.64400000000000002}]},{"osd":5,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0840000000000001,"15min":2.343},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":11.1,"5min":46.448999999999998,"15min":46.448999999999998},"last":1.0229999999999999},{"interface":"front","average":{"1min":2.6160000000000001,"5min":2.9079999999999999,"15min":2.589},"min":{"1min":0.58099999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":14.760999999999999,"5min":18.962,"15min":35.591999999999999},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":2.9359999999999999,"15min":2.3210000000000002},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":15.662000000000001,"5min":58.857999999999997,"15min":58.857999999999997},"last":0.87},{"interface":"front","average":{"1min":2.9319999999999999,"5min":4.0650000000000004,"15min":2.7160000000000002},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":11.148,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.91200000000000003}]}]},{"osd":0,"up_from":14,"seq":60129542476,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752828,"kb_used_data":45940,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93619012,"statfs":{"total":96636764160,"available":95865868288,"internally_reserved":0,"allocated":47042560,"data_stored":46850033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.379,"15min":1.4390000000000001},"min":{"1min":0.32400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":8.7910000000000004,"5min":39.710000000000001,"15min":40.371000000000002},"last":0.379},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.8200000000000001,"15min":1.9279999999999999},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.7290000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":1.1719999999999999,"15min":1.181},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":1.863,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.282,"15min":1.4099999999999999},"min":{"1min":0.39000000000000001,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":1.7050000000000001,"5min":17.998000000000001,"15min":37.643999999999998},"last":0.55400000000000005}]},{"osd":3,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.6080000000000001,"15min":2.0880000000000001},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":4.7089999999999996,"5min":51.646999999999998,"15min":108.407},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.752,"5min":1.367,"15min":1.4810000000000001},"min":{"1min":0.48399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.173,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.59799999999999998}]},{"osd":4,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":2.331,"15min":2.347},"min":{"1min":0.52400000000000002,"5min":0.438,"15min":0.38400000000000001},"max":{"1min":4.6619999999999999,"5min":52.307000000000002,"15min":52.307000000000002},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.1419999999999999,"5min":2.0539999999999998,"15min":2.0350000000000001},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":3.6549999999999998,"5min":17.518999999999998,"15min":32.276000000000003},"last":0.93000000000000005}]},{"osd":5,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.8740000000000001,"15min":1.889},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1989999999999998,"5min":18.966000000000001,"15min":37.572000000000003},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.3779999999999999,"5min":2.2280000000000002,"15min":2.3100000000000001},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.44600000000000001},"max":{"1min":7.6829999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":0.86399999999999999}]},{"osd":6,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.919,"15min":2.1720000000000002},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":3.052,"5min":13.968,"15min":41.270000000000003},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.0600000000000001,"5min":2.1259999999999999,"15min":2.286},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":3.0630000000000002,"5min":18.013000000000002,"15min":41.043999999999997},"last":1.012}]},{"osd":7,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":2.1930000000000001,"15min":2.2719999999999998},"min":{"1min":0.68000000000000005,"5min":0.50800000000000001,"15min":0.45900000000000002},"max":{"1min":1.8200000000000001,"5min":22.251000000000001,"15min":37.850000000000001},"last":1.111},{"interface":"front","average":{"1min":1.615,"5min":2.2490000000000001,"15min":2.4220000000000002},"min":{"1min":0.70699999999999996,"5min":0.503,"15min":0.503},"max":{"1min":9.9499999999999993,"5min":39.850000000000001,"15min":46.118000000000002},"last":0.82499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575182,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":539116,"kb_used_data":20772,"kb_used_omap":1,"kb_used_meta":518334,"kb_avail":93832724,"statfs":{"total":96636764160,"available":96084709376,"internally_reserved":0,"allocated":21270528,"data_stored":21093203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":530774470},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.1439999999999999,"15min":1.22},"min":{"1min":0.29999999999999999,"5min":0.246,"15min":0.246},"max":{"1min":8.1189999999999998,"5min":11.212,"15min":24.271000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.897,"5min":1.244,"15min":1.4279999999999999},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":16.366,"5min":16.366,"15min":30.734999999999999},"last":0.73599999999999999}]},{"osd":1,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.008,"15min":1.444},"min":{"1min":0.40699999999999997,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":4.3079999999999998,"5min":9.9079999999999995,"15min":105.28},"last":0.81999999999999995},{"interface":"front","average":{"1min":2.23,"5min":2.23,"15min":2.577},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":16.309000000000001,"5min":73.775999999999996,"15min":105.255},"last":0.90300000000000002}]},{"osd":3,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.0249999999999999,"5min":1.343,"15min":1.629},"min":{"1min":0.34699999999999998,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":13.557,"5min":13.557,"15min":60.387999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.758,"5min":1.347,"15min":1.4450000000000001},"min":{"1min":0.45400000000000001,"5min":0.315,"15min":0.315},"max":{"1min":14.116,"5min":14.116,"15min":22.358000000000001},"last":1.093}]},{"osd":4,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":4.2350000000000003,"15min":2.7890000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":12.548999999999999,"5min":249.88,"15min":249.88},"last":1.514},{"interface":"front","average":{"1min":3.5179999999999998,"5min":4.6390000000000002,"15min":3.1779999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":20.428999999999998,"5min":249.82300000000001,"15min":249.82300000000001},"last":1.349}]},{"osd":5,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":4.0250000000000004,"15min":2.7170000000000001},"min":{"1min":0.442,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":15.917999999999999,"5min":256.38600000000002,"15min":256.38600000000002},"last":1.1950000000000001},{"interface":"front","average":{"1min":2.3679999999999999,"5min":3.9020000000000001,"15min":2.3769999999999998},"min":{"1min":0.59099999999999997,"5min":0.42899999999999999,"15min":0.42799999999999999},"max":{"1min":14.08,"5min":255.04499999999999,"15min":255.04499999999999},"last":1.4550000000000001}]},{"osd":6,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":3.1190000000000002,"5min":4.9669999999999996,"15min":3.0369999999999999},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":20.393999999999998,"5min":255.06999999999999,"15min":255.06999999999999},"last":1.486},{"interface":"front","average":{"1min":3.327,"5min":4.9809999999999999,"15min":3.1400000000000001},"min":{"1min":0.505,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":18.178000000000001,"5min":253.095,"15min":253.095},"last":1.302}]},{"osd":7,"last update":"Fri May 10 05:18:27 2024","interfaces":[{"interface":"back","average":{"1min":4.2649999999999997,"5min":4.1109999999999998,"15min":3.008},"min":{"1min":0.65600000000000003,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":24.565000000000001,"5min":249.90799999999999,"15min":249.90799999999999},"last":1.4019999999999999},{"interface":"front","average":{"1min":2.1459999999999999,"5min":4.4390000000000001,"15min":3.2029999999999998},"min":{"1min":0.57099999999999995,"5min":0.55600000000000005,"15min":0.44400000000000001},"max":{"1min":8.5760000000000005,"5min":256.97699999999998,"15min":256.97699999999998},"last":1.4239999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542475,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":966332,"kb_used_data":50932,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93405508,"statfs":{"total":96636764160,"available":95647240192,"internally_reserved":0,"allocated":52154368,"data_stored":51965329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":2.391,"5min":2.4849999999999999,"15min":2.5089999999999999},"min":{"1min":0.27800000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":16.178000000000001,"5min":50.100000000000001,"15min":192.745},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.867,"15min":2.2320000000000002},"min":{"1min":0.39400000000000002,"5min":0.377,"15min":0.30499999999999999},"max":{"1min":10.452999999999999,"5min":50.145000000000003,"15min":192.62799999999999},"last":0.72899999999999998}]},{"osd":2,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":1.411,"15min":1.665},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":5.375,"5min":14.263999999999999,"15min":71.727999999999994},"last":0.68000000000000005},{"interface":"front","average":{"1min":2.1760000000000002,"5min":1.9399999999999999,"15min":2.0129999999999999},"min":{"1min":0.47499999999999998,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":22.484999999999999,"5min":32.435000000000002,"15min":95.793000000000006},"last":0.64900000000000002}]},{"osd":3,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":2.2210000000000001,"5min":2.2909999999999999,"15min":2.0950000000000002},"min":{"1min":0.437,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":16.245999999999999,"5min":21.994,"15min":125.41200000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.3009999999999999,"5min":2.1019999999999999,"15min":1.829},"min":{"1min":0.35099999999999998,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":9.8640000000000008,"5min":26.085000000000001,"15min":111.134},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":11.686,"5min":4.8959999999999999,"15min":3.1880000000000002},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":180.386,"5min":180.386,"15min":180.386},"last":0.83799999999999997},{"interface":"front","average":{"1min":11.231,"5min":5.3250000000000002,"15min":3.7040000000000002},"min":{"1min":0.46600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":183.21299999999999,"5min":183.21299999999999,"15min":183.21299999999999},"last":1.143}]},{"osd":5,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":10.397,"5min":3.988,"15min":2.6280000000000001},"min":{"1min":0.45700000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":162.23099999999999,"5min":162.23099999999999,"15min":162.23099999999999},"last":1.034},{"interface":"front","average":{"1min":10.180999999999999,"5min":4.5730000000000004,"15min":2.7429999999999999},"min":{"1min":0.46100000000000002,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":167.78100000000001,"5min":167.78100000000001,"15min":167.78100000000001},"last":1.0069999999999999}]},{"osd":6,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":9.8179999999999996,"5min":4.5359999999999996,"15min":4.2930000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":160.99600000000001,"5min":160.99600000000001,"15min":289.625},"last":1.0629999999999999},{"interface":"front","average":{"1min":10.183,"5min":4.4379999999999997,"15min":4.6799999999999997},"min":{"1min":0.54300000000000004,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":163.37200000000001,"5min":163.37200000000001,"15min":289.608},"last":1.1899999999999999}]},{"osd":7,"last update":"Fri May 10 05:18:35 2024","interfaces":[{"interface":"back","average":{"1min":10.803000000000001,"5min":3.7320000000000002,"15min":2.5369999999999999},"min":{"1min":0.51600000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":168.459,"5min":168.459,"15min":168.459},"last":1.107},{"interface":"front","average":{"1min":10.798999999999999,"5min":4.4740000000000002,"15min":2.7509999999999999},"min":{"1min":0.58199999999999996,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":166.607,"5min":166.607,"15min":166.607},"last":1.161}]}]},{"osd":3,"up_from":14,"seq":60129542476,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077940,"kb_used_data":86316,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293900,"statfs":{"total":96636764160,"available":95532953600,"internally_reserved":0,"allocated":88387584,"data_stored":88202739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.0030000000000001,"5min":1.528,"15min":1.488},"min":{"1min":0.315,"5min":0.245,"15min":0.24299999999999999},"max":{"1min":22.021000000000001,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.66900000000000004},{"interface":"front","average":{"1min":2.2189999999999999,"5min":1.5009999999999999,"15min":1.8740000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":23.219999999999999,"5min":23.219999999999999,"15min":119.66200000000001},"last":0.46500000000000002}]},{"osd":1,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.948,"5min":1.7629999999999999,"15min":1.4219999999999999},"min":{"1min":0.29099999999999998,"5min":0.28399999999999997,"15min":0.27500000000000002},"max":{"1min":10.342000000000001,"5min":25.995000000000001,"15min":26.573},"last":0.442},{"interface":"front","average":{"1min":2.2549999999999999,"5min":1.714,"15min":1.7210000000000001},"min":{"1min":0.33900000000000002,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":22.068999999999999,"5min":32.93,"15min":32.93},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.6499999999999999,"15min":1.371},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":9.9819999999999993,"5min":26.187999999999999,"15min":26.187999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":2.1230000000000002,"5min":1.3939999999999999,"15min":1.365},"min":{"1min":0.41599999999999998,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":22.123000000000001,"5min":22.123000000000001,"15min":29.568999999999999},"last":0.56899999999999995}]},{"osd":4,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.8849999999999998,"5min":4.2030000000000003,"15min":4.1020000000000003},"min":{"1min":0.45500000000000002,"5min":0.39500000000000002,"15min":0.36399999999999999},"max":{"1min":23.181999999999999,"5min":101.81399999999999,"15min":157.47},"last":0.83299999999999996},{"interface":"front","average":{"1min":2.7120000000000002,"5min":3.9689999999999999,"15min":3.6339999999999999},"min":{"1min":0.46600000000000003,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":25.175999999999998,"5min":102.501,"15min":189.161},"last":0.94599999999999995}]},{"osd":5,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":2.2109999999999999,"15min":2.488},"min":{"1min":0.54800000000000004,"5min":0.42799999999999999,"15min":0.40799999999999997},"max":{"1min":3.9550000000000001,"5min":22.468,"15min":150.14500000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":2.6640000000000001,"5min":2.851,"15min":3.2759999999999998},"min":{"1min":0.52800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":23.141999999999999,"5min":50.697000000000003,"15min":165.47},"last":0.89000000000000001}]},{"osd":6,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.1520000000000001,"5min":3.1110000000000002,"15min":3.0449999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":10.287000000000001,"5min":43.024999999999999,"15min":179.703},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.1619999999999999,"5min":2.0640000000000001,"15min":2.6509999999999998},"min":{"1min":0.58199999999999996,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":4.0309999999999997,"5min":17.460000000000001,"15min":135.15899999999999},"last":0.91500000000000004}]},{"osd":7,"last update":"Fri May 10 05:18:29 2024","interfaces":[{"interface":"back","average":{"1min":2.5329999999999999,"5min":2.0830000000000002,"15min":3.1600000000000001},"min":{"1min":0.57499999999999996,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":23.079000000000001,"5min":23.079000000000001,"15min":148.93899999999999},"last":0.97999999999999998},{"interface":"front","average":{"1min":2.4319999999999999,"5min":3.113,"15min":3.2650000000000001},"min":{"1min":0.62,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":12.063000000000001,"5min":59.588999999999999,"15min":215.81299999999999},"last":0.85599999999999998}]}]},{"osd":4,"up_from":14,"seq":60129542474,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":928504,"kb_used_data":49456,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93443336,"statfs":{"total":96636764160,"available":95685976064,"internally_reserved":0,"allocated":50642944,"data_stored":50453457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2869999999999999,"5min":2.3149999999999999,"15min":5.0179999999999998},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":51.966000000000001,"5min":51.966000000000001,"15min":440.25299999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.2390000000000001,"5min":2.3929999999999998,"15min":2.6850000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":6.5229999999999997,"5min":33.819000000000003,"15min":94.004999999999995},"last":0.91800000000000004}]},{"osd":1,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":2.302,"15min":3.532},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":5.0990000000000002,"5min":30.404,"15min":112.73699999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.95,"15min":2.0459999999999998},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":5,"5min":14.278,"15min":32.863},"last":0.78100000000000003}]},{"osd":2,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.7230000000000001,"5min":1.839,"15min":5.2889999999999997},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":13.967000000000001,"5min":13.967000000000001,"15min":440.32400000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":1.405,"5min":2.2120000000000002,"15min":3.1339999999999999},"min":{"1min":0.442,"5min":0.438,"15min":0.40899999999999997},"max":{"1min":5.1520000000000001,"5min":17.382999999999999,"15min":161.42699999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":2.6299999999999999,"15min":2.4889999999999999},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.41799999999999998},"max":{"1min":9.4949999999999992,"5min":32.715000000000003,"15min":44.515999999999998},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.9139999999999999,"5min":2.3279999999999998,"15min":5.0579999999999998},"min":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":13.728,"5min":19.661999999999999,"15min":440.197},"last":0.94599999999999995}]},{"osd":5,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":2.379,"15min":3.3599999999999999},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":6.6059999999999999,"5min":25.640999999999998,"15min":215.369},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.163,"5min":2.7330000000000001,"15min":3.3730000000000002},"min":{"1min":0.51500000000000001,"5min":0.439,"15min":0.38},"max":{"1min":4.9500000000000002,"5min":32.659999999999997,"15min":212.42599999999999},"last":0.57299999999999995}]},{"osd":6,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":2.7519999999999998,"15min":5.5860000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32100000000000001},"max":{"1min":14.042,"5min":30.117999999999999,"15min":440.358},"last":0.61099999999999999},{"interface":"front","average":{"1min":2.371,"5min":2.71,"15min":4.125},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":15.471,"5min":15.471,"15min":215.42099999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":3.5979999999999999,"15min":3.3860000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42499999999999999},"max":{"1min":5.3049999999999997,"5min":45.661000000000001,"15min":121.637},"last":0.5},{"interface":"front","average":{"1min":3.7999999999999998,"5min":3.8679999999999999,"15min":5.6479999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":52.021999999999998,"5min":60.430999999999997,"15min":440.291},"last":0.89300000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542475,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":831508,"kb_used_data":48268,"kb_used_omap":1,"kb_used_meta":783230,"kb_avail":93540332,"statfs":{"total":96636764160,"available":95785299968,"internally_reserved":0,"allocated":49426432,"data_stored":49242654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":802027974},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.8980000000000001,"15min":2.0779999999999998},"min":{"1min":0.41999999999999998,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":12.201000000000001,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.3780000000000001,"15min":1.8660000000000001},"min":{"1min":0.46100000000000002,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":11.143000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":3.5419999999999998,"5min":2.7810000000000001,"15min":1.893},"min":{"1min":0.55300000000000005,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":18.725999999999999,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":2.492,"5min":2.8359999999999999,"15min":1.982},"min":{"1min":0.66300000000000003,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":9.5459999999999994,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.88300000000000001}]},{"osd":2,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":2.4689999999999999,"15min":1.923},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":11.041,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":2.0910000000000002,"5min":3.4100000000000001,"15min":2.347},"min":{"1min":0.52700000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":12.156000000000001,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.504,"5min":2.7610000000000001,"15min":2.093},"min":{"1min":0.71199999999999997,"5min":0.42399999999999999,"15min":0.41499999999999998},"max":{"1min":9.9420000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.85399999999999998},{"interface":"front","average":{"1min":2.1219999999999999,"5min":2.6859999999999999,"15min":2.1019999999999999},"min":{"1min":0.55700000000000005,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":11.606999999999999,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.51500000000000001}]},{"osd":4,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":4.8090000000000002,"5min":5.8399999999999999,"15min":4.4930000000000003},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":38.665999999999997,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":3.6539999999999999,"5min":3.4049999999999998,"15min":3.3530000000000002},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":23.553000000000001,"5min":23.553000000000001,"15min":174.684},"last":0.82299999999999995}]},{"osd":6,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":3.8820000000000001,"15min":2.9660000000000002},"min":{"1min":0.57799999999999996,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":13.242000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":3.7989999999999999,"5min":4.4989999999999997,"15min":3.6659999999999999},"min":{"1min":0.49199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.899999999999999,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.75}]},{"osd":7,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":3.7989999999999999,"15min":2.6680000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.42999999999999999},"max":{"1min":5.9199999999999999,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.63400000000000001},{"interface":"front","average":{"1min":2.8570000000000002,"5min":5.3529999999999998,"15min":3.258},"min":{"1min":0.66600000000000004,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":18.844999999999999,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51855360,"data_stored":51843646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49127424,"data_stored":49120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92590080,"data_stored":92576431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:19:18.338 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.338 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.338 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.339 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.339 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.339 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.339 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.339 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.339 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.340 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.341 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.341 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.341 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.341 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.341 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.341 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.342 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.342 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.342 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.342 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-10T04:51:56.127962+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=56, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.342 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-10T04:51:52.105100+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=4, tm_min=51, tm_sec=52, tm_wday=4, tm_yday=131, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=10, tm_hour=5, tm_min=18, tm_sec=28, tm_wday=4, tm_yday=131, tm_isdst=0) 2024-05-10T05:19:18.342 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-10T05:19:38.344 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-10T05:19:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.625+0000 7fbbc3200700 1 Processor -- start 2024-05-10T05:19:38.627 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.625+0000 7fbbc3200700 1 -- start start 2024-05-10T05:19:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc3200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbbc40c8ba0 0x7fbbc40c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:38.632 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc3200700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc406cbd0 con 0x7fbbc41588d0 2024-05-10T05:19:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc3200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc41593f0 con 0x7fbbc40c8ba0 2024-05-10T05:19:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc3200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40ca500 con 0x7fbbc40c5a00 2024-05-10T05:19:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc2800700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fbbc40c8ba0 0x7fbbc40c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc1e00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc1400700 1 --1- >> v1:172.21.15.117:6789/0 conn(0x7fbbc41588d0 0x7fbbc4158ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.117:6789/0 says I am v1:172.21.15.47:44662/0 (socket says 172.21.15.47:44662) 2024-05-10T05:19:38.633 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.627+0000 7fbbc1400700 1 -- 172.21.15.47:0/3732358526 learned_addr learned my addr 172.21.15.47:0/3732358526 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc0a00700 1 -- 172.21.15.47:0/3732358526 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172595745 0 0) 0x7fbbc406cbd0 con 0x7fbbc41588d0 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc0a00700 1 -- 172.21.15.47:0/3732358526 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbba80035b0 con 0x7fbbc41588d0 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc1e00700 1 -- 172.21.15.47:0/3732358526 >> v2:172.21.15.117:3300/0 conn(0x7fbbc40c8ba0 msgr2=0x7fbbc40c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc1e00700 1 --2- 172.21.15.47:0/3732358526 >> v2:172.21.15.117:3300/0 conn(0x7fbbc40c8ba0 0x7fbbc40c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc1e00700 1 -- 172.21.15.47:0/3732358526 >> v1:172.21.15.117:6789/0 conn(0x7fbbc41588d0 legacy=0x7fbbc4158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc1e00700 1 -- 172.21.15.47:0/3732358526 --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4159660 con 0x7fbbc40c5a00 2024-05-10T05:19:38.634 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc2800700 1 --2- 172.21.15.47:0/3732358526 >> v2:172.21.15.117:3300/0 conn(0x7fbbc40c8ba0 0x7fbbc40c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:19:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc1e00700 1 --2- 172.21.15.47:0/3732358526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41529e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009840 tx=0x7fbbb4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ae320d8ff9c995 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.628+0000 7fbbc0a00700 1 -- 172.21.15.47:0/3732358526 <== mon.2 v2:172.21.15.117:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4011830 con 0x7fbbc40c5a00 2024-05-10T05:19:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc0a00700 1 -- 172.21.15.47:0/3732358526 <== mon.2 v2:172.21.15.117:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb4011990 con 0x7fbbc40c5a00 2024-05-10T05:19:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc0a00700 1 -- 172.21.15.47:0/3732358526 <== mon.2 v2:172.21.15.117:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4011d00 con 0x7fbbc40c5a00 2024-05-10T05:19:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 -- 172.21.15.47:0/3732358526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 msgr2=0x7fbbc41529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:38.635 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3732358526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41529e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009840 tx=0x7fbbb4009b50 comp rx=0 tx=0).stop 2024-05-10T05:19:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 -- 172.21.15.47:0/3732358526 shutdown_connections 2024-05-10T05:19:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3732358526 >> v2:172.21.15.117:3300/0 conn(0x7fbbc40c8ba0 0x7fbbc40c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3732358526 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41529e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 -- 172.21.15.47:0/3732358526 >> 172.21.15.47:0/3732358526 conn(0x7fbbc40ca700 msgr2=0x7fbbc40cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 -- 172.21.15.47:0/3732358526 shutdown_connections 2024-05-10T05:19:38.636 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.629+0000 7fbbc3200700 1 -- 172.21.15.47:0/3732358526 wait complete. 2024-05-10T05:19:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.631+0000 7fbbc3200700 1 Processor -- start 2024-05-10T05:19:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.632+0000 7fbbc3200700 1 -- start start 2024-05-10T05:19:38.641 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc40c8ba0 0x7fbbc40aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 0x7fbbc414d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc3200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc40c3460 con 0x7fbbc41588d0 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc3200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc41eb2d0 con 0x7fbbc40c8ba0 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc3200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc41eb700 con 0x7fbbc40c5a00 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc2800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 0x7fbbc414d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc2800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 0x7fbbc414d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40628/0 (socket says 172.21.15.47:40628) 2024-05-10T05:19:38.642 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.633+0000 7fbbc2800700 1 -- 172.21.15.47:0/3438343797 learned_addr learned my addr 172.21.15.47:0/3438343797 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc1400700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc40c8ba0 0x7fbbc40aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc1e00700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc2800700 1 -- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 msgr2=0x7fbbc41ead90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc2800700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41ead90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc2800700 1 -- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc40c8ba0 msgr2=0x7fbbc40aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc2800700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc40c8ba0 0x7fbbc40aeba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc2800700 1 -- 172.21.15.47:0/3438343797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc009a70 con 0x7fbbc41588d0 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbc2800700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 0x7fbbc414d3d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009e10 tx=0x7fbbbc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:38.643 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.634+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc009cb0 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.635+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb40094a0 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.635+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc00f040 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.635+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00ceb0 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.635+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc414e1b0 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.636+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc4074720 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.637+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbbbc014480 con 0x7fbbc41588d0 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.638+0000 7fbbba000700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbba406ac90 0x7fbba406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:38.644 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.638+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbbbc08a3e0 con 0x7fbbc41588d0 2024-05-10T05:19:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.638+0000 7fbbc1e00700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbba406ac90 0x7fbba406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.639+0000 7fbbc1e00700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbba406ac90 0x7fbba406d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009b90 tx=0x7fbbb4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:38.645 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.643+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fbbbc0550e0 con 0x7fbbc41588d0 2024-05-10T05:19:38.855 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.854+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 --> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbbc406d3e0 con 0x7fbba406ac90 2024-05-10T05:19:38.867 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.866+0000 7fbbba000700 1 -- 172.21.15.47:0/3438343797 <== mgr.4108 v2:172.21.15.117:6832/43361 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+374578 (secure 0 0 0) 0x7fbbb4011630 con 0x7fbba406ac90 2024-05-10T05:19:38.872 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbba406ac90 msgr2=0x7fbba406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbba406ac90 0x7fbba406d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009b90 tx=0x7fbbb4008030 comp rx=0 tx=0).stop 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 msgr2=0x7fbbc414d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 0x7fbbc414d3d0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009e10 tx=0x7fbbbc00c3a0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 shutdown_connections 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fbbc41588d0 0x7fbbc414d3d0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.875 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fbba406ac90 0x7fbba406d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fbbc40c5a00 0x7fbbc41ead90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 --2- 172.21.15.47:0/3438343797 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fbbc40c8ba0 0x7fbbc40aeba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:38.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 >> 172.21.15.47:0/3438343797 conn(0x7fbbc40ca700 msgr2=0x7fbbc40c8fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:38.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 shutdown_connections 2024-05-10T05:19:38.876 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:38.870+0000 7fbbc3200700 1 -- 172.21.15.47:0/3438343797 wait complete. 2024-05-10T05:19:38.876 INFO:teuthology.orchestra.run.smithi047.stderr:dumped all 2024-05-10T05:19:38.901 INFO:teuthology.orchestra.run.smithi047.stdout:{"pg_ready":true,"pg_map":{"version":858,"stamp":"2024-05-10T05:19:38.713149+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":235773933,"num_objects":81,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":0,"num_read":4755,"num_read_kb":580569,"num_write":359369,"num_write_kb":31014503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6380,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529619,"ondisk_log_size":529619,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":7010168,"kb_used_data":462904,"kb_used_omap":12,"kb_used_meta":6547187,"kb_avail":747964552,"statfs":{"total":773094113280,"available":765915701248,"internally_reserved":0,"allocated":474013696,"data_stored":472521330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":6704320056},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004308"},"pg_stats":[{"pgid":"3.3f","version":"28'1987","reported_seq":2028,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:25.600530+0000","last_change":"2024-05-10T05:19:25.600671+0000","last_active":"2024-05-10T05:19:25.600530+0000","last_peered":"2024-05-10T05:19:25.600530+0000","last_clean":"2024-05-10T05:19:25.600530+0000","last_became_active":"2024-05-10T04:51:52.766224+0000","last_became_peered":"2024-05-10T04:51:52.766224+0000","last_unstale":"2024-05-10T05:19:25.600530+0000","last_undegraded":"2024-05-10T05:19:25.600530+0000","last_fullsized":"2024-05-10T05:19:25.600530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1987","last_scrub_stamp":"2024-05-10T05:19:25.600501+0000","last_deep_scrub":"28'1987","last_deep_scrub_stamp":"2024-05-10T05:19:25.600501+0000","last_clean_scrub_stamp":"2024-05-10T05:19:25.600501+0000","objects_scrubbed":0,"log_size":1987,"log_dups_size":0,"ondisk_log_size":1987,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:44.812935+0000","scrub_duration":0.026709523999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'1980","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:58.234884+0000","last_change":"2024-05-10T05:18:58.234884+0000","last_active":"2024-05-10T05:18:58.234884+0000","last_peered":"2024-05-10T05:18:58.234884+0000","last_clean":"2024-05-10T05:18:58.234884+0000","last_became_active":"2024-05-10T04:51:52.756556+0000","last_became_peered":"2024-05-10T04:51:52.756556+0000","last_unstale":"2024-05-10T05:18:58.234884+0000","last_undegraded":"2024-05-10T05:18:58.234884+0000","last_fullsized":"2024-05-10T05:18:58.234884+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1980","last_scrub_stamp":"2024-05-10T05:18:58.234747+0000","last_deep_scrub":"28'1980","last_deep_scrub_stamp":"2024-05-10T05:18:58.234747+0000","last_clean_scrub_stamp":"2024-05-10T05:18:58.234747+0000","objects_scrubbed":0,"log_size":1980,"log_dups_size":0,"ondisk_log_size":1980,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:09.502049+0000","scrub_duration":0.015462225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'2129","reported_seq":2170,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.252553+0000","last_change":"2024-05-10T05:19:09.252684+0000","last_active":"2024-05-10T05:19:09.252553+0000","last_peered":"2024-05-10T05:19:09.252553+0000","last_clean":"2024-05-10T05:19:09.252553+0000","last_became_active":"2024-05-10T04:51:52.745653+0000","last_became_peered":"2024-05-10T04:51:52.745653+0000","last_unstale":"2024-05-10T05:19:09.252553+0000","last_undegraded":"2024-05-10T05:19:09.252553+0000","last_fullsized":"2024-05-10T05:19:09.252553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2129","last_scrub_stamp":"2024-05-10T05:19:09.252524+0000","last_deep_scrub":"28'2129","last_deep_scrub_stamp":"2024-05-10T05:19:09.252524+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.252524+0000","objects_scrubbed":0,"log_size":2129,"log_dups_size":0,"ondisk_log_size":2129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:21:33.793032+0000","scrub_duration":0.014282459000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'2105","reported_seq":2146,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:06.949721+0000","last_change":"2024-05-10T05:19:06.949847+0000","last_active":"2024-05-10T05:19:06.949721+0000","last_peered":"2024-05-10T05:19:06.949721+0000","last_clean":"2024-05-10T05:19:06.949721+0000","last_became_active":"2024-05-10T04:51:52.746914+0000","last_became_peered":"2024-05-10T04:51:52.746914+0000","last_unstale":"2024-05-10T05:19:06.949721+0000","last_undegraded":"2024-05-10T05:19:06.949721+0000","last_fullsized":"2024-05-10T05:19:06.949721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2105","last_scrub_stamp":"2024-05-10T05:19:06.949693+0000","last_deep_scrub":"28'2105","last_deep_scrub_stamp":"2024-05-10T05:19:06.949693+0000","last_clean_scrub_stamp":"2024-05-10T05:19:06.949693+0000","objects_scrubbed":0,"log_size":2105,"log_dups_size":0,"ondisk_log_size":2105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:15:02.733480+0000","scrub_duration":0.002472222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'2061","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:06.540114+0000","last_change":"2024-05-10T05:19:06.540114+0000","last_active":"2024-05-10T05:19:06.540114+0000","last_peered":"2024-05-10T05:19:06.540114+0000","last_clean":"2024-05-10T05:19:06.540114+0000","last_became_active":"2024-05-10T04:51:52.762828+0000","last_became_peered":"2024-05-10T04:51:52.762828+0000","last_unstale":"2024-05-10T05:19:06.540114+0000","last_undegraded":"2024-05-10T05:19:06.540114+0000","last_fullsized":"2024-05-10T05:19:06.540114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2061","last_scrub_stamp":"2024-05-10T05:19:06.539949+0000","last_deep_scrub":"28'2061","last_deep_scrub_stamp":"2024-05-10T05:19:06.539949+0000","last_clean_scrub_stamp":"2024-05-10T05:19:06.539949+0000","objects_scrubbed":0,"log_size":2061,"log_dups_size":0,"ondisk_log_size":2061,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:43.575774+0000","scrub_duration":0.027233351999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'1968","reported_seq":2007,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:14.853020+0000","last_change":"2024-05-10T05:19:14.853020+0000","last_active":"2024-05-10T05:19:14.853020+0000","last_peered":"2024-05-10T05:19:14.853020+0000","last_clean":"2024-05-10T05:19:14.853020+0000","last_became_active":"2024-05-10T04:51:52.754544+0000","last_became_peered":"2024-05-10T04:51:52.754544+0000","last_unstale":"2024-05-10T05:19:14.853020+0000","last_undegraded":"2024-05-10T05:19:14.853020+0000","last_fullsized":"2024-05-10T05:19:14.853020+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1968","last_scrub_stamp":"2024-05-10T05:19:14.852835+0000","last_deep_scrub":"28'1968","last_deep_scrub_stamp":"2024-05-10T05:19:14.852835+0000","last_clean_scrub_stamp":"2024-05-10T05:19:14.852835+0000","objects_scrubbed":0,"log_size":1968,"log_dups_size":0,"ondisk_log_size":1968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:40:01.716842+0000","scrub_duration":0.0025516549999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"28'2006","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:28.623502+0000","last_change":"2024-05-10T05:19:28.623608+0000","last_active":"2024-05-10T05:19:28.623502+0000","last_peered":"2024-05-10T05:19:28.623502+0000","last_clean":"2024-05-10T05:19:28.623502+0000","last_became_active":"2024-05-10T04:51:52.762962+0000","last_became_peered":"2024-05-10T04:51:52.762962+0000","last_unstale":"2024-05-10T05:19:28.623502+0000","last_undegraded":"2024-05-10T05:19:28.623502+0000","last_fullsized":"2024-05-10T05:19:28.623502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2006","last_scrub_stamp":"2024-05-10T05:19:28.623472+0000","last_deep_scrub":"28'2006","last_deep_scrub_stamp":"2024-05-10T05:19:28.623472+0000","last_clean_scrub_stamp":"2024-05-10T05:19:28.623472+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:59:36.849556+0000","scrub_duration":0.0025102620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'2023","reported_seq":2062,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:14.048300+0000","last_change":"2024-05-10T05:19:14.048300+0000","last_active":"2024-05-10T05:19:14.048300+0000","last_peered":"2024-05-10T05:19:14.048300+0000","last_clean":"2024-05-10T05:19:14.048300+0000","last_became_active":"2024-05-10T04:51:52.738641+0000","last_became_peered":"2024-05-10T04:51:52.738641+0000","last_unstale":"2024-05-10T05:19:14.048300+0000","last_undegraded":"2024-05-10T05:19:14.048300+0000","last_fullsized":"2024-05-10T05:19:14.048300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2023","last_scrub_stamp":"2024-05-10T05:19:14.048154+0000","last_deep_scrub":"28'2023","last_deep_scrub_stamp":"2024-05-10T05:19:14.048154+0000","last_clean_scrub_stamp":"2024-05-10T05:19:14.048154+0000","objects_scrubbed":0,"log_size":2023,"log_dups_size":0,"ondisk_log_size":2023,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:53.475598+0000","scrub_duration":0.002738739,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'2083","reported_seq":2122,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:11.439671+0000","last_change":"2024-05-10T05:19:11.439798+0000","last_active":"2024-05-10T05:19:11.439671+0000","last_peered":"2024-05-10T05:19:11.439671+0000","last_clean":"2024-05-10T05:19:11.439671+0000","last_became_active":"2024-05-10T04:51:52.766622+0000","last_became_peered":"2024-05-10T04:51:52.766622+0000","last_unstale":"2024-05-10T05:19:11.439671+0000","last_undegraded":"2024-05-10T05:19:11.439671+0000","last_fullsized":"2024-05-10T05:19:11.439671+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2083","last_scrub_stamp":"2024-05-10T05:19:11.439645+0000","last_deep_scrub":"28'2083","last_deep_scrub_stamp":"2024-05-10T05:19:11.439645+0000","last_clean_scrub_stamp":"2024-05-10T05:19:11.439645+0000","objects_scrubbed":0,"log_size":2083,"log_dups_size":0,"ondisk_log_size":2083,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:39.267148+0000","scrub_duration":0.017916062,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"28'2091","reported_seq":2130,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.330233+0000","last_change":"2024-05-10T05:19:01.330399+0000","last_active":"2024-05-10T05:19:01.330233+0000","last_peered":"2024-05-10T05:19:01.330233+0000","last_clean":"2024-05-10T05:19:01.330233+0000","last_became_active":"2024-05-10T04:51:52.749341+0000","last_became_peered":"2024-05-10T04:51:52.749341+0000","last_unstale":"2024-05-10T05:19:01.330233+0000","last_undegraded":"2024-05-10T05:19:01.330233+0000","last_fullsized":"2024-05-10T05:19:01.330233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2091","last_scrub_stamp":"2024-05-10T05:19:01.330205+0000","last_deep_scrub":"28'2091","last_deep_scrub_stamp":"2024-05-10T05:19:01.330205+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.330205+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:38.366030+0000","scrub_duration":0.0063731329999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'1958","reported_seq":1997,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.363975+0000","last_change":"2024-05-10T05:18:52.364107+0000","last_active":"2024-05-10T05:18:52.363975+0000","last_peered":"2024-05-10T05:18:52.363975+0000","last_clean":"2024-05-10T05:18:52.363975+0000","last_became_active":"2024-05-10T04:51:52.759337+0000","last_became_peered":"2024-05-10T04:51:52.759337+0000","last_unstale":"2024-05-10T05:18:52.363975+0000","last_undegraded":"2024-05-10T05:18:52.363975+0000","last_fullsized":"2024-05-10T05:18:52.363975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1958","last_scrub_stamp":"2024-05-10T05:18:52.363948+0000","last_deep_scrub":"28'1958","last_deep_scrub_stamp":"2024-05-10T05:18:52.363948+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.363948+0000","objects_scrubbed":0,"log_size":1958,"log_dups_size":0,"ondisk_log_size":1958,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:41.653986+0000","scrub_duration":0.018300833999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'1948","reported_seq":1987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.921175+0000","last_change":"2024-05-10T05:18:36.921337+0000","last_active":"2024-05-10T05:18:36.921175+0000","last_peered":"2024-05-10T05:18:36.921175+0000","last_clean":"2024-05-10T05:18:36.921175+0000","last_became_active":"2024-05-10T04:51:52.751622+0000","last_became_peered":"2024-05-10T04:51:52.751622+0000","last_unstale":"2024-05-10T05:18:36.921175+0000","last_undegraded":"2024-05-10T05:18:36.921175+0000","last_fullsized":"2024-05-10T05:18:36.921175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1948","last_scrub_stamp":"2024-05-10T05:18:36.921148+0000","last_deep_scrub":"28'1948","last_deep_scrub_stamp":"2024-05-10T05:18:36.921148+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.921148+0000","objects_scrubbed":0,"log_size":1948,"log_dups_size":0,"ondisk_log_size":1948,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:17.214023+0000","scrub_duration":0.0019686439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'2029","reported_seq":2068,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.847677+0000","last_change":"2024-05-10T05:18:33.847792+0000","last_active":"2024-05-10T05:18:33.847677+0000","last_peered":"2024-05-10T05:18:33.847677+0000","last_clean":"2024-05-10T05:18:33.847677+0000","last_became_active":"2024-05-10T04:51:52.752978+0000","last_became_peered":"2024-05-10T04:51:52.752978+0000","last_unstale":"2024-05-10T05:18:33.847677+0000","last_undegraded":"2024-05-10T05:18:33.847677+0000","last_fullsized":"2024-05-10T05:18:33.847677+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2029","last_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_deep_scrub":"28'2029","last_deep_scrub_stamp":"2024-05-10T05:18:33.847651+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.847651+0000","objects_scrubbed":0,"log_size":2029,"log_dups_size":0,"ondisk_log_size":2029,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:17.105998+0000","scrub_duration":0.018189367000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'2006","reported_seq":2045,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:10.278699+0000","last_change":"2024-05-10T05:19:10.278823+0000","last_active":"2024-05-10T05:19:10.278699+0000","last_peered":"2024-05-10T05:19:10.278699+0000","last_clean":"2024-05-10T05:19:10.278699+0000","last_became_active":"2024-05-10T04:51:52.749697+0000","last_became_peered":"2024-05-10T04:51:52.749697+0000","last_unstale":"2024-05-10T05:19:10.278699+0000","last_undegraded":"2024-05-10T05:19:10.278699+0000","last_fullsized":"2024-05-10T05:19:10.278699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2006","last_scrub_stamp":"2024-05-10T05:19:10.278668+0000","last_deep_scrub":"28'2006","last_deep_scrub_stamp":"2024-05-10T05:19:10.278668+0000","last_clean_scrub_stamp":"2024-05-10T05:19:10.278668+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:47:49.706112+0000","scrub_duration":0.0020059499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'2108","reported_seq":2147,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.275942+0000","last_change":"2024-05-10T05:18:59.276069+0000","last_active":"2024-05-10T05:18:59.275942+0000","last_peered":"2024-05-10T05:18:59.275942+0000","last_clean":"2024-05-10T05:18:59.275942+0000","last_became_active":"2024-05-10T04:51:52.741367+0000","last_became_peered":"2024-05-10T04:51:52.741367+0000","last_unstale":"2024-05-10T05:18:59.275942+0000","last_undegraded":"2024-05-10T05:18:59.275942+0000","last_fullsized":"2024-05-10T05:18:59.275942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2108","last_scrub_stamp":"2024-05-10T05:18:59.275911+0000","last_deep_scrub":"28'2108","last_deep_scrub_stamp":"2024-05-10T05:18:59.275911+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.275911+0000","objects_scrubbed":0,"log_size":2108,"log_dups_size":0,"ondisk_log_size":2108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:38:03.694684+0000","scrub_duration":0.019024083000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'1994","reported_seq":2033,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:16.822184+0000","last_change":"2024-05-10T05:19:16.822319+0000","last_active":"2024-05-10T05:19:16.822184+0000","last_peered":"2024-05-10T05:19:16.822184+0000","last_clean":"2024-05-10T05:19:16.822184+0000","last_became_active":"2024-05-10T04:51:52.757251+0000","last_became_peered":"2024-05-10T04:51:52.757251+0000","last_unstale":"2024-05-10T05:19:16.822184+0000","last_undegraded":"2024-05-10T05:19:16.822184+0000","last_fullsized":"2024-05-10T05:19:16.822184+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:19:16.822155+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:19:16.822155+0000","last_clean_scrub_stamp":"2024-05-10T05:19:16.822155+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:18:04.003313+0000","scrub_duration":0.0026174290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:38.044150+0000","last_change":"2024-05-10T05:18:38.044283+0000","last_active":"2024-05-10T05:18:38.044150+0000","last_peered":"2024-05-10T05:18:38.044150+0000","last_clean":"2024-05-10T05:18:38.044150+0000","last_became_active":"2024-05-10T04:51:52.766438+0000","last_became_peered":"2024-05-10T04:51:52.766438+0000","last_unstale":"2024-05-10T05:18:38.044150+0000","last_undegraded":"2024-05-10T05:18:38.044150+0000","last_fullsized":"2024-05-10T05:18:38.044150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:18:38.044115+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:18:38.044115+0000","last_clean_scrub_stamp":"2024-05-10T05:18:38.044115+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:54:20.224156+0000","scrub_duration":0.033850064999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'1994","reported_seq":2033,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.488895+0000","last_change":"2024-05-10T05:18:48.489025+0000","last_active":"2024-05-10T05:18:48.488895+0000","last_peered":"2024-05-10T05:18:48.488895+0000","last_clean":"2024-05-10T05:18:48.488895+0000","last_became_active":"2024-05-10T04:51:52.753913+0000","last_became_peered":"2024-05-10T04:51:52.753913+0000","last_unstale":"2024-05-10T05:18:48.488895+0000","last_undegraded":"2024-05-10T05:18:48.488895+0000","last_fullsized":"2024-05-10T05:18:48.488895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:18:48.488869+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:18:48.488869+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.488869+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:42.641061+0000","scrub_duration":0.0021049350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'2104","reported_seq":2144,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:30.591972+0000","last_change":"2024-05-10T05:19:30.592109+0000","last_active":"2024-05-10T05:19:30.591972+0000","last_peered":"2024-05-10T05:19:30.591972+0000","last_clean":"2024-05-10T05:19:30.591972+0000","last_became_active":"2024-05-10T04:51:52.767692+0000","last_became_peered":"2024-05-10T04:51:52.767692+0000","last_unstale":"2024-05-10T05:19:30.591972+0000","last_undegraded":"2024-05-10T05:19:30.591972+0000","last_fullsized":"2024-05-10T05:19:30.591972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2104","last_scrub_stamp":"2024-05-10T05:19:30.591944+0000","last_deep_scrub":"28'2104","last_deep_scrub_stamp":"2024-05-10T05:19:30.591944+0000","last_clean_scrub_stamp":"2024-05-10T05:19:30.591944+0000","objects_scrubbed":0,"log_size":2104,"log_dups_size":0,"ondisk_log_size":2104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:37:26.852615+0000","scrub_duration":0.0027659830000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"28'7782","reported_seq":7894,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:24.161016+0000","last_change":"2024-05-10T05:19:24.161200+0000","last_active":"2024-05-10T05:19:24.161016+0000","last_peered":"2024-05-10T05:19:24.161016+0000","last_clean":"2024-05-10T05:19:24.161016+0000","last_became_active":"2024-05-10T04:51:57.222606+0000","last_became_peered":"2024-05-10T04:51:57.222606+0000","last_unstale":"2024-05-10T05:19:24.161016+0000","last_undegraded":"2024-05-10T05:19:24.161016+0000","last_fullsized":"2024-05-10T05:19:24.161016+0000","mapping_epoch":24,"log_start":"28'1521","ondisk_log_start":"28'1521","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7782","last_scrub_stamp":"2024-05-10T05:19:24.160985+0000","last_deep_scrub":"28'7782","last_deep_scrub_stamp":"2024-05-10T05:19:24.160985+0000","last_clean_scrub_stamp":"2024-05-10T05:19:24.160985+0000","objects_scrubbed":0,"log_size":6261,"log_dups_size":0,"ondisk_log_size":6261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:07:23.016154+0000","scrub_duration":0.060421953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":19050,"num_write":5710,"num_write_kb":937728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'1893","reported_seq":1935,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.189902+0000","last_change":"2024-05-10T05:18:36.189902+0000","last_active":"2024-05-10T05:18:36.189902+0000","last_peered":"2024-05-10T05:18:36.189902+0000","last_clean":"2024-05-10T05:18:36.189902+0000","last_became_active":"2024-05-10T04:51:52.139804+0000","last_became_peered":"2024-05-10T04:51:52.139804+0000","last_unstale":"2024-05-10T05:18:36.189902+0000","last_undegraded":"2024-05-10T05:18:36.189902+0000","last_fullsized":"2024-05-10T05:18:36.189902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1893","last_scrub_stamp":"2024-05-10T05:18:36.189732+0000","last_deep_scrub":"28'1893","last_deep_scrub_stamp":"2024-05-10T05:18:36.189732+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.189732+0000","objects_scrubbed":2,"log_size":1893,"log_dups_size":0,"ondisk_log_size":1893,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:57:40.485840+0000","scrub_duration":0.006777127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":1915,"num_write_kb":13600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"28'2039","reported_seq":2080,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:13.026233+0000","last_change":"2024-05-10T05:19:13.026377+0000","last_active":"2024-05-10T05:19:13.026233+0000","last_peered":"2024-05-10T05:19:13.026233+0000","last_clean":"2024-05-10T05:19:13.026233+0000","last_became_active":"2024-05-10T04:51:52.756061+0000","last_became_peered":"2024-05-10T04:51:52.756061+0000","last_unstale":"2024-05-10T05:19:13.026233+0000","last_undegraded":"2024-05-10T05:19:13.026233+0000","last_fullsized":"2024-05-10T05:19:13.026233+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2039","last_scrub_stamp":"2024-05-10T05:19:13.026206+0000","last_deep_scrub":"28'2039","last_deep_scrub_stamp":"2024-05-10T05:19:13.026206+0000","last_clean_scrub_stamp":"2024-05-10T05:19:13.026206+0000","objects_scrubbed":0,"log_size":2039,"log_dups_size":0,"ondisk_log_size":2039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:32.238640+0000","scrub_duration":0.012113007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"28'7466","reported_seq":7662,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.855509+0000","last_change":"2024-05-10T05:19:09.855734+0000","last_active":"2024-05-10T05:19:09.855509+0000","last_peered":"2024-05-10T05:19:09.855509+0000","last_clean":"2024-05-10T05:19:09.855509+0000","last_became_active":"2024-05-10T04:51:57.180483+0000","last_became_peered":"2024-05-10T04:51:57.180483+0000","last_unstale":"2024-05-10T05:19:09.855509+0000","last_undegraded":"2024-05-10T05:19:09.855509+0000","last_fullsized":"2024-05-10T05:19:09.855509+0000","mapping_epoch":24,"log_start":"28'321","ondisk_log_start":"28'321","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7466","last_scrub_stamp":"2024-05-10T05:19:09.855482+0000","last_deep_scrub":"28'7466","last_deep_scrub_stamp":"2024-05-10T05:19:09.855482+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.855482+0000","objects_scrubbed":0,"log_size":7145,"log_dups_size":0,"ondisk_log_size":7145,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:23:29.788871+0000","scrub_duration":0.042030791999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":159,"num_read_kb":40386,"num_write":5267,"num_write_kb":905574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"28'6436","reported_seq":6478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.018633+0000","last_change":"2024-05-10T05:18:49.018746+0000","last_active":"2024-05-10T05:18:49.018633+0000","last_peered":"2024-05-10T05:18:49.018633+0000","last_clean":"2024-05-10T05:18:49.018633+0000","last_became_active":"2024-05-10T04:51:52.132187+0000","last_became_peered":"2024-05-10T04:51:52.132187+0000","last_unstale":"2024-05-10T05:18:49.018633+0000","last_undegraded":"2024-05-10T05:18:49.018633+0000","last_fullsized":"2024-05-10T05:18:49.018633+0000","mapping_epoch":19,"log_start":"28'100","ondisk_log_start":"28'100","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6436","last_scrub_stamp":"2024-05-10T05:18:49.018608+0000","last_deep_scrub":"28'6436","last_deep_scrub_stamp":"2024-05-10T05:18:49.018608+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.018608+0000","objects_scrubbed":2,"log_size":6336,"log_dups_size":0,"ondisk_log_size":6336,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:29.024164+0000","scrub_duration":0.035903804999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6431,"num_write_kb":41336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"28'2041","reported_seq":2082,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.310495+0000","last_change":"2024-05-10T05:18:55.310495+0000","last_active":"2024-05-10T05:18:55.310495+0000","last_peered":"2024-05-10T05:18:55.310495+0000","last_clean":"2024-05-10T05:18:55.310495+0000","last_became_active":"2024-05-10T04:51:52.753909+0000","last_became_peered":"2024-05-10T04:51:52.753909+0000","last_unstale":"2024-05-10T05:18:55.310495+0000","last_undegraded":"2024-05-10T05:18:55.310495+0000","last_fullsized":"2024-05-10T05:18:55.310495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2041","last_scrub_stamp":"2024-05-10T05:18:55.310319+0000","last_deep_scrub":"28'2041","last_deep_scrub_stamp":"2024-05-10T05:18:55.310319+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.310319+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:23.137822+0000","scrub_duration":0.029729122,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"28'7590","reported_seq":7735,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:02.844173+0000","last_change":"2024-05-10T05:19:02.844173+0000","last_active":"2024-05-10T05:19:02.844173+0000","last_peered":"2024-05-10T05:19:02.844173+0000","last_clean":"2024-05-10T05:19:02.844173+0000","last_became_active":"2024-05-10T04:51:57.171779+0000","last_became_peered":"2024-05-10T04:51:57.171779+0000","last_unstale":"2024-05-10T05:19:02.844173+0000","last_undegraded":"2024-05-10T05:19:02.844173+0000","last_fullsized":"2024-05-10T05:19:02.844173+0000","mapping_epoch":24,"log_start":"28'408","ondisk_log_start":"28'408","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7590","last_scrub_stamp":"2024-05-10T05:19:02.843960+0000","last_deep_scrub":"28'7590","last_deep_scrub_stamp":"2024-05-10T05:19:02.843960+0000","last_clean_scrub_stamp":"2024-05-10T05:19:02.843960+0000","objects_scrubbed":0,"log_size":7182,"log_dups_size":0,"ondisk_log_size":7182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:14:28.510783+0000","scrub_duration":0.040026500999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":27432,"num_write":5371,"num_write_kb":853168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"28'9873","reported_seq":9913,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.610579+0000","last_change":"2024-05-10T05:18:57.610579+0000","last_active":"2024-05-10T05:18:57.610579+0000","last_peered":"2024-05-10T05:18:57.610579+0000","last_clean":"2024-05-10T05:18:57.610579+0000","last_became_active":"2024-05-10T04:51:52.147455+0000","last_became_peered":"2024-05-10T04:51:52.147455+0000","last_unstale":"2024-05-10T05:18:57.610579+0000","last_undegraded":"2024-05-10T05:18:57.610579+0000","last_fullsized":"2024-05-10T05:18:57.610579+0000","mapping_epoch":19,"log_start":"28'2800","ondisk_log_start":"28'2800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9873","last_scrub_stamp":"2024-05-10T05:18:57.610445+0000","last_deep_scrub":"28'9873","last_deep_scrub_stamp":"2024-05-10T05:18:57.610445+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.610445+0000","objects_scrubbed":6,"log_size":7073,"log_dups_size":0,"ondisk_log_size":7073,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:22:20.490810+0000","scrub_duration":0.083117143000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":9870,"num_write_kb":72194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'2094","reported_seq":2126,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:03.505624+0000","last_change":"2024-05-10T05:19:03.505751+0000","last_active":"2024-05-10T05:19:03.505624+0000","last_peered":"2024-05-10T05:19:03.505624+0000","last_clean":"2024-05-10T05:19:03.505624+0000","last_became_active":"2024-05-10T04:52:40.336143+0000","last_became_peered":"2024-05-10T04:52:40.336143+0000","last_unstale":"2024-05-10T05:19:03.505624+0000","last_undegraded":"2024-05-10T05:19:03.505624+0000","last_fullsized":"2024-05-10T05:19:03.505624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2094","last_scrub_stamp":"2024-05-10T05:19:03.505597+0000","last_deep_scrub":"28'2094","last_deep_scrub_stamp":"2024-05-10T05:19:03.505597+0000","last_clean_scrub_stamp":"2024-05-10T05:19:03.505597+0000","objects_scrubbed":0,"log_size":2094,"log_dups_size":0,"ondisk_log_size":2094,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:13.266940+0000","scrub_duration":0.0023624420000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"28'7416","reported_seq":7512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:50.926397+0000","last_change":"2024-05-10T05:18:50.926397+0000","last_active":"2024-05-10T05:18:50.926397+0000","last_peered":"2024-05-10T05:18:50.926397+0000","last_clean":"2024-05-10T05:18:50.926397+0000","last_became_active":"2024-05-10T04:51:57.170448+0000","last_became_peered":"2024-05-10T04:51:57.170448+0000","last_unstale":"2024-05-10T05:18:50.926397+0000","last_undegraded":"2024-05-10T05:18:50.926397+0000","last_fullsized":"2024-05-10T05:18:50.926397+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7416","last_scrub_stamp":"2024-05-10T05:18:50.926128+0000","last_deep_scrub":"28'7416","last_deep_scrub_stamp":"2024-05-10T05:18:50.926128+0000","last_clean_scrub_stamp":"2024-05-10T05:18:50.926128+0000","objects_scrubbed":0,"log_size":7216,"log_dups_size":0,"ondisk_log_size":7216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:08.428647+0000","scrub_duration":0.048600009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5311,"num_write_kb":1031390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"28'5472","reported_seq":5512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.638670+0000","last_change":"2024-05-10T05:18:52.638670+0000","last_active":"2024-05-10T05:18:52.638670+0000","last_peered":"2024-05-10T05:18:52.638670+0000","last_clean":"2024-05-10T05:18:52.638670+0000","last_became_active":"2024-05-10T04:51:52.149327+0000","last_became_peered":"2024-05-10T04:51:52.149327+0000","last_unstale":"2024-05-10T05:18:52.638670+0000","last_undegraded":"2024-05-10T05:18:52.638670+0000","last_fullsized":"2024-05-10T05:18:52.638670+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5472","last_scrub_stamp":"2024-05-10T05:18:52.638511+0000","last_deep_scrub":"28'5472","last_deep_scrub_stamp":"2024-05-10T05:18:52.638511+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.638511+0000","objects_scrubbed":3,"log_size":5472,"log_dups_size":0,"ondisk_log_size":5472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:43.963218+0000","scrub_duration":0.039925167999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5469,"num_write_kb":44451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"28'2034","reported_seq":2073,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:21.771898+0000","last_change":"2024-05-10T05:19:21.771898+0000","last_active":"2024-05-10T05:19:21.771898+0000","last_peered":"2024-05-10T05:19:21.771898+0000","last_clean":"2024-05-10T05:19:21.771898+0000","last_became_active":"2024-05-10T04:51:52.744968+0000","last_became_peered":"2024-05-10T04:51:52.744968+0000","last_unstale":"2024-05-10T05:19:21.771898+0000","last_undegraded":"2024-05-10T05:19:21.771898+0000","last_fullsized":"2024-05-10T05:19:21.771898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2034","last_scrub_stamp":"2024-05-10T05:19:21.771711+0000","last_deep_scrub":"28'2034","last_deep_scrub_stamp":"2024-05-10T05:19:21.771711+0000","last_clean_scrub_stamp":"2024-05-10T05:19:21.771711+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:14:47.438534+0000","scrub_duration":0.0061079359999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"28'7514","reported_seq":7590,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:16.125724+0000","last_change":"2024-05-10T05:19:16.125724+0000","last_active":"2024-05-10T05:19:16.125724+0000","last_peered":"2024-05-10T05:19:16.125724+0000","last_clean":"2024-05-10T05:19:16.125724+0000","last_became_active":"2024-05-10T04:51:57.174780+0000","last_became_peered":"2024-05-10T04:51:57.174780+0000","last_unstale":"2024-05-10T05:19:16.125724+0000","last_undegraded":"2024-05-10T05:19:16.125724+0000","last_fullsized":"2024-05-10T05:19:16.125724+0000","mapping_epoch":24,"log_start":"28'1214","ondisk_log_start":"28'1214","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7514","last_scrub_stamp":"2024-05-10T05:19:16.125539+0000","last_deep_scrub":"28'7514","last_deep_scrub_stamp":"2024-05-10T05:19:16.125539+0000","last_clean_scrub_stamp":"2024-05-10T05:19:16.125539+0000","objects_scrubbed":0,"log_size":6300,"log_dups_size":0,"ondisk_log_size":6300,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:26:52.179125+0000","scrub_duration":0.049204077999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":9906,"num_write":5295,"num_write_kb":976486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"28'8794","reported_seq":8834,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.149956+0000","last_change":"2024-05-10T05:18:47.149956+0000","last_active":"2024-05-10T05:18:47.149956+0000","last_peered":"2024-05-10T05:18:47.149956+0000","last_clean":"2024-05-10T05:18:47.149956+0000","last_became_active":"2024-05-10T04:51:52.138699+0000","last_became_peered":"2024-05-10T04:51:52.138699+0000","last_unstale":"2024-05-10T05:18:47.149956+0000","last_undegraded":"2024-05-10T05:18:47.149956+0000","last_fullsized":"2024-05-10T05:18:47.149956+0000","mapping_epoch":19,"log_start":"28'2500","ondisk_log_start":"28'2500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8794","last_scrub_stamp":"2024-05-10T05:18:47.149826+0000","last_deep_scrub":"28'8794","last_deep_scrub_stamp":"2024-05-10T05:18:47.149826+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.149826+0000","objects_scrubbed":6,"log_size":6294,"log_dups_size":0,"ondisk_log_size":6294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:24.339435+0000","scrub_duration":0.095680271999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8787,"num_write_kb":67134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"28'2072","reported_seq":2111,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.892088+0000","last_change":"2024-05-10T05:18:40.892088+0000","last_active":"2024-05-10T05:18:40.892088+0000","last_peered":"2024-05-10T05:18:40.892088+0000","last_clean":"2024-05-10T05:18:40.892088+0000","last_became_active":"2024-05-10T04:51:52.750600+0000","last_became_peered":"2024-05-10T04:51:52.750600+0000","last_unstale":"2024-05-10T05:18:40.892088+0000","last_undegraded":"2024-05-10T05:18:40.892088+0000","last_fullsized":"2024-05-10T05:18:40.892088+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2072","last_scrub_stamp":"2024-05-10T05:18:40.891925+0000","last_deep_scrub":"28'2072","last_deep_scrub_stamp":"2024-05-10T05:18:40.891925+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.891925+0000","objects_scrubbed":0,"log_size":2072,"log_dups_size":0,"ondisk_log_size":2072,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:32:47.245425+0000","scrub_duration":0.0121844,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"28'7470","reported_seq":7558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:56.492046+0000","last_change":"2024-05-10T05:18:56.492046+0000","last_active":"2024-05-10T05:18:56.492046+0000","last_peered":"2024-05-10T05:18:56.492046+0000","last_clean":"2024-05-10T05:18:56.492046+0000","last_became_active":"2024-05-10T04:52:40.388042+0000","last_became_peered":"2024-05-10T04:52:40.388042+0000","last_unstale":"2024-05-10T05:18:56.492046+0000","last_undegraded":"2024-05-10T05:18:56.492046+0000","last_fullsized":"2024-05-10T05:18:56.492046+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7470","last_scrub_stamp":"2024-05-10T05:18:56.491859+0000","last_deep_scrub":"28'7470","last_deep_scrub_stamp":"2024-05-10T05:18:56.491859+0000","last_clean_scrub_stamp":"2024-05-10T05:18:56.491859+0000","objects_scrubbed":0,"log_size":7470,"log_dups_size":0,"ondisk_log_size":7470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:36.784734+0000","scrub_duration":0.040445502000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":10414,"num_write":5230,"num_write_kb":984359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,5],"acting":[2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"28'9793","reported_seq":9833,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.398230+0000","last_change":"2024-05-10T05:18:44.398230+0000","last_active":"2024-05-10T05:18:44.398230+0000","last_peered":"2024-05-10T05:18:44.398230+0000","last_clean":"2024-05-10T05:18:44.398230+0000","last_became_active":"2024-05-10T04:51:52.135122+0000","last_became_peered":"2024-05-10T04:51:52.135122+0000","last_unstale":"2024-05-10T05:18:44.398230+0000","last_undegraded":"2024-05-10T05:18:44.398230+0000","last_fullsized":"2024-05-10T05:18:44.398230+0000","mapping_epoch":19,"log_start":"28'1800","ondisk_log_start":"28'1800","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9793","last_scrub_stamp":"2024-05-10T05:18:44.398080+0000","last_deep_scrub":"28'9793","last_deep_scrub_stamp":"2024-05-10T05:18:44.398080+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.398080+0000","objects_scrubbed":5,"log_size":7993,"log_dups_size":0,"ondisk_log_size":7993,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:44.122929+0000","scrub_duration":0.088564188000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9779,"num_write_kb":68049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"28'2031","reported_seq":2070,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.257816+0000","last_change":"2024-05-10T05:18:44.257816+0000","last_active":"2024-05-10T05:18:44.257816+0000","last_peered":"2024-05-10T05:18:44.257816+0000","last_clean":"2024-05-10T05:18:44.257816+0000","last_became_active":"2024-05-10T04:51:52.753050+0000","last_became_peered":"2024-05-10T04:51:52.753050+0000","last_unstale":"2024-05-10T05:18:44.257816+0000","last_undegraded":"2024-05-10T05:18:44.257816+0000","last_fullsized":"2024-05-10T05:18:44.257816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2031","last_scrub_stamp":"2024-05-10T05:18:44.257627+0000","last_deep_scrub":"28'2031","last_deep_scrub_stamp":"2024-05-10T05:18:44.257627+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.257627+0000","objects_scrubbed":0,"log_size":2031,"log_dups_size":0,"ondisk_log_size":2031,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:14:43.057150+0000","scrub_duration":0.0094484070000000007,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"28'7236","reported_seq":7491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:23.439542+0000","last_change":"2024-05-10T05:19:23.439706+0000","last_active":"2024-05-10T05:19:23.439542+0000","last_peered":"2024-05-10T05:19:23.439542+0000","last_clean":"2024-05-10T05:19:23.439542+0000","last_became_active":"2024-05-10T04:51:57.171135+0000","last_became_peered":"2024-05-10T04:51:57.171135+0000","last_unstale":"2024-05-10T05:19:23.439542+0000","last_undegraded":"2024-05-10T05:19:23.439542+0000","last_fullsized":"2024-05-10T05:19:23.439542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7236","last_scrub_stamp":"2024-05-10T05:19:23.439511+0000","last_deep_scrub":"28'7236","last_deep_scrub_stamp":"2024-05-10T05:19:23.439511+0000","last_clean_scrub_stamp":"2024-05-10T05:19:23.439511+0000","objects_scrubbed":0,"log_size":7236,"log_dups_size":0,"ondisk_log_size":7236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:12:11.044024+0000","scrub_duration":0.039130563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":54864,"num_write":5149,"num_write_kb":870343,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'4835","reported_seq":4875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:45.041921+0000","last_change":"2024-05-10T05:18:45.042028+0000","last_active":"2024-05-10T05:18:45.041921+0000","last_peered":"2024-05-10T05:18:45.041921+0000","last_clean":"2024-05-10T05:18:45.041921+0000","last_became_active":"2024-05-10T04:51:52.131409+0000","last_became_peered":"2024-05-10T04:51:52.131409+0000","last_unstale":"2024-05-10T05:18:45.041921+0000","last_undegraded":"2024-05-10T05:18:45.041921+0000","last_fullsized":"2024-05-10T05:18:45.041921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4835","last_scrub_stamp":"2024-05-10T05:18:45.041892+0000","last_deep_scrub":"28'4835","last_deep_scrub_stamp":"2024-05-10T05:18:45.041892+0000","last_clean_scrub_stamp":"2024-05-10T05:18:45.041892+0000","objects_scrubbed":2,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:49.460665+0000","scrub_duration":0.031114352000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4833,"num_write_kb":35949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'2106","reported_seq":2145,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.975043+0000","last_change":"2024-05-10T05:18:53.975155+0000","last_active":"2024-05-10T05:18:53.975043+0000","last_peered":"2024-05-10T05:18:53.975043+0000","last_clean":"2024-05-10T05:18:53.975043+0000","last_became_active":"2024-05-10T04:51:52.746452+0000","last_became_peered":"2024-05-10T04:51:52.746452+0000","last_unstale":"2024-05-10T05:18:53.975043+0000","last_undegraded":"2024-05-10T05:18:53.975043+0000","last_fullsized":"2024-05-10T05:18:53.975043+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2106","last_scrub_stamp":"2024-05-10T05:18:53.975013+0000","last_deep_scrub":"28'2106","last_deep_scrub_stamp":"2024-05-10T05:18:53.975013+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.975013+0000","objects_scrubbed":0,"log_size":2106,"log_dups_size":0,"ondisk_log_size":2106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:32.059839+0000","scrub_duration":0.0019932040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"28'7755","reported_seq":7822,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:16.228629+0000","last_change":"2024-05-10T05:19:16.228792+0000","last_active":"2024-05-10T05:19:16.228629+0000","last_peered":"2024-05-10T05:19:16.228629+0000","last_clean":"2024-05-10T05:19:16.228629+0000","last_became_active":"2024-05-10T04:51:57.217563+0000","last_became_peered":"2024-05-10T04:51:57.217563+0000","last_unstale":"2024-05-10T05:19:16.228629+0000","last_undegraded":"2024-05-10T05:19:16.228629+0000","last_fullsized":"2024-05-10T05:19:16.228629+0000","mapping_epoch":24,"log_start":"28'520","ondisk_log_start":"28'520","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7755","last_scrub_stamp":"2024-05-10T05:19:16.228601+0000","last_deep_scrub":"28'7755","last_deep_scrub_stamp":"2024-05-10T05:19:16.228601+0000","last_clean_scrub_stamp":"2024-05-10T05:19:16.228601+0000","objects_scrubbed":0,"log_size":7235,"log_dups_size":0,"ondisk_log_size":7235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:56:00.763042+0000","scrub_duration":0.037491364999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":7112,"num_write":5693,"num_write_kb":1009137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"28'9720","reported_seq":9760,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:52.873540+0000","last_change":"2024-05-10T05:18:52.873661+0000","last_active":"2024-05-10T05:18:52.873540+0000","last_peered":"2024-05-10T05:18:52.873540+0000","last_clean":"2024-05-10T05:18:52.873540+0000","last_became_active":"2024-05-10T04:51:52.136522+0000","last_became_peered":"2024-05-10T04:51:52.136522+0000","last_unstale":"2024-05-10T05:18:52.873540+0000","last_undegraded":"2024-05-10T05:18:52.873540+0000","last_fullsized":"2024-05-10T05:18:52.873540+0000","mapping_epoch":19,"log_start":"28'2200","ondisk_log_start":"28'2200","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9720","last_scrub_stamp":"2024-05-10T05:18:52.873508+0000","last_deep_scrub":"28'9720","last_deep_scrub_stamp":"2024-05-10T05:18:52.873508+0000","last_clean_scrub_stamp":"2024-05-10T05:18:52.873508+0000","objects_scrubbed":1,"log_size":7520,"log_dups_size":0,"ondisk_log_size":7520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:53.278672+0000","scrub_duration":0.023067694999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9704,"num_write_kb":63985,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'2011","reported_seq":2050,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:56.298417+0000","last_change":"2024-05-10T05:18:56.298549+0000","last_active":"2024-05-10T05:18:56.298417+0000","last_peered":"2024-05-10T05:18:56.298417+0000","last_clean":"2024-05-10T05:18:56.298417+0000","last_became_active":"2024-05-10T04:51:52.750096+0000","last_became_peered":"2024-05-10T04:51:52.750096+0000","last_unstale":"2024-05-10T05:18:56.298417+0000","last_undegraded":"2024-05-10T05:18:56.298417+0000","last_fullsized":"2024-05-10T05:18:56.298417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2011","last_scrub_stamp":"2024-05-10T05:18:56.298376+0000","last_deep_scrub":"28'2011","last_deep_scrub_stamp":"2024-05-10T05:18:56.298376+0000","last_clean_scrub_stamp":"2024-05-10T05:18:56.298376+0000","objects_scrubbed":0,"log_size":2011,"log_dups_size":0,"ondisk_log_size":2011,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:47.623083+0000","scrub_duration":0.017952936999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"28'7567","reported_seq":7757,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:29.103916+0000","last_change":"2024-05-10T05:19:29.104103+0000","last_active":"2024-05-10T05:19:29.103916+0000","last_peered":"2024-05-10T05:19:29.103916+0000","last_clean":"2024-05-10T05:19:29.103916+0000","last_became_active":"2024-05-10T04:51:57.221648+0000","last_became_peered":"2024-05-10T04:51:57.221648+0000","last_unstale":"2024-05-10T05:19:29.103916+0000","last_undegraded":"2024-05-10T05:19:29.103916+0000","last_fullsized":"2024-05-10T05:19:29.103916+0000","mapping_epoch":24,"log_start":"28'1310","ondisk_log_start":"28'1310","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7567","last_scrub_stamp":"2024-05-10T05:19:29.103882+0000","last_deep_scrub":"28'7567","last_deep_scrub_stamp":"2024-05-10T05:19:29.103882+0000","last_clean_scrub_stamp":"2024-05-10T05:19:29.103882+0000","objects_scrubbed":0,"log_size":6257,"log_dups_size":0,"ondisk_log_size":6257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:08:54.749593+0000","scrub_duration":0.048838263999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":38862,"num_write":5342,"num_write_kb":1016486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"28'6187","reported_seq":6969,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.342323+0000","last_change":"2024-05-10T05:18:48.342476+0000","last_active":"2024-05-10T05:18:48.342323+0000","last_peered":"2024-05-10T05:18:48.342323+0000","last_clean":"2024-05-10T05:18:48.342323+0000","last_became_active":"2024-05-10T04:51:52.144912+0000","last_became_peered":"2024-05-10T04:51:52.144912+0000","last_unstale":"2024-05-10T05:18:48.342323+0000","last_undegraded":"2024-05-10T05:18:48.342323+0000","last_fullsized":"2024-05-10T05:18:48.342323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6187","last_scrub_stamp":"2024-05-10T05:18:48.342269+0000","last_deep_scrub":"28'6187","last_deep_scrub_stamp":"2024-05-10T05:18:48.342269+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.342269+0000","objects_scrubbed":3,"log_size":6187,"log_dups_size":0,"ondisk_log_size":6187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:42.585826+0000","scrub_duration":0.053531205999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11372145,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":743,"num_read_kb":4579,"num_write":6181,"num_write_kb":47965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'2046","reported_seq":2085,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:22.723404+0000","last_change":"2024-05-10T05:19:22.723539+0000","last_active":"2024-05-10T05:19:22.723404+0000","last_peered":"2024-05-10T05:19:22.723404+0000","last_clean":"2024-05-10T05:19:22.723404+0000","last_became_active":"2024-05-10T04:51:52.758174+0000","last_became_peered":"2024-05-10T04:51:52.758174+0000","last_unstale":"2024-05-10T05:19:22.723404+0000","last_undegraded":"2024-05-10T05:19:22.723404+0000","last_fullsized":"2024-05-10T05:19:22.723404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2046","last_scrub_stamp":"2024-05-10T05:19:22.723375+0000","last_deep_scrub":"28'2046","last_deep_scrub_stamp":"2024-05-10T05:19:22.723375+0000","last_clean_scrub_stamp":"2024-05-10T05:19:22.723375+0000","objects_scrubbed":0,"log_size":2046,"log_dups_size":0,"ondisk_log_size":2046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:44.173984+0000","scrub_duration":0.0062811079999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"28'7408","reported_seq":7481,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:26.088571+0000","last_change":"2024-05-10T05:19:26.088765+0000","last_active":"2024-05-10T05:19:26.088571+0000","last_peered":"2024-05-10T05:19:26.088571+0000","last_clean":"2024-05-10T05:19:26.088571+0000","last_became_active":"2024-05-10T04:51:57.176620+0000","last_became_peered":"2024-05-10T04:51:57.176620+0000","last_unstale":"2024-05-10T05:19:26.088571+0000","last_undegraded":"2024-05-10T05:19:26.088571+0000","last_fullsized":"2024-05-10T05:19:26.088571+0000","mapping_epoch":24,"log_start":"28'1104","ondisk_log_start":"28'1104","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7408","last_scrub_stamp":"2024-05-10T05:19:26.088540+0000","last_deep_scrub":"28'7408","last_deep_scrub_stamp":"2024-05-10T05:19:26.088540+0000","last_clean_scrub_stamp":"2024-05-10T05:19:26.088540+0000","objects_scrubbed":0,"log_size":6304,"log_dups_size":0,"ondisk_log_size":6304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:40:17.302264+0000","scrub_duration":0.043124994999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5304,"num_write_kb":989379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"28'6458","reported_seq":6498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.896966+0000","last_change":"2024-05-10T05:18:53.897089+0000","last_active":"2024-05-10T05:18:53.896966+0000","last_peered":"2024-05-10T05:18:53.896966+0000","last_clean":"2024-05-10T05:18:53.896966+0000","last_became_active":"2024-05-10T04:51:52.139471+0000","last_became_peered":"2024-05-10T04:51:52.139471+0000","last_unstale":"2024-05-10T05:18:53.896966+0000","last_undegraded":"2024-05-10T05:18:53.896966+0000","last_fullsized":"2024-05-10T05:18:53.896966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6458","last_scrub_stamp":"2024-05-10T05:18:53.896937+0000","last_deep_scrub":"28'6458","last_deep_scrub_stamp":"2024-05-10T05:18:53.896937+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.896937+0000","objects_scrubbed":1,"log_size":6458,"log_dups_size":0,"ondisk_log_size":6458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:42:34.189812+0000","scrub_duration":0.02504234,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6459,"num_write_kb":45352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'2058","reported_seq":2105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.294133+0000","last_change":"2024-05-10T05:18:42.294264+0000","last_active":"2024-05-10T05:18:42.294133+0000","last_peered":"2024-05-10T05:18:42.294133+0000","last_clean":"2024-05-10T05:18:42.294133+0000","last_became_active":"2024-05-10T04:52:41.276360+0000","last_became_peered":"2024-05-10T04:52:41.276360+0000","last_unstale":"2024-05-10T05:18:42.294133+0000","last_undegraded":"2024-05-10T05:18:42.294133+0000","last_fullsized":"2024-05-10T05:18:42.294133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2058","last_scrub_stamp":"2024-05-10T05:18:42.294102+0000","last_deep_scrub":"28'2058","last_deep_scrub_stamp":"2024-05-10T05:18:42.294102+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.294102+0000","objects_scrubbed":0,"log_size":2058,"log_dups_size":0,"ondisk_log_size":2058,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:19.483711+0000","scrub_duration":0.026468472,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"28'7585","reported_seq":7632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.896626+0000","last_change":"2024-05-10T05:18:55.896808+0000","last_active":"2024-05-10T05:18:55.896626+0000","last_peered":"2024-05-10T05:18:55.896626+0000","last_clean":"2024-05-10T05:18:55.896626+0000","last_became_active":"2024-05-10T04:51:57.166759+0000","last_became_peered":"2024-05-10T04:51:57.166759+0000","last_unstale":"2024-05-10T05:18:55.896626+0000","last_undegraded":"2024-05-10T05:18:55.896626+0000","last_fullsized":"2024-05-10T05:18:55.896626+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7585","last_scrub_stamp":"2024-05-10T05:18:55.896595+0000","last_deep_scrub":"28'7585","last_deep_scrub_stamp":"2024-05-10T05:18:55.896595+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.896595+0000","objects_scrubbed":0,"log_size":7185,"log_dups_size":0,"ondisk_log_size":7185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:39:42.760602+0000","scrub_duration":0.041604107000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":2540,"num_write":5413,"num_write_kb":853679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"28'5962","reported_seq":6002,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.349719+0000","last_change":"2024-05-10T05:18:53.349832+0000","last_active":"2024-05-10T05:18:53.349719+0000","last_peered":"2024-05-10T05:18:53.349719+0000","last_clean":"2024-05-10T05:18:53.349719+0000","last_became_active":"2024-05-10T04:51:52.137584+0000","last_became_peered":"2024-05-10T04:51:52.137584+0000","last_unstale":"2024-05-10T05:18:53.349719+0000","last_undegraded":"2024-05-10T05:18:53.349719+0000","last_fullsized":"2024-05-10T05:18:53.349719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5962","last_scrub_stamp":"2024-05-10T05:18:53.349691+0000","last_deep_scrub":"28'5962","last_deep_scrub_stamp":"2024-05-10T05:18:53.349691+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.349691+0000","objects_scrubbed":3,"log_size":5962,"log_dups_size":0,"ondisk_log_size":5962,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:53.074540+0000","scrub_duration":0.025746323000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5964,"num_write_kb":37127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'2047","reported_seq":2086,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:43.908832+0000","last_change":"2024-05-10T05:18:43.908970+0000","last_active":"2024-05-10T05:18:43.908832+0000","last_peered":"2024-05-10T05:18:43.908832+0000","last_clean":"2024-05-10T05:18:43.908832+0000","last_became_active":"2024-05-10T04:51:52.764577+0000","last_became_peered":"2024-05-10T04:51:52.764577+0000","last_unstale":"2024-05-10T05:18:43.908832+0000","last_undegraded":"2024-05-10T05:18:43.908832+0000","last_fullsized":"2024-05-10T05:18:43.908832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2047","last_scrub_stamp":"2024-05-10T05:18:43.908805+0000","last_deep_scrub":"28'2047","last_deep_scrub_stamp":"2024-05-10T05:18:43.908805+0000","last_clean_scrub_stamp":"2024-05-10T05:18:43.908805+0000","objects_scrubbed":0,"log_size":2047,"log_dups_size":0,"ondisk_log_size":2047,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:59:53.670148+0000","scrub_duration":0.0019465979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"28'7575","reported_seq":7652,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.334081+0000","last_change":"2024-05-10T05:19:09.334250+0000","last_active":"2024-05-10T05:19:09.334081+0000","last_peered":"2024-05-10T05:19:09.334081+0000","last_clean":"2024-05-10T05:19:09.334081+0000","last_became_active":"2024-05-10T04:51:57.166171+0000","last_became_peered":"2024-05-10T04:51:57.166171+0000","last_unstale":"2024-05-10T05:19:09.334081+0000","last_undegraded":"2024-05-10T05:19:09.334081+0000","last_fullsized":"2024-05-10T05:19:09.334081+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7575","last_scrub_stamp":"2024-05-10T05:19:09.334055+0000","last_deep_scrub":"28'7575","last_deep_scrub_stamp":"2024-05-10T05:19:09.334055+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.334055+0000","objects_scrubbed":0,"log_size":7375,"log_dups_size":0,"ondisk_log_size":7375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:46.369880+0000","scrub_duration":0.040651574000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5441,"num_write_kb":923430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"28'9434","reported_seq":10141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:39.429029+0000","last_change":"2024-05-10T05:18:39.429149+0000","last_active":"2024-05-10T05:18:39.429029+0000","last_peered":"2024-05-10T05:18:39.429029+0000","last_clean":"2024-05-10T05:18:39.429029+0000","last_became_active":"2024-05-10T04:51:52.140356+0000","last_became_peered":"2024-05-10T04:51:52.140356+0000","last_unstale":"2024-05-10T05:18:39.429029+0000","last_undegraded":"2024-05-10T05:18:39.429029+0000","last_fullsized":"2024-05-10T05:18:39.429029+0000","mapping_epoch":19,"log_start":"28'1500","ondisk_log_start":"28'1500","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'9434","last_scrub_stamp":"2024-05-10T05:18:39.429006+0000","last_deep_scrub":"28'9434","last_deep_scrub_stamp":"2024-05-10T05:18:39.429006+0000","last_clean_scrub_stamp":"2024-05-10T05:18:39.429006+0000","objects_scrubbed":8,"log_size":7934,"log_dups_size":0,"ondisk_log_size":7934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:06.400181+0000","scrub_duration":0.080354881000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20972192,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":668,"num_read_kb":4534,"num_write":9422,"num_write_kb":67821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'1992","reported_seq":2031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:26.538732+0000","last_change":"2024-05-10T05:19:26.538870+0000","last_active":"2024-05-10T05:19:26.538732+0000","last_peered":"2024-05-10T05:19:26.538732+0000","last_clean":"2024-05-10T05:19:26.538732+0000","last_became_active":"2024-05-10T04:51:52.769107+0000","last_became_peered":"2024-05-10T04:51:52.769107+0000","last_unstale":"2024-05-10T05:19:26.538732+0000","last_undegraded":"2024-05-10T05:19:26.538732+0000","last_fullsized":"2024-05-10T05:19:26.538732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1992","last_scrub_stamp":"2024-05-10T05:19:26.538686+0000","last_deep_scrub":"28'1992","last_deep_scrub_stamp":"2024-05-10T05:19:26.538686+0000","last_clean_scrub_stamp":"2024-05-10T05:19:26.538686+0000","objects_scrubbed":0,"log_size":1992,"log_dups_size":0,"ondisk_log_size":1992,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:05.966131+0000","scrub_duration":0.0055243970000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"28'7578","reported_seq":7655,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:28.796531+0000","last_change":"2024-05-10T05:19:28.796726+0000","last_active":"2024-05-10T05:19:28.796531+0000","last_peered":"2024-05-10T05:19:28.796531+0000","last_clean":"2024-05-10T05:19:28.796531+0000","last_became_active":"2024-05-10T04:51:57.219233+0000","last_became_peered":"2024-05-10T04:51:57.219233+0000","last_unstale":"2024-05-10T05:19:28.796531+0000","last_undegraded":"2024-05-10T05:19:28.796531+0000","last_fullsized":"2024-05-10T05:19:28.796531+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7578","last_scrub_stamp":"2024-05-10T05:19:28.796504+0000","last_deep_scrub":"28'7578","last_deep_scrub_stamp":"2024-05-10T05:19:28.796504+0000","last_clean_scrub_stamp":"2024-05-10T05:19:28.796504+0000","objects_scrubbed":0,"log_size":7578,"log_dups_size":0,"ondisk_log_size":7578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:23:48.729893+0000","scrub_duration":0.041078938000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5513,"num_write_kb":854916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"28'4835","reported_seq":4875,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:35.257270+0000","last_change":"2024-05-10T05:18:35.257379+0000","last_active":"2024-05-10T05:18:35.257270+0000","last_peered":"2024-05-10T05:18:35.257270+0000","last_clean":"2024-05-10T05:18:35.257270+0000","last_became_active":"2024-05-10T04:51:52.135131+0000","last_became_peered":"2024-05-10T04:51:52.135131+0000","last_unstale":"2024-05-10T05:18:35.257270+0000","last_undegraded":"2024-05-10T05:18:35.257270+0000","last_fullsized":"2024-05-10T05:18:35.257270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4835","last_scrub_stamp":"2024-05-10T05:18:35.257245+0000","last_deep_scrub":"28'4835","last_deep_scrub_stamp":"2024-05-10T05:18:35.257245+0000","last_clean_scrub_stamp":"2024-05-10T05:18:35.257245+0000","objects_scrubbed":4,"log_size":4835,"log_dups_size":0,"ondisk_log_size":4835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T08:09:26.581951+0000","scrub_duration":0.037039299999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4833,"num_write_kb":36023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'2054","reported_seq":2093,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.334744+0000","last_change":"2024-05-10T05:18:49.334848+0000","last_active":"2024-05-10T05:18:49.334744+0000","last_peered":"2024-05-10T05:18:49.334744+0000","last_clean":"2024-05-10T05:18:49.334744+0000","last_became_active":"2024-05-10T04:51:52.745249+0000","last_became_peered":"2024-05-10T04:51:52.745249+0000","last_unstale":"2024-05-10T05:18:49.334744+0000","last_undegraded":"2024-05-10T05:18:49.334744+0000","last_fullsized":"2024-05-10T05:18:49.334744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2054","last_scrub_stamp":"2024-05-10T05:18:49.334712+0000","last_deep_scrub":"28'2054","last_deep_scrub_stamp":"2024-05-10T05:18:49.334712+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.334712+0000","objects_scrubbed":0,"log_size":2054,"log_dups_size":0,"ondisk_log_size":2054,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:27.419539+0000","scrub_duration":0.002887634,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"28'7438","reported_seq":7492,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:15.084855+0000","last_change":"2024-05-10T05:19:15.085026+0000","last_active":"2024-05-10T05:19:15.084855+0000","last_peered":"2024-05-10T05:19:15.084855+0000","last_clean":"2024-05-10T05:19:15.084855+0000","last_became_active":"2024-05-10T04:51:57.215757+0000","last_became_peered":"2024-05-10T04:51:57.215757+0000","last_unstale":"2024-05-10T05:19:15.084855+0000","last_undegraded":"2024-05-10T05:19:15.084855+0000","last_fullsized":"2024-05-10T05:19:15.084855+0000","mapping_epoch":24,"log_start":"28'1116","ondisk_log_start":"28'1116","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7438","last_scrub_stamp":"2024-05-10T05:19:15.084828+0000","last_deep_scrub":"28'7438","last_deep_scrub_stamp":"2024-05-10T05:19:15.084828+0000","last_clean_scrub_stamp":"2024-05-10T05:19:15.084828+0000","objects_scrubbed":0,"log_size":6322,"log_dups_size":0,"ondisk_log_size":6322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:59:23.310912+0000","scrub_duration":0.035514015000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":4318,"num_write":5400,"num_write_kb":1058713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"28'2078","reported_seq":2118,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.978768+0000","last_change":"2024-05-10T05:18:59.978883+0000","last_active":"2024-05-10T05:18:59.978768+0000","last_peered":"2024-05-10T05:18:59.978768+0000","last_clean":"2024-05-10T05:18:59.978768+0000","last_became_active":"2024-05-10T04:51:52.139627+0000","last_became_peered":"2024-05-10T04:51:52.139627+0000","last_unstale":"2024-05-10T05:18:59.978768+0000","last_undegraded":"2024-05-10T05:18:59.978768+0000","last_fullsized":"2024-05-10T05:18:59.978768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2078","last_scrub_stamp":"2024-05-10T05:18:59.978739+0000","last_deep_scrub":"28'2078","last_deep_scrub_stamp":"2024-05-10T05:18:59.978739+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.978739+0000","objects_scrubbed":2,"log_size":2078,"log_dups_size":0,"ondisk_log_size":2078,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:35.925245+0000","scrub_duration":0.030891707000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2091,"num_write_kb":17666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'2077","reported_seq":2116,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.504489+0000","last_change":"2024-05-10T05:18:59.504609+0000","last_active":"2024-05-10T05:18:59.504489+0000","last_peered":"2024-05-10T05:18:59.504489+0000","last_clean":"2024-05-10T05:18:59.504489+0000","last_became_active":"2024-05-10T04:51:52.775707+0000","last_became_peered":"2024-05-10T04:51:52.775707+0000","last_unstale":"2024-05-10T05:18:59.504489+0000","last_undegraded":"2024-05-10T05:18:59.504489+0000","last_fullsized":"2024-05-10T05:18:59.504489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2077","last_scrub_stamp":"2024-05-10T05:18:59.504466+0000","last_deep_scrub":"28'2077","last_deep_scrub_stamp":"2024-05-10T05:18:59.504466+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.504466+0000","objects_scrubbed":0,"log_size":2077,"log_dups_size":0,"ondisk_log_size":2077,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:39.510022+0000","scrub_duration":0.0036729250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"28'7481","reported_seq":7654,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:21.157437+0000","last_change":"2024-05-10T05:19:21.157598+0000","last_active":"2024-05-10T05:19:21.157437+0000","last_peered":"2024-05-10T05:19:21.157437+0000","last_clean":"2024-05-10T05:19:21.157437+0000","last_became_active":"2024-05-10T04:52:41.238939+0000","last_became_peered":"2024-05-10T04:52:41.238939+0000","last_unstale":"2024-05-10T05:19:21.157437+0000","last_undegraded":"2024-05-10T05:19:21.157437+0000","last_fullsized":"2024-05-10T05:19:21.157437+0000","mapping_epoch":27,"log_start":"28'1221","ondisk_log_start":"28'1221","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7481","last_scrub_stamp":"2024-05-10T05:19:21.157384+0000","last_deep_scrub":"28'7481","last_deep_scrub_stamp":"2024-05-10T05:19:21.157384+0000","last_clean_scrub_stamp":"2024-05-10T05:19:21.157384+0000","objects_scrubbed":0,"log_size":6260,"log_dups_size":0,"ondisk_log_size":6260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:15.002108+0000","scrub_duration":0.044786584999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":126,"num_read_kb":32004,"num_write":5275,"num_write_kb":842752,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,6],"acting":[3,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"28'2440","reported_seq":2480,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.358849+0000","last_change":"2024-05-10T05:18:40.358971+0000","last_active":"2024-05-10T05:18:40.358849+0000","last_peered":"2024-05-10T05:18:40.358849+0000","last_clean":"2024-05-10T05:18:40.358849+0000","last_became_active":"2024-05-10T04:51:52.134851+0000","last_became_peered":"2024-05-10T04:51:52.134851+0000","last_unstale":"2024-05-10T05:18:40.358849+0000","last_undegraded":"2024-05-10T05:18:40.358849+0000","last_fullsized":"2024-05-10T05:18:40.358849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2440","last_scrub_stamp":"2024-05-10T05:18:40.358819+0000","last_deep_scrub":"28'2440","last_deep_scrub_stamp":"2024-05-10T05:18:40.358819+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.358819+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:23.617166+0000","scrub_duration":0.0046993249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2445,"num_write_kb":22057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'2008","reported_seq":2047,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:51.331886+0000","last_change":"2024-05-10T05:18:51.332028+0000","last_active":"2024-05-10T05:18:51.331886+0000","last_peered":"2024-05-10T05:18:51.331886+0000","last_clean":"2024-05-10T05:18:51.331886+0000","last_became_active":"2024-05-10T04:51:52.753159+0000","last_became_peered":"2024-05-10T04:51:52.753159+0000","last_unstale":"2024-05-10T05:18:51.331886+0000","last_undegraded":"2024-05-10T05:18:51.331886+0000","last_fullsized":"2024-05-10T05:18:51.331886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2008","last_scrub_stamp":"2024-05-10T05:18:51.331859+0000","last_deep_scrub":"28'2008","last_deep_scrub_stamp":"2024-05-10T05:18:51.331859+0000","last_clean_scrub_stamp":"2024-05-10T05:18:51.331859+0000","objects_scrubbed":0,"log_size":2008,"log_dups_size":0,"ondisk_log_size":2008,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:55.750632+0000","scrub_duration":0.0023987499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"28'7423","reported_seq":7509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:21.266407+0000","last_change":"2024-05-10T05:19:21.266597+0000","last_active":"2024-05-10T05:19:21.266407+0000","last_peered":"2024-05-10T05:19:21.266407+0000","last_clean":"2024-05-10T05:19:21.266407+0000","last_became_active":"2024-05-10T04:51:57.174952+0000","last_became_peered":"2024-05-10T04:51:57.174952+0000","last_unstale":"2024-05-10T05:19:21.266407+0000","last_undegraded":"2024-05-10T05:19:21.266407+0000","last_fullsized":"2024-05-10T05:19:21.266407+0000","mapping_epoch":24,"log_start":"28'202","ondisk_log_start":"28'202","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7423","last_scrub_stamp":"2024-05-10T05:19:21.266365+0000","last_deep_scrub":"28'7423","last_deep_scrub_stamp":"2024-05-10T05:19:21.266365+0000","last_clean_scrub_stamp":"2024-05-10T05:19:21.266365+0000","objects_scrubbed":0,"log_size":7221,"log_dups_size":0,"ondisk_log_size":7221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:02:48.792579+0000","scrub_duration":0.035280334000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":12446,"num_write":5256,"num_write_kb":810960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"28'3410","reported_seq":3450,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.526731+0000","last_change":"2024-05-10T05:18:33.526835+0000","last_active":"2024-05-10T05:18:33.526731+0000","last_peered":"2024-05-10T05:18:33.526731+0000","last_clean":"2024-05-10T05:18:33.526731+0000","last_became_active":"2024-05-10T04:51:52.131270+0000","last_became_peered":"2024-05-10T04:51:52.131270+0000","last_unstale":"2024-05-10T05:18:33.526731+0000","last_undegraded":"2024-05-10T05:18:33.526731+0000","last_fullsized":"2024-05-10T05:18:33.526731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3410","last_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_deep_scrub":"28'3410","last_deep_scrub_stamp":"2024-05-10T05:18:33.526706+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.526706+0000","objects_scrubbed":6,"log_size":3410,"log_dups_size":0,"ondisk_log_size":3410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:03:30.870417+0000","scrub_duration":0.035523645,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3414,"num_write_kb":26805,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'2093","reported_seq":2126,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.501519+0000","last_change":"2024-05-10T05:19:01.501659+0000","last_active":"2024-05-10T05:19:01.501519+0000","last_peered":"2024-05-10T05:19:01.501519+0000","last_clean":"2024-05-10T05:19:01.501519+0000","last_became_active":"2024-05-10T04:52:40.334417+0000","last_became_peered":"2024-05-10T04:52:40.334417+0000","last_unstale":"2024-05-10T05:19:01.501519+0000","last_undegraded":"2024-05-10T05:19:01.501519+0000","last_fullsized":"2024-05-10T05:19:01.501519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2093","last_scrub_stamp":"2024-05-10T05:19:01.501471+0000","last_deep_scrub":"28'2093","last_deep_scrub_stamp":"2024-05-10T05:19:01.501471+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.501471+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:36:37.447977+0000","scrub_duration":0.0025676319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"28'7434","reported_seq":7508,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:03.787873+0000","last_change":"2024-05-10T05:19:03.788074+0000","last_active":"2024-05-10T05:19:03.787873+0000","last_peered":"2024-05-10T05:19:03.787873+0000","last_clean":"2024-05-10T05:19:03.787873+0000","last_became_active":"2024-05-10T04:51:57.174759+0000","last_became_peered":"2024-05-10T04:51:57.174759+0000","last_unstale":"2024-05-10T05:19:03.787873+0000","last_undegraded":"2024-05-10T05:19:03.787873+0000","last_fullsized":"2024-05-10T05:19:03.787873+0000","mapping_epoch":24,"log_start":"28'201","ondisk_log_start":"28'201","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7434","last_scrub_stamp":"2024-05-10T05:19:03.787843+0000","last_deep_scrub":"28'7434","last_deep_scrub_stamp":"2024-05-10T05:19:03.787843+0000","last_clean_scrub_stamp":"2024-05-10T05:19:03.787843+0000","objects_scrubbed":0,"log_size":7233,"log_dups_size":0,"ondisk_log_size":7233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:10:25.238453+0000","scrub_duration":0.031043378999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":9144,"num_write":5259,"num_write_kb":953625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"28'4732","reported_seq":4773,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.007422+0000","last_change":"2024-05-10T05:18:36.007422+0000","last_active":"2024-05-10T05:18:36.007422+0000","last_peered":"2024-05-10T05:18:36.007422+0000","last_clean":"2024-05-10T05:18:36.007422+0000","last_became_active":"2024-05-10T04:51:52.142834+0000","last_became_peered":"2024-05-10T04:51:52.142834+0000","last_unstale":"2024-05-10T05:18:36.007422+0000","last_undegraded":"2024-05-10T05:18:36.007422+0000","last_fullsized":"2024-05-10T05:18:36.007422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4732","last_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_deep_scrub":"28'4732","last_deep_scrub_stamp":"2024-05-10T05:18:36.007270+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.007270+0000","objects_scrubbed":4,"log_size":4732,"log_dups_size":0,"ondisk_log_size":4732,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:36.412434+0000","scrub_duration":0.047935197999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582934,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4731,"num_write_kb":35848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'2048","reported_seq":2088,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:05.564105+0000","last_change":"2024-05-10T05:19:05.564231+0000","last_active":"2024-05-10T05:19:05.564105+0000","last_peered":"2024-05-10T05:19:05.564105+0000","last_clean":"2024-05-10T05:19:05.564105+0000","last_became_active":"2024-05-10T04:51:52.775962+0000","last_became_peered":"2024-05-10T04:51:52.775962+0000","last_unstale":"2024-05-10T05:19:05.564105+0000","last_undegraded":"2024-05-10T05:19:05.564105+0000","last_fullsized":"2024-05-10T05:19:05.564105+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2048","last_scrub_stamp":"2024-05-10T05:19:05.564071+0000","last_deep_scrub":"28'2048","last_deep_scrub_stamp":"2024-05-10T05:19:05.564071+0000","last_clean_scrub_stamp":"2024-05-10T05:19:05.564071+0000","objects_scrubbed":0,"log_size":2048,"log_dups_size":0,"ondisk_log_size":2048,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:08:04.125916+0000","scrub_duration":0.0019698820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"28'7862","reported_seq":7941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:14.362311+0000","last_change":"2024-05-10T05:19:14.362547+0000","last_active":"2024-05-10T05:19:14.362311+0000","last_peered":"2024-05-10T05:19:14.362311+0000","last_clean":"2024-05-10T05:19:14.362311+0000","last_became_active":"2024-05-10T04:51:57.166261+0000","last_became_peered":"2024-05-10T04:51:57.166261+0000","last_unstale":"2024-05-10T05:19:14.362311+0000","last_undegraded":"2024-05-10T05:19:14.362311+0000","last_fullsized":"2024-05-10T05:19:14.362311+0000","mapping_epoch":24,"log_start":"28'500","ondisk_log_start":"28'500","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7862","last_scrub_stamp":"2024-05-10T05:19:14.362267+0000","last_deep_scrub":"28'7862","last_deep_scrub_stamp":"2024-05-10T05:19:14.362267+0000","last_clean_scrub_stamp":"2024-05-10T05:19:14.362267+0000","objects_scrubbed":0,"log_size":7362,"log_dups_size":0,"ondisk_log_size":7362,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:42.189769+0000","scrub_duration":0.043487314999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":10160,"num_write":5749,"num_write_kb":836489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"28'6065","reported_seq":6107,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.318485+0000","last_change":"2024-05-10T05:18:49.318485+0000","last_active":"2024-05-10T05:18:49.318485+0000","last_peered":"2024-05-10T05:18:49.318485+0000","last_clean":"2024-05-10T05:18:49.318485+0000","last_became_active":"2024-05-10T04:51:52.120273+0000","last_became_peered":"2024-05-10T04:51:52.120273+0000","last_unstale":"2024-05-10T05:18:49.318485+0000","last_undegraded":"2024-05-10T05:18:49.318485+0000","last_fullsized":"2024-05-10T05:18:49.318485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6065","last_scrub_stamp":"2024-05-10T05:18:49.318323+0000","last_deep_scrub":"28'6065","last_deep_scrub_stamp":"2024-05-10T05:18:49.318323+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.318323+0000","objects_scrubbed":2,"log_size":6065,"log_dups_size":0,"ondisk_log_size":6065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:32.576670+0000","scrub_duration":0.033539357999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6068,"num_write_kb":49040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'2026","reported_seq":2067,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:05.904631+0000","last_change":"2024-05-10T05:19:05.904631+0000","last_active":"2024-05-10T05:19:05.904631+0000","last_peered":"2024-05-10T05:19:05.904631+0000","last_clean":"2024-05-10T05:19:05.904631+0000","last_became_active":"2024-05-10T04:51:52.736890+0000","last_became_peered":"2024-05-10T04:51:52.736890+0000","last_unstale":"2024-05-10T05:19:05.904631+0000","last_undegraded":"2024-05-10T05:19:05.904631+0000","last_fullsized":"2024-05-10T05:19:05.904631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2026","last_scrub_stamp":"2024-05-10T05:19:05.904474+0000","last_deep_scrub":"28'2026","last_deep_scrub_stamp":"2024-05-10T05:19:05.904474+0000","last_clean_scrub_stamp":"2024-05-10T05:19:05.904474+0000","objects_scrubbed":0,"log_size":2026,"log_dups_size":0,"ondisk_log_size":2026,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:20.224651+0000","scrub_duration":0.0063328960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"28'8319","reported_seq":8424,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.342062+0000","last_change":"2024-05-10T05:19:01.342062+0000","last_active":"2024-05-10T05:19:01.342062+0000","last_peered":"2024-05-10T05:19:01.342062+0000","last_clean":"2024-05-10T05:19:01.342062+0000","last_became_active":"2024-05-10T04:51:57.179125+0000","last_became_peered":"2024-05-10T04:51:57.179125+0000","last_unstale":"2024-05-10T05:19:01.342062+0000","last_undegraded":"2024-05-10T05:19:01.342062+0000","last_fullsized":"2024-05-10T05:19:01.342062+0000","mapping_epoch":24,"log_start":"28'1000","ondisk_log_start":"28'1000","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'8319","last_scrub_stamp":"2024-05-10T05:19:01.341867+0000","last_deep_scrub":"28'8319","last_deep_scrub_stamp":"2024-05-10T05:19:01.341867+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.341867+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:42:22.189005+0000","scrub_duration":0.044138001000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":16764,"num_write":6167,"num_write_kb":990124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'7063","reported_seq":7105,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.933890+0000","last_change":"2024-05-10T05:18:44.933890+0000","last_active":"2024-05-10T05:18:44.933890+0000","last_peered":"2024-05-10T05:18:44.933890+0000","last_clean":"2024-05-10T05:18:44.933890+0000","last_became_active":"2024-05-10T04:51:52.130068+0000","last_became_peered":"2024-05-10T04:51:52.130068+0000","last_unstale":"2024-05-10T05:18:44.933890+0000","last_undegraded":"2024-05-10T05:18:44.933890+0000","last_fullsized":"2024-05-10T05:18:44.933890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7063","last_scrub_stamp":"2024-05-10T05:18:44.933739+0000","last_deep_scrub":"28'7063","last_deep_scrub_stamp":"2024-05-10T05:18:44.933739+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.933739+0000","objects_scrubbed":0,"log_size":7063,"log_dups_size":0,"ondisk_log_size":7063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:16:39.085930+0000","scrub_duration":0.0063213080000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":7059,"num_write_kb":53978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'2071","reported_seq":2112,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:46.916485+0000","last_change":"2024-05-10T05:18:46.916485+0000","last_active":"2024-05-10T05:18:46.916485+0000","last_peered":"2024-05-10T05:18:46.916485+0000","last_clean":"2024-05-10T05:18:46.916485+0000","last_became_active":"2024-05-10T04:51:52.762433+0000","last_became_peered":"2024-05-10T04:51:52.762433+0000","last_unstale":"2024-05-10T05:18:46.916485+0000","last_undegraded":"2024-05-10T05:18:46.916485+0000","last_fullsized":"2024-05-10T05:18:46.916485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2071","last_scrub_stamp":"2024-05-10T05:18:46.916337+0000","last_deep_scrub":"28'2071","last_deep_scrub_stamp":"2024-05-10T05:18:46.916337+0000","last_clean_scrub_stamp":"2024-05-10T05:18:46.916337+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:39:01.236515+0000","scrub_duration":0.0041311799999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"28'7419","reported_seq":7600,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:08.345716+0000","last_change":"2024-05-10T05:19:08.345879+0000","last_active":"2024-05-10T05:19:08.345716+0000","last_peered":"2024-05-10T05:19:08.345716+0000","last_clean":"2024-05-10T05:19:08.345716+0000","last_became_active":"2024-05-10T04:51:57.181822+0000","last_became_peered":"2024-05-10T04:51:57.181822+0000","last_unstale":"2024-05-10T05:19:08.345716+0000","last_undegraded":"2024-05-10T05:19:08.345716+0000","last_fullsized":"2024-05-10T05:19:08.345716+0000","mapping_epoch":24,"log_start":"28'100","ondisk_log_start":"28'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7419","last_scrub_stamp":"2024-05-10T05:19:08.345687+0000","last_deep_scrub":"28'7419","last_deep_scrub_stamp":"2024-05-10T05:19:08.345687+0000","last_clean_scrub_stamp":"2024-05-10T05:19:08.345687+0000","objects_scrubbed":0,"log_size":7319,"log_dups_size":0,"ondisk_log_size":7319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:46.430513+0000","scrub_duration":0.039549005999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":36322,"num_write":5259,"num_write_kb":874601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"28'2059","reported_seq":2100,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.256655+0000","last_change":"2024-05-10T05:18:57.256759+0000","last_active":"2024-05-10T05:18:57.256655+0000","last_peered":"2024-05-10T05:18:57.256655+0000","last_clean":"2024-05-10T05:18:57.256655+0000","last_became_active":"2024-05-10T04:51:52.737643+0000","last_became_peered":"2024-05-10T04:51:52.737643+0000","last_unstale":"2024-05-10T05:18:57.256655+0000","last_undegraded":"2024-05-10T05:18:57.256655+0000","last_fullsized":"2024-05-10T05:18:57.256655+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2059","last_scrub_stamp":"2024-05-10T05:18:57.256622+0000","last_deep_scrub":"28'2059","last_deep_scrub_stamp":"2024-05-10T05:18:57.256622+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.256622+0000","objects_scrubbed":0,"log_size":2059,"log_dups_size":0,"ondisk_log_size":2059,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:58:01.552730+0000","scrub_duration":0.0023702509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"28'5855","reported_seq":6621,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:43.443028+0000","last_change":"2024-05-10T05:18:43.443028+0000","last_active":"2024-05-10T05:18:43.443028+0000","last_peered":"2024-05-10T05:18:43.443028+0000","last_clean":"2024-05-10T05:18:43.443028+0000","last_became_active":"2024-05-10T04:51:52.136016+0000","last_became_peered":"2024-05-10T04:51:52.136016+0000","last_unstale":"2024-05-10T05:18:43.443028+0000","last_undegraded":"2024-05-10T05:18:43.443028+0000","last_fullsized":"2024-05-10T05:18:43.443028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5855","last_scrub_stamp":"2024-05-10T05:18:43.442882+0000","last_deep_scrub":"28'5855","last_deep_scrub_stamp":"2024-05-10T05:18:43.442882+0000","last_clean_scrub_stamp":"2024-05-10T05:18:43.442882+0000","objects_scrubbed":0,"log_size":5855,"log_dups_size":0,"ondisk_log_size":5855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:57.851745+0000","scrub_duration":0.0054037529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":4559,"num_write":5861,"num_write_kb":44842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"28'7465","reported_seq":7609,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:21.486047+0000","last_change":"2024-05-10T05:19:21.486216+0000","last_active":"2024-05-10T05:19:21.486047+0000","last_peered":"2024-05-10T05:19:21.486047+0000","last_clean":"2024-05-10T05:19:21.486047+0000","last_became_active":"2024-05-10T04:51:57.215855+0000","last_became_peered":"2024-05-10T04:51:57.215855+0000","last_unstale":"2024-05-10T05:19:21.486047+0000","last_undegraded":"2024-05-10T05:19:21.486047+0000","last_fullsized":"2024-05-10T05:19:21.486047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7465","last_scrub_stamp":"2024-05-10T05:19:21.486015+0000","last_deep_scrub":"28'7465","last_deep_scrub_stamp":"2024-05-10T05:19:21.486015+0000","last_clean_scrub_stamp":"2024-05-10T05:19:21.486015+0000","objects_scrubbed":0,"log_size":7465,"log_dups_size":0,"ondisk_log_size":7465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:48:00.913460+0000","scrub_duration":0.046782592999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":26670,"num_write":5392,"num_write_kb":927769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"28'2085","reported_seq":2126,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:11.978282+0000","last_change":"2024-05-10T05:19:11.978482+0000","last_active":"2024-05-10T05:19:11.978282+0000","last_peered":"2024-05-10T05:19:11.978282+0000","last_clean":"2024-05-10T05:19:11.978282+0000","last_became_active":"2024-05-10T04:51:52.731459+0000","last_became_peered":"2024-05-10T04:51:52.731459+0000","last_unstale":"2024-05-10T05:19:11.978282+0000","last_undegraded":"2024-05-10T05:19:11.978282+0000","last_fullsized":"2024-05-10T05:19:11.978282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2085","last_scrub_stamp":"2024-05-10T05:19:11.978235+0000","last_deep_scrub":"28'2085","last_deep_scrub_stamp":"2024-05-10T05:19:11.978235+0000","last_clean_scrub_stamp":"2024-05-10T05:19:11.978235+0000","objects_scrubbed":0,"log_size":2085,"log_dups_size":0,"ondisk_log_size":2085,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:50.491529+0000","scrub_duration":0.0025443800000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"28'4532","reported_seq":4574,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.037113+0000","last_change":"2024-05-10T05:18:41.037113+0000","last_active":"2024-05-10T05:18:41.037113+0000","last_peered":"2024-05-10T05:18:41.037113+0000","last_clean":"2024-05-10T05:18:41.037113+0000","last_became_active":"2024-05-10T04:51:52.137148+0000","last_became_peered":"2024-05-10T04:51:52.137148+0000","last_unstale":"2024-05-10T05:18:41.037113+0000","last_undegraded":"2024-05-10T05:18:41.037113+0000","last_fullsized":"2024-05-10T05:18:41.037113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4532","last_scrub_stamp":"2024-05-10T05:18:41.036968+0000","last_deep_scrub":"28'4532","last_deep_scrub_stamp":"2024-05-10T05:18:41.036968+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.036968+0000","objects_scrubbed":0,"log_size":4532,"log_dups_size":0,"ondisk_log_size":4532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:17.427232+0000","scrub_duration":0.0040866000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4533,"num_write_kb":35766,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":197,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.548160+0000","last_change":"2024-05-10T05:18:44.548319+0000","last_active":"2024-05-10T05:18:44.548160+0000","last_peered":"2024-05-10T05:18:44.548160+0000","last_clean":"2024-05-10T05:18:44.548160+0000","last_became_active":"2024-05-10T04:51:47.443393+0000","last_became_peered":"2024-05-10T04:51:47.443393+0000","last_unstale":"2024-05-10T05:18:44.548160+0000","last_undegraded":"2024-05-10T05:18:44.548160+0000","last_fullsized":"2024-05-10T05:18:44.548160+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-05-10T05:18:44.548136+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-05-10T05:18:44.548136+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.548136+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:11.519311+0000","scrub_duration":0.0075957919999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"28'7749","reported_seq":7852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:20.226547+0000","last_change":"2024-05-10T05:19:20.226714+0000","last_active":"2024-05-10T05:19:20.226547+0000","last_peered":"2024-05-10T05:19:20.226547+0000","last_clean":"2024-05-10T05:19:20.226547+0000","last_became_active":"2024-05-10T04:51:57.219633+0000","last_became_peered":"2024-05-10T04:51:57.219633+0000","last_unstale":"2024-05-10T05:19:20.226547+0000","last_undegraded":"2024-05-10T05:19:20.226547+0000","last_fullsized":"2024-05-10T05:19:20.226547+0000","mapping_epoch":24,"log_start":"28'519","ondisk_log_start":"28'519","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7749","last_scrub_stamp":"2024-05-10T05:19:20.226515+0000","last_deep_scrub":"28'7749","last_deep_scrub_stamp":"2024-05-10T05:19:20.226515+0000","last_clean_scrub_stamp":"2024-05-10T05:19:20.226515+0000","objects_scrubbed":0,"log_size":7230,"log_dups_size":0,"ondisk_log_size":7230,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T05:37:46.899712+0000","scrub_duration":0.031611673999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":16510,"num_write":5630,"num_write_kb":894989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"28'1994","reported_seq":2035,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.210587+0000","last_change":"2024-05-10T05:18:40.210587+0000","last_active":"2024-05-10T05:18:40.210587+0000","last_peered":"2024-05-10T05:18:40.210587+0000","last_clean":"2024-05-10T05:18:40.210587+0000","last_became_active":"2024-05-10T04:51:52.756656+0000","last_became_peered":"2024-05-10T04:51:52.756656+0000","last_unstale":"2024-05-10T05:18:40.210587+0000","last_undegraded":"2024-05-10T05:18:40.210587+0000","last_fullsized":"2024-05-10T05:18:40.210587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1994","last_scrub_stamp":"2024-05-10T05:18:40.210380+0000","last_deep_scrub":"28'1994","last_deep_scrub_stamp":"2024-05-10T05:18:40.210380+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.210380+0000","objects_scrubbed":0,"log_size":1994,"log_dups_size":0,"ondisk_log_size":1994,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:37:44.629153+0000","scrub_duration":0.002471778,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"28'6535","reported_seq":6577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:45.611659+0000","last_change":"2024-05-10T05:18:45.611799+0000","last_active":"2024-05-10T05:18:45.611659+0000","last_peered":"2024-05-10T05:18:45.611659+0000","last_clean":"2024-05-10T05:18:45.611659+0000","last_became_active":"2024-05-10T04:51:52.146068+0000","last_became_peered":"2024-05-10T04:51:52.146068+0000","last_unstale":"2024-05-10T05:18:45.611659+0000","last_undegraded":"2024-05-10T05:18:45.611659+0000","last_fullsized":"2024-05-10T05:18:45.611659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6535","last_scrub_stamp":"2024-05-10T05:18:45.611628+0000","last_deep_scrub":"28'6535","last_deep_scrub_stamp":"2024-05-10T05:18:45.611628+0000","last_clean_scrub_stamp":"2024-05-10T05:18:45.611628+0000","objects_scrubbed":1,"log_size":6535,"log_dups_size":0,"ondisk_log_size":6535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:51:28.869976+0000","scrub_duration":0.023044243999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":6538,"num_write_kb":49451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"28'7586","reported_seq":7706,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:12.226707+0000","last_change":"2024-05-10T05:19:12.226869+0000","last_active":"2024-05-10T05:19:12.226707+0000","last_peered":"2024-05-10T05:19:12.226707+0000","last_clean":"2024-05-10T05:19:12.226707+0000","last_became_active":"2024-05-10T04:51:57.217700+0000","last_became_peered":"2024-05-10T04:51:57.217700+0000","last_unstale":"2024-05-10T05:19:12.226707+0000","last_undegraded":"2024-05-10T05:19:12.226707+0000","last_fullsized":"2024-05-10T05:19:12.226707+0000","mapping_epoch":24,"log_start":"28'400","ondisk_log_start":"28'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7586","last_scrub_stamp":"2024-05-10T05:19:12.226679+0000","last_deep_scrub":"28'7586","last_deep_scrub_stamp":"2024-05-10T05:19:12.226679+0000","last_clean_scrub_stamp":"2024-05-10T05:19:12.226679+0000","objects_scrubbed":0,"log_size":7186,"log_dups_size":0,"ondisk_log_size":7186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:26:48.280265+0000","scrub_duration":0.036866283999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":20574,"num_write":5406,"num_write_kb":841072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"28'4968","reported_seq":5010,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:53.652387+0000","last_change":"2024-05-10T05:18:53.652387+0000","last_active":"2024-05-10T05:18:53.652387+0000","last_peered":"2024-05-10T05:18:53.652387+0000","last_clean":"2024-05-10T05:18:53.652387+0000","last_became_active":"2024-05-10T04:51:52.146556+0000","last_became_peered":"2024-05-10T04:51:52.146556+0000","last_unstale":"2024-05-10T05:18:53.652387+0000","last_undegraded":"2024-05-10T05:18:53.652387+0000","last_fullsized":"2024-05-10T05:18:53.652387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4968","last_scrub_stamp":"2024-05-10T05:18:53.652243+0000","last_deep_scrub":"28'4968","last_deep_scrub_stamp":"2024-05-10T05:18:53.652243+0000","last_clean_scrub_stamp":"2024-05-10T05:18:53.652243+0000","objects_scrubbed":1,"log_size":4968,"log_dups_size":0,"ondisk_log_size":4968,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:57:57.948351+0000","scrub_duration":0.020192067000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":4970,"num_write_kb":40280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'2075","reported_seq":2116,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:33.267598+0000","last_change":"2024-05-10T05:18:33.267598+0000","last_active":"2024-05-10T05:18:33.267598+0000","last_peered":"2024-05-10T05:18:33.267598+0000","last_clean":"2024-05-10T05:18:33.267598+0000","last_became_active":"2024-05-10T04:51:52.737633+0000","last_became_peered":"2024-05-10T04:51:52.737633+0000","last_unstale":"2024-05-10T05:18:33.267598+0000","last_undegraded":"2024-05-10T05:18:33.267598+0000","last_fullsized":"2024-05-10T05:18:33.267598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2075","last_scrub_stamp":"2024-05-10T05:18:33.267453+0000","last_deep_scrub":"28'2075","last_deep_scrub_stamp":"2024-05-10T05:18:33.267453+0000","last_clean_scrub_stamp":"2024-05-10T05:18:33.267453+0000","objects_scrubbed":0,"log_size":2075,"log_dups_size":0,"ondisk_log_size":2075,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:37:20.868771+0000","scrub_duration":0.017069349000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"28'7178","reported_seq":7235,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:19.123530+0000","last_change":"2024-05-10T05:19:19.123684+0000","last_active":"2024-05-10T05:19:19.123530+0000","last_peered":"2024-05-10T05:19:19.123530+0000","last_clean":"2024-05-10T05:19:19.123530+0000","last_became_active":"2024-05-10T04:51:57.220526+0000","last_became_peered":"2024-05-10T04:51:57.220526+0000","last_unstale":"2024-05-10T05:19:19.123530+0000","last_undegraded":"2024-05-10T05:19:19.123530+0000","last_fullsized":"2024-05-10T05:19:19.123530+0000","mapping_epoch":24,"log_start":"28'902","ondisk_log_start":"28'902","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7178","last_scrub_stamp":"2024-05-10T05:19:19.123499+0000","last_deep_scrub":"28'7178","last_deep_scrub_stamp":"2024-05-10T05:19:19.123499+0000","last_clean_scrub_stamp":"2024-05-10T05:19:19.123499+0000","objects_scrubbed":0,"log_size":6276,"log_dups_size":0,"ondisk_log_size":6276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:48:13.782451+0000","scrub_duration":0.057477264,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":4572,"num_write":5018,"num_write_kb":931856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"28'4519","reported_seq":4813,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:48.364492+0000","last_change":"2024-05-10T05:18:48.364602+0000","last_active":"2024-05-10T05:18:48.364492+0000","last_peered":"2024-05-10T05:18:48.364492+0000","last_clean":"2024-05-10T05:18:48.364492+0000","last_became_active":"2024-05-10T04:51:52.139613+0000","last_became_peered":"2024-05-10T04:51:52.139613+0000","last_unstale":"2024-05-10T05:18:48.364492+0000","last_undegraded":"2024-05-10T05:18:48.364492+0000","last_fullsized":"2024-05-10T05:18:48.364492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4519","last_scrub_stamp":"2024-05-10T05:18:48.364462+0000","last_deep_scrub":"28'4519","last_deep_scrub_stamp":"2024-05-10T05:18:48.364462+0000","last_clean_scrub_stamp":"2024-05-10T05:18:48.364462+0000","objects_scrubbed":3,"log_size":4519,"log_dups_size":0,"ondisk_log_size":4519,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T17:00:15.335637+0000","scrub_duration":0.059862429000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5706142,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":253,"num_read_kb":1647,"num_write":5099,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'1997","reported_seq":2037,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.008916+0000","last_change":"2024-05-10T05:18:42.009047+0000","last_active":"2024-05-10T05:18:42.008916+0000","last_peered":"2024-05-10T05:18:42.008916+0000","last_clean":"2024-05-10T05:18:42.008916+0000","last_became_active":"2024-05-10T04:51:52.766399+0000","last_became_peered":"2024-05-10T04:51:52.766399+0000","last_unstale":"2024-05-10T05:18:42.008916+0000","last_undegraded":"2024-05-10T05:18:42.008916+0000","last_fullsized":"2024-05-10T05:18:42.008916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1997","last_scrub_stamp":"2024-05-10T05:18:42.008888+0000","last_deep_scrub":"28'1997","last_deep_scrub_stamp":"2024-05-10T05:18:42.008888+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.008888+0000","objects_scrubbed":0,"log_size":1997,"log_dups_size":0,"ondisk_log_size":1997,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:46:36.252444+0000","scrub_duration":0.016990521000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"28'7757","reported_seq":7852,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.977553+0000","last_change":"2024-05-10T05:18:47.977553+0000","last_active":"2024-05-10T05:18:47.977553+0000","last_peered":"2024-05-10T05:18:47.977553+0000","last_clean":"2024-05-10T05:18:47.977553+0000","last_became_active":"2024-05-10T04:51:57.222511+0000","last_became_peered":"2024-05-10T04:51:57.222511+0000","last_unstale":"2024-05-10T05:18:47.977553+0000","last_undegraded":"2024-05-10T05:18:47.977553+0000","last_fullsized":"2024-05-10T05:18:47.977553+0000","mapping_epoch":24,"log_start":"28'600","ondisk_log_start":"28'600","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7757","last_scrub_stamp":"2024-05-10T05:18:47.977339+0000","last_deep_scrub":"28'7757","last_deep_scrub_stamp":"2024-05-10T05:18:47.977339+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.977339+0000","objects_scrubbed":0,"log_size":7157,"log_dups_size":0,"ondisk_log_size":7157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:43.761125+0000","scrub_duration":0.049427395999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":14224,"num_write":5627,"num_write_kb":856310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"28'2931","reported_seq":2972,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:47.296272+0000","last_change":"2024-05-10T05:18:47.296396+0000","last_active":"2024-05-10T05:18:47.296272+0000","last_peered":"2024-05-10T05:18:47.296272+0000","last_clean":"2024-05-10T05:18:47.296272+0000","last_became_active":"2024-05-10T04:51:52.144545+0000","last_became_peered":"2024-05-10T04:51:52.144545+0000","last_unstale":"2024-05-10T05:18:47.296272+0000","last_undegraded":"2024-05-10T05:18:47.296272+0000","last_fullsized":"2024-05-10T05:18:47.296272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2931","last_scrub_stamp":"2024-05-10T05:18:47.296244+0000","last_deep_scrub":"28'2931","last_deep_scrub_stamp":"2024-05-10T05:18:47.296244+0000","last_clean_scrub_stamp":"2024-05-10T05:18:47.296244+0000","objects_scrubbed":2,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:46.247263+0000","scrub_duration":0.0070847059999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":0,"num_write":2952,"num_write_kb":22479,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":558,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'2041","reported_seq":2081,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:50.301111+0000","last_change":"2024-05-10T05:18:50.301225+0000","last_active":"2024-05-10T05:18:50.301111+0000","last_peered":"2024-05-10T05:18:50.301111+0000","last_clean":"2024-05-10T05:18:50.301111+0000","last_became_active":"2024-05-10T04:51:52.741243+0000","last_became_peered":"2024-05-10T04:51:52.741243+0000","last_unstale":"2024-05-10T05:18:50.301111+0000","last_undegraded":"2024-05-10T05:18:50.301111+0000","last_fullsized":"2024-05-10T05:18:50.301111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2041","last_scrub_stamp":"2024-05-10T05:18:50.301080+0000","last_deep_scrub":"28'2041","last_deep_scrub_stamp":"2024-05-10T05:18:50.301080+0000","last_clean_scrub_stamp":"2024-05-10T05:18:50.301080+0000","objects_scrubbed":0,"log_size":2041,"log_dups_size":0,"ondisk_log_size":2041,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:27.336905+0000","scrub_duration":0.011476890999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"28'7497","reported_seq":7582,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.863073+0000","last_change":"2024-05-10T05:18:57.863073+0000","last_active":"2024-05-10T05:18:57.863073+0000","last_peered":"2024-05-10T05:18:57.863073+0000","last_clean":"2024-05-10T05:18:57.863073+0000","last_became_active":"2024-05-10T04:51:57.176621+0000","last_became_peered":"2024-05-10T04:51:57.176621+0000","last_unstale":"2024-05-10T05:18:57.863073+0000","last_undegraded":"2024-05-10T05:18:57.863073+0000","last_fullsized":"2024-05-10T05:18:57.863073+0000","mapping_epoch":24,"log_start":"28'304","ondisk_log_start":"28'304","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7497","last_scrub_stamp":"2024-05-10T05:18:57.862888+0000","last_deep_scrub":"28'7497","last_deep_scrub_stamp":"2024-05-10T05:18:57.862888+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.862888+0000","objects_scrubbed":0,"log_size":7193,"log_dups_size":0,"ondisk_log_size":7193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:17:45.044046+0000","scrub_duration":0.040099164,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":11938,"num_write":5407,"num_write_kb":1012008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"28'2708","reported_seq":2749,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:54.649392+0000","last_change":"2024-05-10T05:18:54.649532+0000","last_active":"2024-05-10T05:18:54.649392+0000","last_peered":"2024-05-10T05:18:54.649392+0000","last_clean":"2024-05-10T05:18:54.649392+0000","last_became_active":"2024-05-10T04:51:52.147216+0000","last_became_peered":"2024-05-10T04:51:52.147216+0000","last_unstale":"2024-05-10T05:18:54.649392+0000","last_undegraded":"2024-05-10T05:18:54.649392+0000","last_fullsized":"2024-05-10T05:18:54.649392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2708","last_scrub_stamp":"2024-05-10T05:18:54.649367+0000","last_deep_scrub":"28'2708","last_deep_scrub_stamp":"2024-05-10T05:18:54.649367+0000","last_clean_scrub_stamp":"2024-05-10T05:18:54.649367+0000","objects_scrubbed":1,"log_size":2708,"log_dups_size":0,"ondisk_log_size":2708,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:25:05.916668+0000","scrub_duration":0.017949637000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2712,"num_write_kb":18238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:37.881619+0000","last_change":"2024-05-10T05:18:37.881727+0000","last_active":"2024-05-10T05:18:37.881619+0000","last_peered":"2024-05-10T05:18:37.881619+0000","last_clean":"2024-05-10T05:18:37.881619+0000","last_became_active":"2024-05-10T04:51:52.742112+0000","last_became_peered":"2024-05-10T04:51:52.742112+0000","last_unstale":"2024-05-10T05:18:37.881619+0000","last_undegraded":"2024-05-10T05:18:37.881619+0000","last_fullsized":"2024-05-10T05:18:37.881619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:18:37.881586+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:18:37.881586+0000","last_clean_scrub_stamp":"2024-05-10T05:18:37.881586+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:36:53.582798+0000","scrub_duration":0.002159762,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"28'7287","reported_seq":7386,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:02.362902+0000","last_change":"2024-05-10T05:19:02.362902+0000","last_active":"2024-05-10T05:19:02.362902+0000","last_peered":"2024-05-10T05:19:02.362902+0000","last_clean":"2024-05-10T05:19:02.362902+0000","last_became_active":"2024-05-10T04:51:57.217749+0000","last_became_peered":"2024-05-10T04:51:57.217749+0000","last_unstale":"2024-05-10T05:19:02.362902+0000","last_undegraded":"2024-05-10T05:19:02.362902+0000","last_fullsized":"2024-05-10T05:19:02.362902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7287","last_scrub_stamp":"2024-05-10T05:19:02.362713+0000","last_deep_scrub":"28'7287","last_deep_scrub_stamp":"2024-05-10T05:19:02.362713+0000","last_clean_scrub_stamp":"2024-05-10T05:19:02.362713+0000","objects_scrubbed":0,"log_size":7287,"log_dups_size":0,"ondisk_log_size":7287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:42.368270+0000","scrub_duration":0.045147409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":15494,"num_write":5174,"num_write_kb":997273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"28'3613","reported_seq":3654,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:39.263553+0000","last_change":"2024-05-10T05:18:39.263719+0000","last_active":"2024-05-10T05:18:39.263553+0000","last_peered":"2024-05-10T05:18:39.263553+0000","last_clean":"2024-05-10T05:18:39.263553+0000","last_became_active":"2024-05-10T04:51:52.142843+0000","last_became_peered":"2024-05-10T04:51:52.142843+0000","last_unstale":"2024-05-10T05:18:39.263553+0000","last_undegraded":"2024-05-10T05:18:39.263553+0000","last_fullsized":"2024-05-10T05:18:39.263553+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3613","last_scrub_stamp":"2024-05-10T05:18:39.263524+0000","last_deep_scrub":"28'3613","last_deep_scrub_stamp":"2024-05-10T05:18:39.263524+0000","last_clean_scrub_stamp":"2024-05-10T05:18:39.263524+0000","objects_scrubbed":1,"log_size":3613,"log_dups_size":0,"ondisk_log_size":3613,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:32:02.820674+0000","scrub_duration":0.020627962999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":3630,"num_write_kb":23009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'2116","reported_seq":2156,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.975579+0000","last_change":"2024-05-10T05:18:40.975713+0000","last_active":"2024-05-10T05:18:40.975579+0000","last_peered":"2024-05-10T05:18:40.975579+0000","last_clean":"2024-05-10T05:18:40.975579+0000","last_became_active":"2024-05-10T04:51:52.740725+0000","last_became_peered":"2024-05-10T04:51:52.740725+0000","last_unstale":"2024-05-10T05:18:40.975579+0000","last_undegraded":"2024-05-10T05:18:40.975579+0000","last_fullsized":"2024-05-10T05:18:40.975579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2116","last_scrub_stamp":"2024-05-10T05:18:40.975550+0000","last_deep_scrub":"28'2116","last_deep_scrub_stamp":"2024-05-10T05:18:40.975550+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.975550+0000","objects_scrubbed":0,"log_size":2116,"log_dups_size":0,"ondisk_log_size":2116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:14:39.926569+0000","scrub_duration":0.011021167,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"28'7396","reported_seq":7439,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:10.891130+0000","last_change":"2024-05-10T05:19:10.891326+0000","last_active":"2024-05-10T05:19:10.891130+0000","last_peered":"2024-05-10T05:19:10.891130+0000","last_clean":"2024-05-10T05:19:10.891130+0000","last_became_active":"2024-05-10T04:51:57.179110+0000","last_became_peered":"2024-05-10T04:51:57.179110+0000","last_unstale":"2024-05-10T05:19:10.891130+0000","last_undegraded":"2024-05-10T05:19:10.891130+0000","last_fullsized":"2024-05-10T05:19:10.891130+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7396","last_scrub_stamp":"2024-05-10T05:19:10.891101+0000","last_deep_scrub":"28'7396","last_deep_scrub_stamp":"2024-05-10T05:19:10.891101+0000","last_clean_scrub_stamp":"2024-05-10T05:19:10.891101+0000","objects_scrubbed":0,"log_size":7196,"log_dups_size":0,"ondisk_log_size":7196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:12:10.388954+0000","scrub_duration":0.049185287000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1270,"num_write":5220,"num_write_kb":971968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"28'6721","reported_seq":6762,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:42.335234+0000","last_change":"2024-05-10T05:18:42.335383+0000","last_active":"2024-05-10T05:18:42.335234+0000","last_peered":"2024-05-10T05:18:42.335234+0000","last_clean":"2024-05-10T05:18:42.335234+0000","last_became_active":"2024-05-10T04:51:52.129083+0000","last_became_peered":"2024-05-10T04:51:52.129083+0000","last_unstale":"2024-05-10T05:18:42.335234+0000","last_undegraded":"2024-05-10T05:18:42.335234+0000","last_fullsized":"2024-05-10T05:18:42.335234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6721","last_scrub_stamp":"2024-05-10T05:18:42.335206+0000","last_deep_scrub":"28'6721","last_deep_scrub_stamp":"2024-05-10T05:18:42.335206+0000","last_clean_scrub_stamp":"2024-05-10T05:18:42.335206+0000","objects_scrubbed":3,"log_size":6721,"log_dups_size":0,"ondisk_log_size":6721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:29:29.735051+0000","scrub_duration":0.047016694999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6710,"num_write_kb":49589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'2079","reported_seq":2112,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:57.494095+0000","last_change":"2024-05-10T05:18:57.494216+0000","last_active":"2024-05-10T05:18:57.494095+0000","last_peered":"2024-05-10T05:18:57.494095+0000","last_clean":"2024-05-10T05:18:57.494095+0000","last_became_active":"2024-05-10T04:52:40.334839+0000","last_became_peered":"2024-05-10T04:52:40.334839+0000","last_unstale":"2024-05-10T05:18:57.494095+0000","last_undegraded":"2024-05-10T05:18:57.494095+0000","last_fullsized":"2024-05-10T05:18:57.494095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2079","last_scrub_stamp":"2024-05-10T05:18:57.494070+0000","last_deep_scrub":"28'2079","last_deep_scrub_stamp":"2024-05-10T05:18:57.494070+0000","last_clean_scrub_stamp":"2024-05-10T05:18:57.494070+0000","objects_scrubbed":0,"log_size":2079,"log_dups_size":0,"ondisk_log_size":2079,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:37:13.195282+0000","scrub_duration":0.031925811999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"28'7752","reported_seq":7882,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:08.840996+0000","last_change":"2024-05-10T05:19:08.841154+0000","last_active":"2024-05-10T05:19:08.840996+0000","last_peered":"2024-05-10T05:19:08.840996+0000","last_clean":"2024-05-10T05:19:08.840996+0000","last_became_active":"2024-05-10T04:51:57.165130+0000","last_became_peered":"2024-05-10T04:51:57.165130+0000","last_unstale":"2024-05-10T05:19:08.840996+0000","last_undegraded":"2024-05-10T05:19:08.840996+0000","last_fullsized":"2024-05-10T05:19:08.840996+0000","mapping_epoch":24,"log_start":"28'605","ondisk_log_start":"28'605","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7752","last_scrub_stamp":"2024-05-10T05:19:08.840966+0000","last_deep_scrub":"28'7752","last_deep_scrub_stamp":"2024-05-10T05:19:08.840966+0000","last_clean_scrub_stamp":"2024-05-10T05:19:08.840966+0000","objects_scrubbed":0,"log_size":7147,"log_dups_size":0,"ondisk_log_size":7147,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:38:25.754207+0000","scrub_duration":0.044890948999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":23368,"num_write":5570,"num_write_kb":863403,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"28'6912","reported_seq":6953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:49.639748+0000","last_change":"2024-05-10T05:18:49.639748+0000","last_active":"2024-05-10T05:18:49.639748+0000","last_peered":"2024-05-10T05:18:49.639748+0000","last_clean":"2024-05-10T05:18:49.639748+0000","last_became_active":"2024-05-10T04:51:52.149178+0000","last_became_peered":"2024-05-10T04:51:52.149178+0000","last_unstale":"2024-05-10T05:18:49.639748+0000","last_undegraded":"2024-05-10T05:18:49.639748+0000","last_fullsized":"2024-05-10T05:18:49.639748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6912","last_scrub_stamp":"2024-05-10T05:18:49.639590+0000","last_deep_scrub":"28'6912","last_deep_scrub_stamp":"2024-05-10T05:18:49.639590+0000","last_clean_scrub_stamp":"2024-05-10T05:18:49.639590+0000","objects_scrubbed":1,"log_size":6912,"log_dups_size":0,"ondisk_log_size":6912,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:49.364440+0000","scrub_duration":0.0094499939999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":0,"num_write":6927,"num_write_kb":41725,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":264,"num_omap_keys":1,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'2069","reported_seq":2109,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:00.307433+0000","last_change":"2024-05-10T05:19:00.307558+0000","last_active":"2024-05-10T05:19:00.307433+0000","last_peered":"2024-05-10T05:19:00.307433+0000","last_clean":"2024-05-10T05:19:00.307433+0000","last_became_active":"2024-05-10T04:51:52.750904+0000","last_became_peered":"2024-05-10T04:51:52.750904+0000","last_unstale":"2024-05-10T05:19:00.307433+0000","last_undegraded":"2024-05-10T05:19:00.307433+0000","last_fullsized":"2024-05-10T05:19:00.307433+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2069","last_scrub_stamp":"2024-05-10T05:19:00.307404+0000","last_deep_scrub":"28'2069","last_deep_scrub_stamp":"2024-05-10T05:19:00.307404+0000","last_clean_scrub_stamp":"2024-05-10T05:19:00.307404+0000","objects_scrubbed":0,"log_size":2069,"log_dups_size":0,"ondisk_log_size":2069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:21:38.392230+0000","scrub_duration":0.0020700440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"28'7329","reported_seq":7426,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:20.434486+0000","last_change":"2024-05-10T05:19:20.434699+0000","last_active":"2024-05-10T05:19:20.434486+0000","last_peered":"2024-05-10T05:19:20.434486+0000","last_clean":"2024-05-10T05:19:20.434486+0000","last_became_active":"2024-05-10T04:51:57.221877+0000","last_became_peered":"2024-05-10T04:51:57.221877+0000","last_unstale":"2024-05-10T05:19:20.434486+0000","last_undegraded":"2024-05-10T05:19:20.434486+0000","last_fullsized":"2024-05-10T05:19:20.434486+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7329","last_scrub_stamp":"2024-05-10T05:19:20.434458+0000","last_deep_scrub":"28'7329","last_deep_scrub_stamp":"2024-05-10T05:19:20.434458+0000","last_clean_scrub_stamp":"2024-05-10T05:19:20.434458+0000","objects_scrubbed":0,"log_size":7329,"log_dups_size":0,"ondisk_log_size":7329,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T13:08:39.646892+0000","scrub_duration":0.035202555000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":14986,"num_write":5084,"num_write_kb":843531,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"28'5972","reported_seq":6013,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.480749+0000","last_change":"2024-05-10T05:18:41.480749+0000","last_active":"2024-05-10T05:18:41.480749+0000","last_peered":"2024-05-10T05:18:41.480749+0000","last_clean":"2024-05-10T05:18:41.480749+0000","last_became_active":"2024-05-10T04:51:52.137525+0000","last_became_peered":"2024-05-10T04:51:52.137525+0000","last_unstale":"2024-05-10T05:18:41.480749+0000","last_undegraded":"2024-05-10T05:18:41.480749+0000","last_fullsized":"2024-05-10T05:18:41.480749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5972","last_scrub_stamp":"2024-05-10T05:18:41.480563+0000","last_deep_scrub":"28'5972","last_deep_scrub_stamp":"2024-05-10T05:18:41.480563+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.480563+0000","objects_scrubbed":2,"log_size":5972,"log_dups_size":0,"ondisk_log_size":5972,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:54:23.660604+0000","scrub_duration":0.035130757999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5960,"num_write_kb":44904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'2043","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:58.534619+0000","last_change":"2024-05-10T05:18:58.534743+0000","last_active":"2024-05-10T05:18:58.534619+0000","last_peered":"2024-05-10T05:18:58.534619+0000","last_clean":"2024-05-10T05:18:58.534619+0000","last_became_active":"2024-05-10T04:51:52.771641+0000","last_became_peered":"2024-05-10T04:51:52.771641+0000","last_unstale":"2024-05-10T05:18:58.534619+0000","last_undegraded":"2024-05-10T05:18:58.534619+0000","last_fullsized":"2024-05-10T05:18:58.534619+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2043","last_scrub_stamp":"2024-05-10T05:18:58.534593+0000","last_deep_scrub":"28'2043","last_deep_scrub_stamp":"2024-05-10T05:18:58.534593+0000","last_clean_scrub_stamp":"2024-05-10T05:18:58.534593+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:38:35.724201+0000","scrub_duration":0.0048393849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"28'7895","reported_seq":8012,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:17.260959+0000","last_change":"2024-05-10T05:19:17.261120+0000","last_active":"2024-05-10T05:19:17.260959+0000","last_peered":"2024-05-10T05:19:17.260959+0000","last_clean":"2024-05-10T05:19:17.260959+0000","last_became_active":"2024-05-10T04:52:40.388669+0000","last_became_peered":"2024-05-10T04:52:40.388669+0000","last_unstale":"2024-05-10T05:19:17.260959+0000","last_undegraded":"2024-05-10T05:19:17.260959+0000","last_fullsized":"2024-05-10T05:19:17.260959+0000","mapping_epoch":27,"log_start":"28'706","ondisk_log_start":"28'706","created":24,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7895","last_scrub_stamp":"2024-05-10T05:19:17.260927+0000","last_deep_scrub":"28'7895","last_deep_scrub_stamp":"2024-05-10T05:19:17.260927+0000","last_clean_scrub_stamp":"2024-05-10T05:19:17.260927+0000","objects_scrubbed":0,"log_size":7189,"log_dups_size":0,"ondisk_log_size":7189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T07:09:11.105652+0000","scrub_duration":0.030214147,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":17526,"num_write":5700,"num_write_kb":1007695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,5],"acting":[0,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"28'7942","reported_seq":7983,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:41.319114+0000","last_change":"2024-05-10T05:18:41.319114+0000","last_active":"2024-05-10T05:18:41.319114+0000","last_peered":"2024-05-10T05:18:41.319114+0000","last_clean":"2024-05-10T05:18:41.319114+0000","last_became_active":"2024-05-10T04:51:52.132908+0000","last_became_peered":"2024-05-10T04:51:52.132908+0000","last_unstale":"2024-05-10T05:18:41.319114+0000","last_undegraded":"2024-05-10T05:18:41.319114+0000","last_fullsized":"2024-05-10T05:18:41.319114+0000","mapping_epoch":19,"log_start":"28'600","ondisk_log_start":"28'600","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7942","last_scrub_stamp":"2024-05-10T05:18:41.318956+0000","last_deep_scrub":"28'7942","last_deep_scrub_stamp":"2024-05-10T05:18:41.318956+0000","last_clean_scrub_stamp":"2024-05-10T05:18:41.318956+0000","objects_scrubbed":2,"log_size":7342,"log_dups_size":0,"ondisk_log_size":7342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:55:03.935767+0000","scrub_duration":0.024728548,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7935,"num_write_kb":50462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'2034","reported_seq":2074,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:13.859163+0000","last_change":"2024-05-10T05:19:13.859326+0000","last_active":"2024-05-10T05:19:13.859163+0000","last_peered":"2024-05-10T05:19:13.859163+0000","last_clean":"2024-05-10T05:19:13.859163+0000","last_became_active":"2024-05-10T04:51:52.730961+0000","last_became_peered":"2024-05-10T04:51:52.730961+0000","last_unstale":"2024-05-10T05:19:13.859163+0000","last_undegraded":"2024-05-10T05:19:13.859163+0000","last_fullsized":"2024-05-10T05:19:13.859163+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2034","last_scrub_stamp":"2024-05-10T05:19:13.859137+0000","last_deep_scrub":"28'2034","last_deep_scrub_stamp":"2024-05-10T05:19:13.859137+0000","last_clean_scrub_stamp":"2024-05-10T05:19:13.859137+0000","objects_scrubbed":0,"log_size":2034,"log_dups_size":0,"ondisk_log_size":2034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:22:24.776637+0000","scrub_duration":0.002765942,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"28'7755","reported_seq":7879,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:27.793280+0000","last_change":"2024-05-10T05:19:27.793519+0000","last_active":"2024-05-10T05:19:27.793280+0000","last_peered":"2024-05-10T05:19:27.793280+0000","last_clean":"2024-05-10T05:19:27.793280+0000","last_became_active":"2024-05-10T04:51:57.215811+0000","last_became_peered":"2024-05-10T04:51:57.215811+0000","last_unstale":"2024-05-10T05:19:27.793280+0000","last_undegraded":"2024-05-10T05:19:27.793280+0000","last_fullsized":"2024-05-10T05:19:27.793280+0000","mapping_epoch":24,"log_start":"28'200","ondisk_log_start":"28'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'7755","last_scrub_stamp":"2024-05-10T05:19:27.793233+0000","last_deep_scrub":"28'7755","last_deep_scrub_stamp":"2024-05-10T05:19:27.793233+0000","last_clean_scrub_stamp":"2024-05-10T05:19:27.793233+0000","objects_scrubbed":0,"log_size":7555,"log_dups_size":0,"ondisk_log_size":7555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:38:44.706473+0000","scrub_duration":0.044177608,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":21844,"num_write":5619,"num_write_kb":940187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"28'5558","reported_seq":5599,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:44.500280+0000","last_change":"2024-05-10T05:18:44.500280+0000","last_active":"2024-05-10T05:18:44.500280+0000","last_peered":"2024-05-10T05:18:44.500280+0000","last_clean":"2024-05-10T05:18:44.500280+0000","last_became_active":"2024-05-10T04:51:52.136038+0000","last_became_peered":"2024-05-10T04:51:52.136038+0000","last_unstale":"2024-05-10T05:18:44.500280+0000","last_undegraded":"2024-05-10T05:18:44.500280+0000","last_fullsized":"2024-05-10T05:18:44.500280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'5558","last_scrub_stamp":"2024-05-10T05:18:44.500139+0000","last_deep_scrub":"28'5558","last_deep_scrub_stamp":"2024-05-10T05:18:44.500139+0000","last_clean_scrub_stamp":"2024-05-10T05:18:44.500139+0000","objects_scrubbed":2,"log_size":5558,"log_dups_size":0,"ondisk_log_size":5558,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:04:20.890403+0000","scrub_duration":0.025591222,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":5557,"num_write_kb":44634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'1961","reported_seq":2001,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:36.626709+0000","last_change":"2024-05-10T05:18:36.626709+0000","last_active":"2024-05-10T05:18:36.626709+0000","last_peered":"2024-05-10T05:18:36.626709+0000","last_clean":"2024-05-10T05:18:36.626709+0000","last_became_active":"2024-05-10T04:51:52.775987+0000","last_became_peered":"2024-05-10T04:51:52.775987+0000","last_unstale":"2024-05-10T05:18:36.626709+0000","last_undegraded":"2024-05-10T05:18:36.626709+0000","last_fullsized":"2024-05-10T05:18:36.626709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1961","last_scrub_stamp":"2024-05-10T05:18:36.626530+0000","last_deep_scrub":"28'1961","last_deep_scrub_stamp":"2024-05-10T05:18:36.626530+0000","last_clean_scrub_stamp":"2024-05-10T05:18:36.626530+0000","objects_scrubbed":0,"log_size":1961,"log_dups_size":0,"ondisk_log_size":1961,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T14:06:49.597931+0000","scrub_duration":0.027198238999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"28'1986","reported_seq":2027,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:06.235362+0000","last_change":"2024-05-10T05:19:06.235483+0000","last_active":"2024-05-10T05:19:06.235362+0000","last_peered":"2024-05-10T05:19:06.235362+0000","last_clean":"2024-05-10T05:19:06.235362+0000","last_became_active":"2024-05-10T04:51:52.752786+0000","last_became_peered":"2024-05-10T04:51:52.752786+0000","last_unstale":"2024-05-10T05:19:06.235362+0000","last_undegraded":"2024-05-10T05:19:06.235362+0000","last_fullsized":"2024-05-10T05:19:06.235362+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1986","last_scrub_stamp":"2024-05-10T05:19:06.235334+0000","last_deep_scrub":"28'1986","last_deep_scrub_stamp":"2024-05-10T05:19:06.235334+0000","last_clean_scrub_stamp":"2024-05-10T05:19:06.235334+0000","objects_scrubbed":0,"log_size":1986,"log_dups_size":0,"ondisk_log_size":1986,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:34.062837+0000","scrub_duration":0.0024130810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"28'2091","reported_seq":2132,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.494048+0000","last_change":"2024-05-10T05:18:55.494048+0000","last_active":"2024-05-10T05:18:55.494048+0000","last_peered":"2024-05-10T05:18:55.494048+0000","last_clean":"2024-05-10T05:18:55.494048+0000","last_became_active":"2024-05-10T04:51:52.744892+0000","last_became_peered":"2024-05-10T04:51:52.744892+0000","last_unstale":"2024-05-10T05:18:55.494048+0000","last_undegraded":"2024-05-10T05:18:55.494048+0000","last_fullsized":"2024-05-10T05:18:55.494048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2091","last_scrub_stamp":"2024-05-10T05:18:55.493882+0000","last_deep_scrub":"28'2091","last_deep_scrub_stamp":"2024-05-10T05:18:55.493882+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.493882+0000","objects_scrubbed":0,"log_size":2091,"log_dups_size":0,"ondisk_log_size":2091,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:55.899046+0000","scrub_duration":0.0058309420000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"28'1990","reported_seq":2031,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:01.962510+0000","last_change":"2024-05-10T05:19:01.962510+0000","last_active":"2024-05-10T05:19:01.962510+0000","last_peered":"2024-05-10T05:19:01.962510+0000","last_clean":"2024-05-10T05:19:01.962510+0000","last_became_active":"2024-05-10T04:51:52.736897+0000","last_became_peered":"2024-05-10T04:51:52.736897+0000","last_unstale":"2024-05-10T05:19:01.962510+0000","last_undegraded":"2024-05-10T05:19:01.962510+0000","last_fullsized":"2024-05-10T05:19:01.962510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1990","last_scrub_stamp":"2024-05-10T05:19:01.962351+0000","last_deep_scrub":"28'1990","last_deep_scrub_stamp":"2024-05-10T05:19:01.962351+0000","last_clean_scrub_stamp":"2024-05-10T05:19:01.962351+0000","objects_scrubbed":0,"log_size":1990,"log_dups_size":0,"ondisk_log_size":1990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T09:00:11.723694+0000","scrub_duration":0.0023731070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"28'2093","reported_seq":2134,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:32.141933+0000","last_change":"2024-05-10T05:18:32.141933+0000","last_active":"2024-05-10T05:18:32.141933+0000","last_peered":"2024-05-10T05:18:32.141933+0000","last_clean":"2024-05-10T05:18:32.141933+0000","last_became_active":"2024-05-10T04:51:52.748265+0000","last_became_peered":"2024-05-10T04:51:52.748265+0000","last_unstale":"2024-05-10T05:18:32.141933+0000","last_undegraded":"2024-05-10T05:18:32.141933+0000","last_fullsized":"2024-05-10T05:18:32.141933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2093","last_scrub_stamp":"2024-05-10T05:18:32.141812+0000","last_deep_scrub":"28'2093","last_deep_scrub_stamp":"2024-05-10T05:18:32.141812+0000","last_clean_scrub_stamp":"2024-05-10T05:18:32.141812+0000","objects_scrubbed":0,"log_size":2093,"log_dups_size":0,"ondisk_log_size":2093,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:17:15.037300+0000","scrub_duration":0.0043493560000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"28'2063","reported_seq":2103,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:55.002743+0000","last_change":"2024-05-10T05:18:55.002865+0000","last_active":"2024-05-10T05:18:55.002743+0000","last_peered":"2024-05-10T05:18:55.002743+0000","last_clean":"2024-05-10T05:18:55.002743+0000","last_became_active":"2024-05-10T04:51:52.742425+0000","last_became_peered":"2024-05-10T04:51:52.742425+0000","last_unstale":"2024-05-10T05:18:55.002743+0000","last_undegraded":"2024-05-10T05:18:55.002743+0000","last_fullsized":"2024-05-10T05:18:55.002743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2063","last_scrub_stamp":"2024-05-10T05:18:55.002712+0000","last_deep_scrub":"28'2063","last_deep_scrub_stamp":"2024-05-10T05:18:55.002712+0000","last_clean_scrub_stamp":"2024-05-10T05:18:55.002712+0000","objects_scrubbed":0,"log_size":2063,"log_dups_size":0,"ondisk_log_size":2063,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T11:17:32.038537+0000","scrub_duration":0.002817253,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"28'1959","reported_seq":1999,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:00.291226+0000","last_change":"2024-05-10T05:19:00.291352+0000","last_active":"2024-05-10T05:19:00.291226+0000","last_peered":"2024-05-10T05:19:00.291226+0000","last_clean":"2024-05-10T05:19:00.291226+0000","last_became_active":"2024-05-10T04:51:52.749687+0000","last_became_peered":"2024-05-10T04:51:52.749687+0000","last_unstale":"2024-05-10T05:19:00.291226+0000","last_undegraded":"2024-05-10T05:19:00.291226+0000","last_fullsized":"2024-05-10T05:19:00.291226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1959","last_scrub_stamp":"2024-05-10T05:19:00.291197+0000","last_deep_scrub":"28'1959","last_deep_scrub_stamp":"2024-05-10T05:19:00.291197+0000","last_clean_scrub_stamp":"2024-05-10T05:19:00.291197+0000","objects_scrubbed":0,"log_size":1959,"log_dups_size":0,"ondisk_log_size":1959,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:22:49.581235+0000","scrub_duration":0.027644953,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"28'2071","reported_seq":2111,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:19.387045+0000","last_change":"2024-05-10T05:19:19.387180+0000","last_active":"2024-05-10T05:19:19.387045+0000","last_peered":"2024-05-10T05:19:19.387045+0000","last_clean":"2024-05-10T05:19:19.387045+0000","last_became_active":"2024-05-10T04:51:52.760783+0000","last_became_peered":"2024-05-10T04:51:52.760783+0000","last_unstale":"2024-05-10T05:19:19.387045+0000","last_undegraded":"2024-05-10T05:19:19.387045+0000","last_fullsized":"2024-05-10T05:19:19.387045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2071","last_scrub_stamp":"2024-05-10T05:19:19.387017+0000","last_deep_scrub":"28'2071","last_deep_scrub_stamp":"2024-05-10T05:19:19.387017+0000","last_clean_scrub_stamp":"2024-05-10T05:19:19.387017+0000","objects_scrubbed":0,"log_size":2071,"log_dups_size":0,"ondisk_log_size":2071,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:55:57.900311+0000","scrub_duration":0.0019091659999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"28'2052","reported_seq":2092,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:37.915644+0000","last_change":"2024-05-10T05:18:37.915765+0000","last_active":"2024-05-10T05:18:37.915644+0000","last_peered":"2024-05-10T05:18:37.915644+0000","last_clean":"2024-05-10T05:18:37.915644+0000","last_became_active":"2024-05-10T04:51:52.738598+0000","last_became_peered":"2024-05-10T04:51:52.738598+0000","last_unstale":"2024-05-10T05:18:37.915644+0000","last_undegraded":"2024-05-10T05:18:37.915644+0000","last_fullsized":"2024-05-10T05:18:37.915644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2052","last_scrub_stamp":"2024-05-10T05:18:37.915613+0000","last_deep_scrub":"28'2052","last_deep_scrub_stamp":"2024-05-10T05:18:37.915613+0000","last_clean_scrub_stamp":"2024-05-10T05:18:37.915613+0000","objects_scrubbed":0,"log_size":2052,"log_dups_size":0,"ondisk_log_size":2052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T10:57:37.640463+0000","scrub_duration":0.017714500000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'2006","reported_seq":2046,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:40.029717+0000","last_change":"2024-05-10T05:18:40.029835+0000","last_active":"2024-05-10T05:18:40.029717+0000","last_peered":"2024-05-10T05:18:40.029717+0000","last_clean":"2024-05-10T05:18:40.029717+0000","last_became_active":"2024-05-10T04:51:52.736511+0000","last_became_peered":"2024-05-10T04:51:52.736511+0000","last_unstale":"2024-05-10T05:18:40.029717+0000","last_undegraded":"2024-05-10T05:18:40.029717+0000","last_fullsized":"2024-05-10T05:18:40.029717+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2006","last_scrub_stamp":"2024-05-10T05:18:40.029690+0000","last_deep_scrub":"28'2006","last_deep_scrub_stamp":"2024-05-10T05:18:40.029690+0000","last_clean_scrub_stamp":"2024-05-10T05:18:40.029690+0000","objects_scrubbed":0,"log_size":2006,"log_dups_size":0,"ondisk_log_size":2006,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T16:47:54.438553+0000","scrub_duration":0.0028650809999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"28'2043","reported_seq":2083,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:59.963920+0000","last_change":"2024-05-10T05:18:59.964032+0000","last_active":"2024-05-10T05:18:59.963920+0000","last_peered":"2024-05-10T05:18:59.963920+0000","last_clean":"2024-05-10T05:18:59.963920+0000","last_became_active":"2024-05-10T04:51:52.742451+0000","last_became_peered":"2024-05-10T04:51:52.742451+0000","last_unstale":"2024-05-10T05:18:59.963920+0000","last_undegraded":"2024-05-10T05:18:59.963920+0000","last_fullsized":"2024-05-10T05:18:59.963920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2043","last_scrub_stamp":"2024-05-10T05:18:59.963894+0000","last_deep_scrub":"28'2043","last_deep_scrub_stamp":"2024-05-10T05:18:59.963894+0000","last_clean_scrub_stamp":"2024-05-10T05:18:59.963894+0000","objects_scrubbed":0,"log_size":2043,"log_dups_size":0,"ondisk_log_size":2043,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T06:46:27.791396+0000","scrub_duration":0.0037174199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"28'2070","reported_seq":2110,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:09.919956+0000","last_change":"2024-05-10T05:19:09.920064+0000","last_active":"2024-05-10T05:19:09.919956+0000","last_peered":"2024-05-10T05:19:09.919956+0000","last_clean":"2024-05-10T05:19:09.919956+0000","last_became_active":"2024-05-10T04:51:52.743797+0000","last_became_peered":"2024-05-10T04:51:52.743797+0000","last_unstale":"2024-05-10T05:19:09.919956+0000","last_undegraded":"2024-05-10T05:19:09.919956+0000","last_fullsized":"2024-05-10T05:19:09.919956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2070","last_scrub_stamp":"2024-05-10T05:19:09.919928+0000","last_deep_scrub":"28'2070","last_deep_scrub_stamp":"2024-05-10T05:19:09.919928+0000","last_clean_scrub_stamp":"2024-05-10T05:19:09.919928+0000","objects_scrubbed":0,"log_size":2070,"log_dups_size":0,"ondisk_log_size":2070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:36:27.422447+0000","scrub_duration":0.0017856079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"28'2074","reported_seq":2114,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:19:11.236578+0000","last_change":"2024-05-10T05:19:11.236711+0000","last_active":"2024-05-10T05:19:11.236578+0000","last_peered":"2024-05-10T05:19:11.236578+0000","last_clean":"2024-05-10T05:19:11.236578+0000","last_became_active":"2024-05-10T04:51:52.747982+0000","last_became_peered":"2024-05-10T04:51:52.747982+0000","last_unstale":"2024-05-10T05:19:11.236578+0000","last_undegraded":"2024-05-10T05:19:11.236578+0000","last_fullsized":"2024-05-10T05:19:11.236578+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2074","last_scrub_stamp":"2024-05-10T05:19:11.236548+0000","last_deep_scrub":"28'2074","last_deep_scrub_stamp":"2024-05-10T05:19:11.236548+0000","last_clean_scrub_stamp":"2024-05-10T05:19:11.236548+0000","objects_scrubbed":0,"log_size":2074,"log_dups_size":0,"ondisk_log_size":2074,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T12:59:19.462632+0000","scrub_duration":0.0091204319999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"28'2051","reported_seq":2091,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-05-10T05:18:54.284504+0000","last_change":"2024-05-10T05:18:54.284504+0000","last_active":"2024-05-10T05:18:54.284504+0000","last_peered":"2024-05-10T05:18:54.284504+0000","last_clean":"2024-05-10T05:18:54.284504+0000","last_became_active":"2024-05-10T04:51:52.761726+0000","last_became_peered":"2024-05-10T04:51:52.761726+0000","last_unstale":"2024-05-10T05:18:54.284504+0000","last_undegraded":"2024-05-10T05:18:54.284504+0000","last_fullsized":"2024-05-10T05:18:54.284504+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2051","last_scrub_stamp":"2024-05-10T05:18:54.284233+0000","last_deep_scrub":"28'2051","last_deep_scrub_stamp":"2024-05-10T05:18:54.284233+0000","last_clean_scrub_stamp":"2024-05-10T05:18:54.284233+0000","objects_scrubbed":0,"log_size":2051,"log_dups_size":0,"ondisk_log_size":2051,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-11T15:20:34.289789+0000","scrub_duration":0.0020759820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2225,"num_read_kb":565150,"num_write":173251,"num_write_kb":29661400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225990,"ondisk_log_size":225990,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130764,"ondisk_log_size":130764,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":235183565,"num_objects":79,"num_object_clones":0,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":2414,"num_read_kb":15319,"num_write":184839,"num_write_kb":1350687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6380,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":470433792,"data_stored":470367130,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172746,"ondisk_log_size":172746,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542481,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":931700,"kb_used_data":70508,"kb_used_omap":1,"kb_used_meta":861182,"kb_avail":93440140,"statfs":{"total":96636764160,"available":95682703360,"internally_reserved":0,"allocated":72200192,"data_stored":72015801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":881850827},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.9390000000000001,"15min":1.8260000000000001},"min":{"1min":0.50600000000000001,"5min":0.309,"15min":0.28199999999999997},"max":{"1min":5.4960000000000004,"5min":28.266999999999999,"15min":34.326999999999998},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.95599999999999996,"5min":2.29,"15min":1.863},"min":{"1min":0.47299999999999998,"5min":0.317,"15min":0.31},"max":{"1min":4.4500000000000002,"5min":28.968,"15min":28.968},"last":1.0680000000000001}]},{"osd":1,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":2.2949999999999999,"15min":1.972},"min":{"1min":0.54000000000000004,"5min":0.35099999999999998,"15min":0.32900000000000001},"max":{"1min":1.248,"5min":34.805999999999997,"15min":34.805999999999997},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.7470000000000001,"5min":2.387,"15min":2.363},"min":{"1min":0.61299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":16.998000000000001,"5min":29.222000000000001,"15min":105.375},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":2.4580000000000002,"15min":2.113},"min":{"1min":0.498,"5min":0.44400000000000001,"15min":0.35899999999999999},"max":{"1min":15.532999999999999,"5min":39.965000000000003,"15min":52.515999999999998},"last":0.749},{"interface":"front","average":{"1min":0.80500000000000005,"5min":2.117,"15min":1.8029999999999999},"min":{"1min":0.50800000000000001,"5min":0.40699999999999997,"15min":0.378},"max":{"1min":1.288,"5min":34.756999999999998,"15min":35.595999999999997},"last":0.92400000000000004}]},{"osd":3,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":2.528,"15min":2.597},"min":{"1min":0.57699999999999996,"5min":0.442,"15min":0.40799999999999997},"max":{"1min":5.327,"5min":38.317999999999998,"15min":64.994},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.036,"5min":2.411,"15min":1.9890000000000001},"min":{"1min":0.69299999999999995,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.6560000000000001,"5min":34.841999999999999,"15min":43.789000000000001},"last":1.024}]},{"osd":4,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":2.9929999999999999,"15min":2.7229999999999999},"min":{"1min":0.52700000000000002,"5min":0.40100000000000002,"15min":0.33800000000000002},"max":{"1min":3.7090000000000001,"5min":40.978999999999999,"15min":52.252000000000002},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":2.5590000000000002,"15min":3.149},"min":{"1min":0.53600000000000003,"5min":0.40600000000000003,"15min":0.36499999999999999},"max":{"1min":3.6080000000000001,"5min":34.289999999999999,"15min":134.07499999999999},"last":1.2669999999999999}]},{"osd":5,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":3.085,"15min":2.5720000000000001},"min":{"1min":0.63400000000000001,"5min":0.47499999999999998,"15min":0.36299999999999999},"max":{"1min":25.75,"5min":34.875,"15min":34.875},"last":1.111},{"interface":"front","average":{"1min":2.4390000000000001,"5min":3.012,"15min":2.4380000000000002},"min":{"1min":0.60799999999999998,"5min":0.40000000000000002,"15min":0.38300000000000001},"max":{"1min":27.667000000000002,"5min":29.867000000000001,"15min":37.582999999999998},"last":1.2470000000000001}]},{"osd":6,"last update":"Fri May 10 05:19:23 2024","interfaces":[{"interface":"back","average":{"1min":0.96399999999999997,"5min":4.4409999999999998,"15min":3.262},"min":{"1min":0.753,"5min":0.57499999999999996,"15min":0.42599999999999999},"max":{"1min":1.97,"5min":65.388999999999996,"15min":65.388999999999996},"last":1.294},{"interface":"front","average":{"1min":1.0429999999999999,"5min":4.2389999999999999,"15min":3.3889999999999998},"min":{"1min":0.74299999999999999,"5min":0.48899999999999999,"15min":0.38200000000000001},"max":{"1min":3.5529999999999999,"5min":84.454999999999998,"15min":84.454999999999998},"last":1.2190000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542479,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":978144,"kb_used_data":90712,"kb_used_omap":1,"kb_used_meta":887422,"kb_avail":93393696,"statfs":{"total":96636764160,"available":95635144704,"internally_reserved":0,"allocated":92889088,"data_stored":92698114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":908720583},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":2.5579999999999998,"15min":3.0569999999999999},"min":{"1min":0.47699999999999998,"5min":0.30599999999999999,"15min":0.30199999999999999},"max":{"1min":14.510999999999999,"5min":17.158000000000001,"15min":215.636},"last":0.82799999999999996},{"interface":"front","average":{"1min":2.5070000000000001,"5min":2.6080000000000001,"15min":2.8149999999999999},"min":{"1min":0.45500000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":15.693,"5min":26.574000000000002,"15min":216.899},"last":0.79800000000000004}]},{"osd":1,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":1.998,"5min":2.5150000000000001,"15min":3.6709999999999998},"min":{"1min":0.39000000000000001,"5min":0.33500000000000002,"15min":0.32100000000000001},"max":{"1min":9.8569999999999993,"5min":20.341999999999999,"15min":283.584},"last":0.85999999999999999},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5590000000000002,"15min":3.3559999999999999},"min":{"1min":0.57799999999999996,"5min":0.39500000000000002,"15min":0.33500000000000002},"max":{"1min":14.353999999999999,"5min":21.161999999999999,"15min":226.642},"last":0.92000000000000004}]},{"osd":2,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.6070000000000002,"5min":2.3220000000000001,"15min":2.6339999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.38200000000000001},"max":{"1min":15.625999999999999,"5min":15.625999999999999,"15min":204.20099999999999},"last":0.98099999999999998},{"interface":"front","average":{"1min":2.5379999999999998,"5min":2.9430000000000001,"15min":2.262},"min":{"1min":0.42099999999999999,"5min":0.38700000000000001,"15min":0.38},"max":{"1min":14.115,"5min":46.381999999999998,"15min":46.381999999999998},"last":0.73899999999999999}]},{"osd":3,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.4470000000000001,"5min":2.3639999999999999,"15min":2.9390000000000001},"min":{"1min":0.54300000000000004,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":14.478999999999999,"5min":21.224,"15min":211.06999999999999},"last":1.012},{"interface":"front","average":{"1min":2.3719999999999999,"5min":2.181,"15min":2.8660000000000001},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":15.923,"5min":15.923,"15min":216.947},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":3.3340000000000001,"5min":2.9980000000000002,"15min":2.653},"min":{"1min":0.44900000000000001,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":14.304,"5min":33.139000000000003,"15min":53.664000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":3.4409999999999998,"5min":3.2200000000000002,"15min":2.4710000000000001},"min":{"1min":0.497,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":16.417000000000002,"5min":37.195,"15min":37.195},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":3.0840000000000001,"15min":2.343},"min":{"1min":0.51700000000000002,"5min":0.39500000000000002,"15min":0.373},"max":{"1min":11.1,"5min":46.448999999999998,"15min":46.448999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":2.6160000000000001,"5min":2.9079999999999999,"15min":2.589},"min":{"1min":0.58099999999999996,"5min":0.48299999999999998,"15min":0.441},"max":{"1min":14.760999999999999,"5min":18.962,"15min":35.591999999999999},"last":0.96699999999999997}]},{"osd":7,"last update":"Fri May 10 05:18:34 2024","interfaces":[{"interface":"back","average":{"1min":2.3100000000000001,"5min":2.9359999999999999,"15min":2.3210000000000002},"min":{"1min":0.45700000000000002,"5min":0.437,"15min":0.437},"max":{"1min":15.662000000000001,"5min":58.857999999999997,"15min":58.857999999999997},"last":0.94799999999999995},{"interface":"front","average":{"1min":2.9319999999999999,"5min":4.0650000000000004,"15min":2.7160000000000002},"min":{"1min":0.55600000000000005,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":11.148,"5min":55.414999999999999,"15min":55.414999999999999},"last":0.998}]}]},{"osd":0,"up_from":14,"seq":60129542481,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752828,"kb_used_data":45940,"kb_used_omap":1,"kb_used_meta":706878,"kb_avail":93619012,"statfs":{"total":96636764160,"available":95865868288,"internally_reserved":0,"allocated":47042560,"data_stored":46850033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":723843526},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.379,"15min":1.4390000000000001},"min":{"1min":0.32400000000000001,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":8.7910000000000004,"5min":39.710000000000001,"15min":40.371000000000002},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":1.8200000000000001,"15min":1.9279999999999999},"min":{"1min":0.314,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":1.7290000000000001,"5min":62.222000000000001,"15min":103.17400000000001},"last":0.625}]},{"osd":2,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":1.1719999999999999,"15min":1.181},"min":{"1min":0.41799999999999998,"5min":0.33800000000000002,"15min":0.316},"max":{"1min":1.863,"5min":13.031000000000001,"15min":22.513000000000002},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.65300000000000002,"5min":1.282,"15min":1.4099999999999999},"min":{"1min":0.39000000000000001,"5min":0.30199999999999999,"15min":0.28299999999999997},"max":{"1min":1.7050000000000001,"5min":17.998000000000001,"15min":37.643999999999998},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":1.6080000000000001,"15min":2.0880000000000001},"min":{"1min":0.42999999999999999,"5min":0.34499999999999997,"15min":0.28199999999999997},"max":{"1min":4.7089999999999996,"5min":51.646999999999998,"15min":108.407},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.752,"5min":1.367,"15min":1.4810000000000001},"min":{"1min":0.48399999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.173,"5min":15.236000000000001,"15min":25.210999999999999},"last":0.95899999999999996}]},{"osd":4,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":2.331,"15min":2.347},"min":{"1min":0.52400000000000002,"5min":0.438,"15min":0.38400000000000001},"max":{"1min":4.6619999999999999,"5min":52.307000000000002,"15min":52.307000000000002},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.1419999999999999,"5min":2.0539999999999998,"15min":2.0350000000000001},"min":{"1min":0.51300000000000001,"5min":0.45100000000000001,"15min":0.44900000000000001},"max":{"1min":3.6549999999999998,"5min":17.518999999999998,"15min":32.276000000000003},"last":1.22}]},{"osd":5,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":1.8740000000000001,"15min":1.889},"min":{"1min":0.495,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1989999999999998,"5min":18.966000000000001,"15min":37.572000000000003},"last":1.202},{"interface":"front","average":{"1min":1.3779999999999999,"5min":2.2280000000000002,"15min":2.3100000000000001},"min":{"1min":0.56299999999999994,"5min":0.52700000000000002,"15min":0.44600000000000001},"max":{"1min":7.6829999999999998,"5min":54.637999999999998,"15min":65.203999999999994},"last":1.248}]},{"osd":6,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.919,"15min":2.1720000000000002},"min":{"1min":0.57899999999999996,"5min":0.52000000000000002,"15min":0.48699999999999999},"max":{"1min":3.052,"5min":13.968,"15min":41.270000000000003},"last":1.319},{"interface":"front","average":{"1min":1.0600000000000001,"5min":2.1259999999999999,"15min":2.286},"min":{"1min":0.56699999999999995,"5min":0.45700000000000002,"15min":0.44800000000000001},"max":{"1min":3.0630000000000002,"5min":18.013000000000002,"15min":41.043999999999997},"last":1.353}]},{"osd":7,"last update":"Fri May 10 05:18:43 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":2.1930000000000001,"15min":2.2719999999999998},"min":{"1min":0.68000000000000005,"5min":0.50800000000000001,"15min":0.45900000000000002},"max":{"1min":1.8200000000000001,"5min":22.251000000000001,"15min":37.850000000000001},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.615,"5min":2.2490000000000001,"15min":2.4220000000000002},"min":{"1min":0.70699999999999996,"5min":0.503,"15min":0.503},"max":{"1min":9.9499999999999993,"5min":39.850000000000001,"15min":46.118000000000002},"last":1.335}]}]},{"osd":2,"up_from":13,"seq":55834575186,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":543212,"kb_used_data":20772,"kb_used_omap":1,"kb_used_meta":522430,"kb_avail":93828628,"statfs":{"total":96636764160,"available":96080515072,"internally_reserved":0,"allocated":21270528,"data_stored":21093203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":534968774},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.998,"15min":1.226},"min":{"1min":0.35099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.82299999999999995,"5min":9.9390000000000001,"15min":24.271000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.625,"5min":1.1160000000000001,"15min":1.421},"min":{"1min":0.41299999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.90400000000000003,"5min":16.366,"15min":30.734999999999999},"last":0.91200000000000003}]},{"osd":1,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":1.0189999999999999,"15min":1.131},"min":{"1min":0.40200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.84699999999999998,"5min":9.9079999999999995,"15min":22.297999999999998},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":2.1960000000000002,"15min":2.242},"min":{"1min":0.56899999999999995,"5min":0.33500000000000002,"15min":0.309},"max":{"1min":0.90300000000000002,"5min":73.775999999999996,"15min":73.775999999999996},"last":0.754}]},{"osd":3,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":1.1930000000000001,"15min":1.617},"min":{"1min":0.42699999999999999,"5min":0.32000000000000001,"15min":0.30499999999999999},"max":{"1min":0.79600000000000004,"5min":13.557,"15min":60.387999999999998},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.82099999999999995,"5min":1.306,"15min":1.4490000000000001},"min":{"1min":0.443,"5min":0.315,"15min":0.315},"max":{"1min":1.093,"5min":14.116,"15min":22.358000000000001},"last":0.996}]},{"osd":4,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":4.0650000000000004,"15min":2.8029999999999999},"min":{"1min":0.624,"5min":0.443,"15min":0.443},"max":{"1min":1.514,"5min":249.88,"15min":249.88},"last":1.079},{"interface":"front","average":{"1min":1.018,"5min":4.4809999999999999,"15min":3.1819999999999999},"min":{"1min":0.65900000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.349,"5min":249.82300000000001,"15min":249.82300000000001},"last":1.1659999999999999}]},{"osd":5,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":3.944,"15min":2.7349999999999999},"min":{"1min":0.53700000000000003,"5min":0.436,"15min":0.38400000000000001},"max":{"1min":1.1950000000000001,"5min":256.38600000000002,"15min":256.38600000000002},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.99399999999999999,"5min":3.8410000000000002,"15min":2.3900000000000001},"min":{"1min":0.57299999999999995,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4550000000000001,"5min":255.04499999999999,"15min":255.04499999999999},"last":1.212}]},{"osd":6,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":4.508,"15min":3.0379999999999998},"min":{"1min":0.59999999999999998,"5min":0.47699999999999998,"15min":0.46100000000000002},"max":{"1min":1.486,"5min":255.06999999999999,"15min":255.06999999999999},"last":1.284},{"interface":"front","average":{"1min":1.0309999999999999,"5min":4.851,"15min":3.1400000000000001},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.46200000000000002},"max":{"1min":1.302,"5min":253.095,"15min":253.095},"last":1.1950000000000001}]},{"osd":7,"last update":"Fri May 10 05:19:27 2024","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":4.0990000000000002,"15min":3.008},"min":{"1min":0.64000000000000001,"5min":0.51400000000000001,"15min":0.49099999999999999},"max":{"1min":1.4019999999999999,"5min":249.90799999999999,"15min":249.90799999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":4.1929999999999996,"15min":3.202},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.44400000000000001},"max":{"1min":1.4239999999999999,"5min":256.97699999999998,"15min":256.97699999999998},"last":1.256}]}]},{"osd":1,"up_from":14,"seq":60129542480,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":966332,"kb_used_data":50932,"kb_used_omap":1,"kb_used_meta":915390,"kb_avail":93405508,"statfs":{"total":96636764160,"available":95647240192,"internally_reserved":0,"allocated":52154368,"data_stored":51965329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":937359814},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":2.145,"15min":2.4449999999999998},"min":{"1min":0.39200000000000002,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.877,"5min":50.100000000000001,"15min":192.745},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.65100000000000002,"5min":1.6539999999999999,"15min":2.2160000000000002},"min":{"1min":0.48799999999999999,"5min":0.38400000000000001,"15min":0.30499999999999999},"max":{"1min":0.85099999999999998,"5min":50.145000000000003,"15min":192.62799999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":1.1419999999999999,"15min":1.663},"min":{"1min":0.443,"5min":0.29899999999999999,"15min":0.28899999999999998},"max":{"1min":0.82299999999999995,"5min":14.263999999999999,"15min":71.727999999999994},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.751,"5min":1.6279999999999999,"15min":1.9630000000000001},"min":{"1min":0.46000000000000002,"5min":0.318,"15min":0.30599999999999999},"max":{"1min":1.0029999999999999,"5min":32.435000000000002,"15min":95.793000000000006},"last":0.84899999999999998}]},{"osd":3,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":1.716,"15min":2.0299999999999998},"min":{"1min":0.59899999999999998,"5min":0.42199999999999999,"15min":0.308},"max":{"1min":0.96999999999999997,"5min":21.994,"15min":125.41200000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.675,"15min":1.819},"min":{"1min":0.56999999999999995,"5min":0.34899999999999998,"15min":0.30099999999999999},"max":{"1min":0.96799999999999997,"5min":26.085000000000001,"15min":111.134},"last":0.65800000000000003}]},{"osd":4,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":4.5119999999999996,"15min":3.1600000000000001},"min":{"1min":0.73299999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.4790000000000001,"5min":180.386,"15min":180.386},"last":1.075},{"interface":"front","average":{"1min":1.0309999999999999,"5min":4.8490000000000002,"15min":3.6469999999999998},"min":{"1min":0.76700000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.369,"5min":183.21299999999999,"15min":183.21299999999999},"last":1.115}]},{"osd":5,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0009999999999999,"5min":3.653,"15min":2.6120000000000001},"min":{"1min":0.72799999999999998,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.329,"5min":162.23099999999999,"15min":162.23099999999999},"last":0.879},{"interface":"front","average":{"1min":1.0209999999999999,"5min":4.1779999999999999,"15min":2.734},"min":{"1min":0.71999999999999997,"5min":0.41399999999999998,"15min":0.39600000000000002},"max":{"1min":1.3879999999999999,"5min":167.78100000000001,"15min":167.78100000000001},"last":0.90000000000000002}]},{"osd":6,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":4.1079999999999997,"15min":4.2839999999999998},"min":{"1min":0.81200000000000006,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.345,"5min":160.99600000000001,"15min":289.625},"last":1.002},{"interface":"front","average":{"1min":1.0900000000000001,"5min":4.0220000000000002,"15min":4.6280000000000001},"min":{"1min":0.82699999999999996,"5min":0.49299999999999999,"15min":0.40000000000000002},"max":{"1min":1.4370000000000001,"5min":163.37200000000001,"15min":289.608},"last":1.046}]},{"osd":7,"last update":"Fri May 10 05:19:36 2024","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":3.5750000000000002,"15min":2.5259999999999998},"min":{"1min":0.79100000000000004,"5min":0.50800000000000001,"15min":0.46000000000000002},"max":{"1min":1.4099999999999999,"5min":168.459,"15min":168.459},"last":0.79100000000000004},{"interface":"front","average":{"1min":1.0860000000000001,"5min":4.0780000000000003,"15min":2.7170000000000001},"min":{"1min":0.79200000000000004,"5min":0.54100000000000004,"15min":0.48199999999999998},"max":{"1min":1.4610000000000001,"5min":166.607,"15min":166.607},"last":0.93999999999999995}]}]},{"osd":3,"up_from":14,"seq":60129542480,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1077940,"kb_used_data":86316,"kb_used_omap":1,"kb_used_meta":991614,"kb_avail":93293900,"statfs":{"total":96636764160,"available":95532953600,"internally_reserved":0,"allocated":88387584,"data_stored":88202739,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":1015413192},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":1.5,"15min":1.49},"min":{"1min":0.39200000000000002,"5min":0.26300000000000001,"15min":0.24299999999999999},"max":{"1min":0.84899999999999998,"5min":34.020000000000003,"15min":34.020000000000003},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":1.339,"15min":1.8779999999999999},"min":{"1min":0.41199999999999998,"5min":0.30299999999999999,"15min":0.28999999999999998},"max":{"1min":0.73699999999999999,"5min":23.219999999999999,"15min":119.66200000000001},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":1.4259999999999999,"15min":1.4350000000000001},"min":{"1min":0.38100000000000001,"5min":0.29099999999999998,"15min":0.27500000000000002},"max":{"1min":0.78400000000000003,"5min":18.273,"15min":26.573},"last":0.623},{"interface":"front","average":{"1min":0.67700000000000005,"5min":1.6719999999999999,"15min":1.724},"min":{"1min":0.48799999999999999,"5min":0.33900000000000002,"15min":0.29699999999999999},"max":{"1min":0.92700000000000005,"5min":32.93,"15min":32.93},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.3480000000000001,"15min":1.3819999999999999},"min":{"1min":0.51100000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"max":{"1min":1.0940000000000001,"5min":15.942,"15min":26.187999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":1.3400000000000001,"15min":1.3759999999999999},"min":{"1min":0.54800000000000004,"5min":0.36799999999999999,"15min":0.36399999999999999},"max":{"1min":0.996,"5min":22.123000000000001,"15min":29.568999999999999},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":2.9140000000000001,"15min":4.1219999999999999},"min":{"1min":0.48699999999999999,"5min":0.40000000000000002,"15min":0.36399999999999999},"max":{"1min":1.294,"5min":55.142000000000003,"15min":157.47},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.98799999999999999,"5min":2.7669999999999999,"15min":3.657},"min":{"1min":0.67200000000000004,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.429,"5min":33.134999999999998,"15min":189.161},"last":1.127}]},{"osd":5,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":2.0089999999999999,"15min":2.5129999999999999},"min":{"1min":0.69299999999999995,"5min":0.46800000000000003,"15min":0.40799999999999997},"max":{"1min":1.5609999999999999,"5min":22.468,"15min":150.14500000000001},"last":1.079},{"interface":"front","average":{"1min":1.0249999999999999,"5min":2.5230000000000001,"15min":3.302},"min":{"1min":0.64100000000000001,"5min":0.51200000000000001,"15min":0.39100000000000001},"max":{"1min":1.5920000000000001,"5min":50.697000000000003,"15min":165.47},"last":0.86499999999999999}]},{"osd":6,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":2.4700000000000002,"15min":3.036},"min":{"1min":0.63800000000000001,"5min":0.48099999999999998,"15min":0.435},"max":{"1min":1.5449999999999999,"5min":43.024999999999999,"15min":179.703},"last":0.91400000000000003},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.875,"15min":2.6629999999999998},"min":{"1min":0.73599999999999999,"5min":0.47999999999999998,"15min":0.46999999999999997},"max":{"1min":1.456,"5min":17.460000000000001,"15min":135.15899999999999},"last":1.024}]},{"osd":7,"last update":"Fri May 10 05:19:32 2024","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":1.897,"15min":3.1739999999999999},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.49199999999999999},"max":{"1min":1.49,"5min":23.079000000000001,"15min":148.93899999999999},"last":1.097},{"interface":"front","average":{"1min":1.083,"5min":2.2949999999999999,"15min":3.274},"min":{"1min":0.77400000000000002,"5min":0.52100000000000002,"15min":0.47899999999999998},"max":{"1min":1.51,"5min":26.553000000000001,"15min":215.81299999999999},"last":1.1779999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542478,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":928504,"kb_used_data":49456,"kb_used_omap":1,"kb_used_meta":879038,"kb_avail":93443336,"statfs":{"total":96636764160,"available":95685976064,"internally_reserved":0,"allocated":50642944,"data_stored":50453457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":900135366},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":3.2869999999999999,"5min":2.3149999999999999,"15min":5.0179999999999998},"min":{"1min":0.33000000000000002,"5min":0.32700000000000001,"15min":0.27600000000000002},"max":{"1min":51.966000000000001,"5min":51.966000000000001,"15min":440.25299999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":1.2390000000000001,"5min":2.3929999999999998,"15min":2.6850000000000001},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.33700000000000002},"max":{"1min":6.5229999999999997,"5min":33.819000000000003,"15min":94.004999999999995},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":2.302,"15min":3.532},"min":{"1min":0.40500000000000003,"5min":0.39000000000000001,"15min":0.317},"max":{"1min":5.0990000000000002,"5min":30.404,"15min":112.73699999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.1659999999999999,"5min":1.95,"15min":2.0459999999999998},"min":{"1min":0.38,"5min":0.36799999999999999,"15min":0.35699999999999998},"max":{"1min":5,"5min":14.278,"15min":32.863},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.7230000000000001,"5min":1.839,"15min":5.2889999999999997},"min":{"1min":0.42199999999999999,"5min":0.375,"15min":0.36699999999999999},"max":{"1min":13.967000000000001,"5min":13.967000000000001,"15min":440.32400000000001},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.405,"5min":2.2120000000000002,"15min":3.1339999999999999},"min":{"1min":0.442,"5min":0.438,"15min":0.40899999999999997},"max":{"1min":5.1520000000000001,"5min":17.382999999999999,"15min":161.42699999999999},"last":0.71799999999999997}]},{"osd":3,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":2.6299999999999999,"15min":2.4889999999999999},"min":{"1min":0.46400000000000002,"5min":0.45700000000000002,"15min":0.41799999999999998},"max":{"1min":9.4949999999999992,"5min":32.715000000000003,"15min":44.515999999999998},"last":0.73799999999999999},{"interface":"front","average":{"1min":1.9139999999999999,"5min":2.3279999999999998,"15min":5.0579999999999998},"min":{"1min":0.47499999999999998,"5min":0.40999999999999998,"15min":0.373},"max":{"1min":13.728,"5min":19.661999999999999,"15min":440.197},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":2.379,"15min":3.3599999999999999},"min":{"1min":0.48699999999999999,"5min":0.40699999999999997,"15min":0.30199999999999999},"max":{"1min":6.6059999999999999,"5min":25.640999999999998,"15min":215.369},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.163,"5min":2.7330000000000001,"15min":3.3730000000000002},"min":{"1min":0.51500000000000001,"5min":0.439,"15min":0.38},"max":{"1min":4.9500000000000002,"5min":32.659999999999997,"15min":212.42599999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.9239999999999999,"5min":2.7519999999999998,"15min":5.5860000000000003},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.32100000000000001},"max":{"1min":14.042,"5min":30.117999999999999,"15min":440.358},"last":0.88200000000000001},{"interface":"front","average":{"1min":2.371,"5min":2.71,"15min":4.125},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":15.471,"5min":15.471,"15min":215.42099999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri May 10 05:18:39 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":3.5979999999999999,"15min":3.3860000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.42499999999999999},"max":{"1min":5.3049999999999997,"5min":45.661000000000001,"15min":121.637},"last":1},{"interface":"front","average":{"1min":3.7999999999999998,"5min":3.8679999999999999,"15min":5.6479999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":52.021999999999998,"5min":60.430999999999997,"15min":440.291},"last":1.093}]}]},{"osd":5,"up_from":14,"seq":60129542480,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":831508,"kb_used_data":48268,"kb_used_omap":1,"kb_used_meta":783230,"kb_avail":93540332,"statfs":{"total":96636764160,"available":95785299968,"internally_reserved":0,"allocated":49426432,"data_stored":49242654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":802027974},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.8980000000000001,"15min":2.0779999999999998},"min":{"1min":0.41999999999999998,"5min":0.32000000000000001,"15min":0.28000000000000003},"max":{"1min":12.201000000000001,"5min":47.201000000000001,"15min":47.201000000000001},"last":0.872},{"interface":"front","average":{"1min":2.5510000000000002,"5min":2.3780000000000001,"15min":1.8660000000000001},"min":{"1min":0.46100000000000002,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":11.143000000000001,"5min":22.106999999999999,"15min":22.106999999999999},"last":0.85599999999999998}]},{"osd":1,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":3.5419999999999998,"5min":2.7810000000000001,"15min":1.893},"min":{"1min":0.55300000000000005,"5min":0.36899999999999999,"15min":0.35699999999999998},"max":{"1min":18.725999999999999,"5min":22.693999999999999,"15min":22.693999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":2.492,"5min":2.8359999999999999,"15min":1.982},"min":{"1min":0.66300000000000003,"5min":0.39000000000000001,"15min":0.36499999999999999},"max":{"1min":9.5459999999999994,"5min":42.451000000000001,"15min":42.451000000000001},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":2.4689999999999999,"15min":1.923},"min":{"1min":0.51100000000000001,"5min":0.39900000000000002,"15min":0.33800000000000002},"max":{"1min":11.041,"5min":48.219999999999999,"15min":48.219999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":2.0910000000000002,"5min":3.4100000000000001,"15min":2.347},"min":{"1min":0.52700000000000002,"5min":0.436,"15min":0.36799999999999999},"max":{"1min":12.156000000000001,"5min":68.078000000000003,"15min":68.078000000000003},"last":0.98399999999999999}]},{"osd":3,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.504,"5min":2.7610000000000001,"15min":2.093},"min":{"1min":0.71199999999999997,"5min":0.42399999999999999,"15min":0.41499999999999998},"max":{"1min":9.9420000000000002,"5min":33.279000000000003,"15min":39.476999999999997},"last":0.81100000000000005},{"interface":"front","average":{"1min":2.1219999999999999,"5min":2.6859999999999999,"15min":2.1019999999999999},"min":{"1min":0.55700000000000005,"5min":0.49099999999999999,"15min":0.38600000000000001},"max":{"1min":11.606999999999999,"5min":36.192999999999998,"15min":36.192999999999998},"last":0.91100000000000003}]},{"osd":4,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":4.8090000000000002,"5min":5.8399999999999999,"15min":4.4930000000000003},"min":{"1min":0.48799999999999999,"5min":0.46500000000000002,"15min":0.32100000000000001},"max":{"1min":38.665999999999997,"5min":117.54600000000001,"15min":174.82499999999999},"last":0.621},{"interface":"front","average":{"1min":3.6539999999999999,"5min":3.4049999999999998,"15min":3.3530000000000002},"min":{"1min":0.51100000000000001,"5min":0.439,"15min":0.34399999999999997},"max":{"1min":23.553000000000001,"5min":23.553000000000001,"15min":174.684},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":3.8820000000000001,"15min":2.9660000000000002},"min":{"1min":0.57799999999999996,"5min":0.45100000000000001,"15min":0.38200000000000001},"max":{"1min":13.242000000000001,"5min":53.313000000000002,"15min":53.313000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":3.7989999999999999,"5min":4.4989999999999997,"15min":3.6659999999999999},"min":{"1min":0.49199999999999999,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":18.899999999999999,"5min":68.037000000000006,"15min":83.602999999999994},"last":0.78300000000000003}]},{"osd":7,"last update":"Fri May 10 05:18:55 2024","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":3.7989999999999999,"15min":2.6680000000000001},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.42999999999999999},"max":{"1min":5.9199999999999999,"5min":80.727999999999994,"15min":80.727999999999994},"last":0.83999999999999997},{"interface":"front","average":{"1min":2.8570000000000002,"5min":5.3529999999999998,"15min":3.258},"min":{"1min":0.66600000000000004,"5min":0.49099999999999999,"15min":0.47799999999999998},"max":{"1min":18.844999999999999,"5min":92.790999999999997,"15min":92.790999999999997},"last":0.93000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51855360,"data_stored":51843646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20971520,"data_stored":20971520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":88088576,"data_stored":88081056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50331774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49127424,"data_stored":49120971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":92590080,"data_stored":92576431,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":71307264,"data_stored":71303750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-10T05:19:38.911 DEBUG:teuthology.orchestra.run.smithi047:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-10T05:19:39.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.204+0000 7f7048600700 1 Processor -- start 2024-05-10T05:19:39.206 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.204+0000 7f7048600700 1 -- start start 2024-05-10T05:19:39.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.206+0000 7f7048600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70401509b0 0x7f70401569a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.206+0000 7f7048600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704015dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.206+0000 7f7048600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7040150dc0 con 0x7f704006ded0 2024-05-10T05:19:39.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.206+0000 7f7048600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70400aa1d0 con 0x7f70401509b0 2024-05-10T05:19:39.207 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.206+0000 7f7048600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704006e4b0 con 0x7f7040156ee0 2024-05-10T05:19:39.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70401509b0 0x7f70401569a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7046600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704015dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f70401509b0 0x7f70401569a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:60816/0 (socket says 172.21.15.47:60816) 2024-05-10T05:19:39.208 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 -- 172.21.15.47:0/3436383967 learned_addr learned my addr 172.21.15.47:0/3436383967 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:39.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 -- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 msgr2=0x7f704015dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:39.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 --2- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704015dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 -- 172.21.15.47:0/3436383967 >> v1:172.21.15.117:6789/0 conn(0x7f704006ded0 legacy=0x7f70400c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.207+0000 7f7045200700 1 -- 172.21.15.47:0/3436383967 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70401534c0 con 0x7f70401509b0 2024-05-10T05:19:39.209 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.208+0000 7f7045200700 1 --2- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401569a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f702c0098f0 tx=0x7f702c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=240d80e754de200d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:39.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.208+0000 7f703fe00700 1 -- 172.21.15.47:0/3436383967 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c011830 con 0x7f70401509b0 2024-05-10T05:19:39.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.208+0000 7f703fe00700 1 -- 172.21.15.47:0/3436383967 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c011990 con 0x7f70401509b0 2024-05-10T05:19:39.210 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.208+0000 7f703fe00700 1 -- 172.21.15.47:0/3436383967 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c011d20 con 0x7f70401509b0 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 -- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 msgr2=0x7f70401569a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 --2- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401569a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f702c0098f0 tx=0x7f702c009c00 comp rx=0 tx=0).stop 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 -- 172.21.15.47:0/3436383967 shutdown_connections 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 --2- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704015dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 --2- 172.21.15.47:0/3436383967 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401569a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 -- 172.21.15.47:0/3436383967 >> 172.21.15.47:0/3436383967 conn(0x7f70400a8ae0 msgr2=0x7f70400a97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 -- 172.21.15.47:0/3436383967 shutdown_connections 2024-05-10T05:19:39.211 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.209+0000 7f7048600700 1 -- 172.21.15.47:0/3436383967 wait complete. 2024-05-10T05:19:39.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.211+0000 7f7048600700 1 Processor -- start 2024-05-10T05:19:39.212 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.211+0000 7f7048600700 1 -- start start 2024-05-10T05:19:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.212+0000 7f7048600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 0x7f70401e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.212+0000 7f7048600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.212+0000 7f7048600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704014b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.212+0000 7f7048600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400c0ee0 con 0x7f704006ded0 2024-05-10T05:19:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.212+0000 7f7048600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70400bee30 con 0x7f70401509b0 2024-05-10T05:19:39.215 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.212+0000 7f7048600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f704014c430 con 0x7f7040156ee0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 0x7f70401e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 0x7f70401e9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40640/0 (socket says 172.21.15.47:40640) 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 -- 172.21.15.47:0/556676911 learned_addr learned my addr 172.21.15.47:0/556676911 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045200700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7046600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704014b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 -- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 msgr2=0x7f704014b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704014b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 -- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 msgr2=0x7f70401559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 -- 172.21.15.47:0/556676911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009550 con 0x7f704006ded0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.213+0000 7f7045c00700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 0x7f70401e9650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f703400c420 tx=0x7f703400c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.214+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340052d0 con 0x7f704006ded0 2024-05-10T05:19:39.216 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.214+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7034005430 con 0x7f704006ded0 2024-05-10T05:19:39.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.214+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f704014cc40 con 0x7f704006ded0 2024-05-10T05:19:39.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.214+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70340038c0 con 0x7f704006ded0 2024-05-10T05:19:39.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.214+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f704014c960 con 0x7f704006ded0 2024-05-10T05:19:39.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.215+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7040074720 con 0x7f704006ded0 2024-05-10T05:19:39.217 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.216+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7034003a20 con 0x7f704006ded0 2024-05-10T05:19:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.217+0000 7f703d600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f702006ac90 0x7f702006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.217+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f70340889d0 con 0x7f704006ded0 2024-05-10T05:19:39.218 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.218+0000 7f7045200700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f702006ac90 0x7f702006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.219 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.218+0000 7f7045200700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f702006ac90 0x7f702006d1a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70400aa080 tx=0x7f702c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:39.223 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.222+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f70340537f0 con 0x7f704006ded0 2024-05-10T05:19:39.440 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.439+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f70400c7000 con 0x7f704006ded0 2024-05-10T05:19:39.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.444+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f70340537f0 con 0x7f704006ded0 2024-05-10T05:19:39.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.444+0000 7f703d600700 1 -- 172.21.15.47:0/556676911 <== mon.0 v2:172.21.15.47:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f70400c7000 con 0x7f704006ded0 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f702006ac90 msgr2=0x7f702006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f702006ac90 0x7f702006d1a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f70400aa080 tx=0x7f702c008030 comp rx=0 tx=0).stop 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 msgr2=0x7f70401e9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 0x7f70401e9650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f703400c420 tx=0x7f703400c730 comp rx=0 tx=0).stop 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 shutdown_connections 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f702006ac90 0x7f702006d1a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f7040156ee0 0x7f704014b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f704006ded0 0x7f70401e9650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 --2- 172.21.15.47:0/556676911 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f70401509b0 0x7f70401559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 >> 172.21.15.47:0/556676911 conn(0x7f70400a8ae0 msgr2=0x7f704014d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 shutdown_connections 2024-05-10T05:19:39.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.447+0000 7f7048600700 1 -- 172.21.15.47:0/556676911 wait complete. 2024-05-10T05:19:39.478 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-10T05:19:39.478 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T05:19:39.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.748+0000 7f57c6600700 1 Processor -- start 2024-05-10T05:19:39.749 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.748+0000 7f57c6600700 1 -- start start 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57c6600700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f57c00cad10 0x7f57c00c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57c6600700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00c62d0 con 0x7f57c00ca900 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57c6600700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c00cb120 con 0x7f57c0152be0 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57c6600700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c00c56c0 con 0x7f57c00cad10 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57bea00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f57c00ca900 0x7f57c00c37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:45568/0 (socket says 172.21.15.47:45568) 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57bea00700 1 -- 172.21.15.47:0/3236433060 learned_addr learned my addr 172.21.15.47:0/3236433060 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:19:39.752 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57bfe00700 1 --2- 172.21.15.47:0/3236433060 >> v2:172.21.15.117:3300/0 conn(0x7f57c00cad10 0x7f57c00c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.750+0000 7f57be000700 1 -- 172.21.15.47:0/3236433060 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522934743 0 0) 0x7f57c00c62d0 con 0x7f57c00ca900 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57be000700 1 -- 172.21.15.47:0/3236433060 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57a40035b0 con 0x7f57c00ca900 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57bfe00700 1 -- 172.21.15.47:0/3236433060 >> v1:172.21.15.117:6789/0 conn(0x7f57c0152be0 legacy=0x7f57c0155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57bfe00700 1 -- 172.21.15.47:0/3236433060 >> v1:172.21.15.47:6789/0 conn(0x7f57c00ca900 legacy=0x7f57c00c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57be000700 1 -- 172.21.15.47:0/3236433060 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472248837 0 0) 0x7f57a40035b0 con 0x7f57c00ca900 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57bfe00700 1 -- 172.21.15.47:0/3236433060 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00c59a0 con 0x7f57c00cad10 2024-05-10T05:19:39.753 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57bfe00700 1 --2- 172.21.15.47:0/3236433060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cad10 0x7f57c00c3eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009d90 tx=0x7f57b800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eedc8541e3f3123a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:39.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57be000700 1 -- 172.21.15.47:0/3236433060 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b800e070 con 0x7f57c00cad10 2024-05-10T05:19:39.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57be000700 1 -- 172.21.15.47:0/3236433060 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f57b8003a20 con 0x7f57c00cad10 2024-05-10T05:19:39.755 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.751+0000 7f57be000700 1 -- 172.21.15.47:0/3236433060 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac001670 con 0x7f57c00cad10 2024-05-10T05:19:39.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 -- 172.21.15.47:0/3236433060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cad10 msgr2=0x7f57c00c3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 --2- 172.21.15.47:0/3236433060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cad10 0x7f57c00c3eb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f57b8009d90 tx=0x7f57b800b330 comp rx=0 tx=0).stop 2024-05-10T05:19:39.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 -- 172.21.15.47:0/3236433060 shutdown_connections 2024-05-10T05:19:39.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 --2- 172.21.15.47:0/3236433060 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00cad10 0x7f57c00c3eb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 -- 172.21.15.47:0/3236433060 >> 172.21.15.47:0/3236433060 conn(0x7f57c00c7630 msgr2=0x7f57c00c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:39.756 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 -- 172.21.15.47:0/3236433060 shutdown_connections 2024-05-10T05:19:39.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.752+0000 7f57c6600700 1 -- 172.21.15.47:0/3236433060 wait complete. 2024-05-10T05:19:39.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.755+0000 7f57c6600700 1 Processor -- start 2024-05-10T05:19:39.757 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.755+0000 7f57c6600700 1 -- start start 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57c6600700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00ca900 0x7f57c01557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57c6600700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cad10 0x7f57c0157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57c6600700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 0x7f57c013d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57c6600700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c0158750 con 0x7f57c0152be0 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57c6600700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c00ca630 con 0x7f57c00ca900 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57c6600700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c01eee40 con 0x7f57c00cad10 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57bfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 0x7f57c013d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57bfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 0x7f57c013d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40642/0 (socket says 172.21.15.47:40642) 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57bfe00700 1 -- 172.21.15.47:0/1711848001 learned_addr learned my addr 172.21.15.47:0/1711848001 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57bea00700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cad10 0x7f57c0157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.757+0000 7f57bf400700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00ca900 0x7f57c01557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57bfe00700 1 -- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cad10 msgr2=0x7f57c0157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57bfe00700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cad10 0x7f57c0157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.760 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57bfe00700 1 -- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00ca900 msgr2=0x7f57c01557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57bfe00700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00ca900 0x7f57c01557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57bfe00700 1 -- 172.21.15.47:0/1711848001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b8009a70 con 0x7f57c0152be0 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57bfe00700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 0x7f57c013d360 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f57b800b370 tx=0x7f57b8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8004600 con 0x7f57c0152be0 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f57b8004760 con 0x7f57c0152be0 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8012430 con 0x7f57c0152be0 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c01ef0e0 con 0x7f57c0152be0 2024-05-10T05:19:39.761 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.758+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c0157230 con 0x7f57c0152be0 2024-05-10T05:19:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.760+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c0074720 con 0x7f57c0152be0 2024-05-10T05:19:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.761+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57b8012590 con 0x7f57c0152be0 2024-05-10T05:19:39.762 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.761+0000 7f57b7400700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f57a006ac90 0x7f57a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.762+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f57b808add0 con 0x7f57c0152be0 2024-05-10T05:19:39.763 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.762+0000 7f57bf400700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f57a006ac90 0x7f57a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:39.764 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.762+0000 7f57bf400700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f57a006ac90 0x7f57a006d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57b0000f60 tx=0x7f57b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:39.767 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:39.766+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f57b8055c00 con 0x7f57c0152be0 2024-05-10T05:19:40.030 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.028+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c00c4ed0 con 0x7f57c0152be0 2024-05-10T05:19:40.031 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.029+0000 7f57b7400700 1 -- 172.21.15.47:0/1711848001 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f57b8016070 con 0x7f57c0152be0 2024-05-10T05:19:40.031 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:19:40.031 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:52:17.211312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f57a006ac90 msgr2=0x7f57a006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f57a006ac90 0x7f57a006d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f57b0000f60 tx=0x7f57b0009040 comp rx=0 tx=0).stop 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 msgr2=0x7f57c013d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 0x7f57c013d360 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f57b800b370 tx=0x7f57b8004ad0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 shutdown_connections 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f57c0152be0 0x7f57c013d360 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f57c00ca900 0x7f57c01557b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f57a006ac90 0x7f57a006d1a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.033 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 --2- 172.21.15.47:0/1711848001 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f57c00cad10 0x7f57c0157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.031+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 >> 172.21.15.47:0/1711848001 conn(0x7f57c00c7630 msgr2=0x7f57c00c7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:40.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.032+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 shutdown_connections 2024-05-10T05:19:40.034 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.032+0000 7f57c6600700 1 -- 172.21.15.47:0/1711848001 wait complete. 2024-05-10T05:19:40.034 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-10T05:19:40.060 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-10T05:19:40.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.328+0000 7f1c42c00700 1 Processor -- start 2024-05-10T05:19:40.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.329+0000 7f1c42c00700 1 -- start start 2024-05-10T05:19:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.330+0000 7f1c42c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c152d40 0x7f1c3c06abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.330+0000 7f1c42c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c3c0c23b0 0x7f1c3c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.330+0000 7f1c42c00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3c0c17d0 con 0x7f1c3c06b130 2024-05-10T05:19:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.330+0000 7f1c42c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c30c0 con 0x7f1c3c0c23b0 2024-05-10T05:19:40.332 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.330+0000 7f1c42c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0726d0 con 0x7f1c3c152d40 2024-05-10T05:19:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c3c0c23b0 0x7f1c3c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c3be00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c152d40 0x7f1c3c06abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f1c3c0c23b0 0x7f1c3c155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.117:3300/0 says I am v2:172.21.15.47:60872/0 (socket says 172.21.15.47:60872) 2024-05-10T05:19:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 -- 172.21.15.47:0/3996690559 learned_addr learned my addr 172.21.15.47:0/3996690559 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 -- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c152d40 msgr2=0x7f1c3c06abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:40.333 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 --2- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c152d40 0x7f1c3c06abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 -- 172.21.15.47:0/3996690559 >> v1:172.21.15.117:6789/0 conn(0x7f1c3c06b130 legacy=0x7f1c3c155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c40c00700 1 -- 172.21.15.47:0/3996690559 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0c1ab0 con 0x7f1c3c0c23b0 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.331+0000 7f1c3be00700 1 --2- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c152d40 0x7f1c3c06abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.332+0000 7f1c40c00700 1 --2- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c0c23b0 0x7f1c3c155d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009e50 tx=0x7f1c3400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40583ac6bf95d97a server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.332+0000 7f1c3aa00700 1 -- 172.21.15.47:0/3996690559 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400e070 con 0x7f1c3c0c23b0 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.332+0000 7f1c3aa00700 1 -- 172.21.15.47:0/3996690559 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1c3400b910 con 0x7f1c3c0c23b0 2024-05-10T05:19:40.334 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.332+0000 7f1c3aa00700 1 -- 172.21.15.47:0/3996690559 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3400bce0 con 0x7f1c3c0c23b0 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 -- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c0c23b0 msgr2=0x7f1c3c155d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 --2- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c0c23b0 0x7f1c3c155d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1c34009e50 tx=0x7f1c3400b330 comp rx=0 tx=0).stop 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 -- 172.21.15.47:0/3996690559 shutdown_connections 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 --2- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c0c23b0 0x7f1c3c155d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 --2- 172.21.15.47:0/3996690559 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c152d40 0x7f1c3c06abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 -- 172.21.15.47:0/3996690559 >> 172.21.15.47:0/3996690559 conn(0x7f1c3c0c4220 msgr2=0x7f1c3c0c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 -- 172.21.15.47:0/3996690559 shutdown_connections 2024-05-10T05:19:40.335 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.333+0000 7f1c42c00700 1 -- 172.21.15.47:0/3996690559 wait complete. 2024-05-10T05:19:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.335+0000 7f1c42c00700 1 Processor -- start 2024-05-10T05:19:40.336 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.335+0000 7f1c42c00700 1 -- start start 2024-05-10T05:19:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.336+0000 7f1c42c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 0x7f1c3c14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.336+0000 7f1c42c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0c23b0 0x7f1c3c0c6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.336+0000 7f1c42c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c152d40 0x7f1c3c147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.336+0000 7f1c42c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c0c7180 con 0x7f1c3c06b130 2024-05-10T05:19:40.339 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.336+0000 7f1c42c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c1464a0 con 0x7f1c3c152d40 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.336+0000 7f1c42c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3c1466f0 con 0x7f1c3c0c23b0 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 0x7f1c3c14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 0x7f1c3c14f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:40658/0 (socket says 172.21.15.47:40658) 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 -- 172.21.15.47:0/457333759 learned_addr learned my addr 172.21.15.47:0/457333759 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3b400700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0c23b0 0x7f1c3c0c6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c40c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c152d40 0x7f1c3c147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 -- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0c23b0 msgr2=0x7f1c3c0c6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0c23b0 0x7f1c3c0c6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 -- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c152d40 msgr2=0x7f1c3c147f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c152d40 0x7f1c3c147f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 -- 172.21.15.47:0/457333759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c009430 con 0x7f1c3c06b130 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.337+0000 7f1c3be00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 0x7f1c3c14f860 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00e9a0 tx=0x7f1c2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.338+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c005a20 con 0x7f1c3c06b130 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.338+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1c2c005b80 con 0x7f1c3c06b130 2024-05-10T05:19:40.340 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.338+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00c690 con 0x7f1c3c06b130 2024-05-10T05:19:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.338+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c34009b30 con 0x7f1c3c06b130 2024-05-10T05:19:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.338+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3c0c7f70 con 0x7f1c3c06b130 2024-05-10T05:19:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.339+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3c1562c0 con 0x7f1c3c06b130 2024-05-10T05:19:40.341 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.340+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1c2c00c7f0 con 0x7f1c3c06b130 2024-05-10T05:19:40.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.341+0000 7f1c33e00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1c1c06ac90 0x7f1c1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.341+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c2c089860 con 0x7f1c3c06b130 2024-05-10T05:19:40.342 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.341+0000 7f1c3b400700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1c1c06ac90 0x7f1c1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.343 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.342+0000 7f1c3b400700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1c1c06ac90 0x7f1c1c06d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c154a10 tx=0x7f1c28009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:40.346 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.345+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f1c2c054670 con 0x7f1c3c06b130 2024-05-10T05:19:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.604+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c3c074720 con 0x7f1c3c06b130 2024-05-10T05:19:40.606 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.605+0000 7f1c33e00700 1 -- 172.21.15.47:0/457333759 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4733 (secure 0 0 0) 0x7f1c2c057c90 con 0x7f1c3c06b130 2024-05-10T05:19:40.607 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:19:40.607 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.117:6835/1595433679","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6834","nonce":1595433679},{"type":"v1","addr":"172.21.15.117:6835","nonce":1595433679}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4257,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6833/698044654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6832","nonce":698044654},{"type":"v1","addr":"172.21.15.47:6833","nonce":698044654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.47:6835/3409120200","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6834","nonce":3409120200},{"type":"v1","addr":"172.21.15.47:6835","nonce":3409120200}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-10T04:51:52.718987+0000","modified":"2024-05-10T04:52:17.211312+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4272},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4272":{"gid":4272,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.117:6837/2356260099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6836","nonce":2356260099},{"type":"v1","addr":"172.21.15.117:6837","nonce":2356260099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-05-10T05:19:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1c1c06ac90 msgr2=0x7f1c1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.609 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1c1c06ac90 0x7f1c1c06d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c154a10 tx=0x7f1c28009040 comp rx=0 tx=0).stop 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 msgr2=0x7f1c3c14f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 0x7f1c3c14f860 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c00e9a0 tx=0x7f1c2c00ecb0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 shutdown_connections 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f1c3c152d40 0x7f1c3c147f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f1c3c06b130 0x7f1c3c14f860 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f1c1c06ac90 0x7f1c1c06d1a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 --2- 172.21.15.47:0/457333759 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f1c3c0c23b0 0x7f1c3c0c6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 >> 172.21.15.47:0/457333759 conn(0x7f1c3c0c4220 msgr2=0x7f1c3c154030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 shutdown_connections 2024-05-10T05:19:40.610 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.608+0000 7f1c42c00700 1 -- 172.21.15.47:0/457333759 wait complete. 2024-05-10T05:19:40.611 INFO:teuthology.orchestra.run.smithi047.stderr:dumped fsmap epoch 9 2024-05-10T05:19:40.635 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-10T05:19:40.906 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.905+0000 7f9b52200700 1 Processor -- start 2024-05-10T05:19:40.907 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.905+0000 7f9b52200700 1 -- start start 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b52200700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9b4c0c5a00 0x7f9b4c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b52200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f9b4c0c8ba0 0x7f9b4c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b52200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c06cbd0 con 0x7f9b4c1588d0 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b52200700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c1593f0 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b52200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0ca500 con 0x7f9b4c0c8ba0 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b50e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9b4c0c5a00 0x7f9b4c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b50e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f9b4c0c5a00 0x7f9b4c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58556/0 (socket says 172.21.15.47:58556) 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b50e00700 1 -- 172.21.15.47:0/877347789 learned_addr learned my addr 172.21.15.47:0/877347789 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:40.909 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b4be00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f9b4c1588d0 0x7f9b4c158ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43576/0 (socket says 172.21.15.47:43576) 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.907+0000 7f9b51800700 1 --2- 172.21.15.47:0/877347789 >> v2:172.21.15.117:3300/0 conn(0x7f9b4c0c8ba0 0x7f9b4c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b50e00700 1 -- 172.21.15.47:0/877347789 >> v2:172.21.15.117:3300/0 conn(0x7f9b4c0c8ba0 msgr2=0x7f9b4c0c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b50e00700 1 --2- 172.21.15.47:0/877347789 >> v2:172.21.15.117:3300/0 conn(0x7f9b4c0c8ba0 0x7f9b4c0c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b50e00700 1 -- 172.21.15.47:0/877347789 >> v1:172.21.15.47:6789/0 conn(0x7f9b4c1588d0 legacy=0x7f9b4c158ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b50e00700 1 -- 172.21.15.47:0/877347789 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c159660 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b51800700 1 --2- 172.21.15.47:0/877347789 >> v2:172.21.15.117:3300/0 conn(0x7f9b4c0c8ba0 0x7f9b4c0c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:19:40.910 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b50e00700 1 --2- 172.21.15.47:0/877347789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c1529e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c08c790 tx=0x7f9b40009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67136122b68e7c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b4b400700 1 -- 172.21.15.47:0/877347789 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000b870 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b4b400700 1 -- 172.21.15.47:0/877347789 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9b4000b9d0 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.908+0000 7f9b4b400700 1 -- 172.21.15.47:0/877347789 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000bd80 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 -- 172.21.15.47:0/877347789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 msgr2=0x7f9b4c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 --2- 172.21.15.47:0/877347789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c1529e0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c08c790 tx=0x7f9b40009bd0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 -- 172.21.15.47:0/877347789 shutdown_connections 2024-05-10T05:19:40.911 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 --2- 172.21.15.47:0/877347789 >> v2:172.21.15.117:3300/0 conn(0x7f9b4c0c8ba0 0x7f9b4c0c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 --2- 172.21.15.47:0/877347789 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c1529e0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 -- 172.21.15.47:0/877347789 >> 172.21.15.47:0/877347789 conn(0x7f9b4c0ca700 msgr2=0x7f9b4c0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 -- 172.21.15.47:0/877347789 shutdown_connections 2024-05-10T05:19:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.909+0000 7f9b52200700 1 -- 172.21.15.47:0/877347789 wait complete. 2024-05-10T05:19:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.911+0000 7f9b52200700 1 Processor -- start 2024-05-10T05:19:40.912 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.911+0000 7f9b52200700 1 -- start start 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b52200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c0aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b52200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b4c0c8ba0 0x7f9b4c1eeb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b52200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1588d0 0x7f9b4c1eb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b52200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c27c0 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b52200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c1eb2b0 con 0x7f9b4c0c8ba0 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b52200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0c4760 con 0x7f9b4c1588d0 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c0aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c0aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58566/0 (socket says 172.21.15.47:58566) 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 -- 172.21.15.47:0/538617024 learned_addr learned my addr 172.21.15.47:0/538617024 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b4be00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b4c0c8ba0 0x7f9b4c1eeb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b51800700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1588d0 0x7f9b4c1eb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.915 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 -- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1588d0 msgr2=0x7f9b4c1eb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1588d0 0x7f9b4c1eb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 -- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b4c0c8ba0 msgr2=0x7f9b4c1eeb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b4c0c8ba0 0x7f9b4c1eeb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.913+0000 7f9b50e00700 1 -- 172.21.15.47:0/538617024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40009550 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.916 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.914+0000 7f9b50e00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c0aeba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c08b600 tx=0x7f9b40004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.914+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004520 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.914+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9b4001e070 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.914+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c1ee6f0 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.914+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b400038c0 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.914+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c0c49b0 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.915+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c074720 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.917 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.916+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9b40003a20 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.917+0000 7f9b48c00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b2c06acc0 0x7f9b2c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:40.918 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.917+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9b40020070 con 0x7f9b4c0c5a00 2024-05-10T05:19:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.918+0000 7f9b4be00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b2c06acc0 0x7f9b2c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:40.919 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.918+0000 7f9b4be00700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b2c06acc0 0x7f9b2c06d1d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c156030 tx=0x7f9b38007ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:40.923 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:40.922+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9b40055a00 con 0x7f9b4c0c5a00 2024-05-10T05:19:41.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.137+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b4c0c55d0 con 0x7f9b4c0c5a00 2024-05-10T05:19:41.139 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.138+0000 7f9b48c00700 1 -- 172.21.15.47:0/538617024 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18267 (secure 0 0 0) 0x7f9b40015020 con 0x7f9b4c0c5a00 2024-05-10T05:19:41.140 INFO:teuthology.orchestra.run.smithi047.stdout: 2024-05-10T05:19:41.140 INFO:teuthology.orchestra.run.smithi047.stdout:{"epoch":28,"fsid":"63debaa4-fa23-4f28-8f14-9786e692137f","created":"2024-05-10T04:51:31.622041+0000","modified":"2024-05-10T04:52:40.317170+0000","last_up_change":"2024-05-10T04:51:43.863491+0000","last_in_change":"2024-05-10T04:51:35.728545+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-10T04:51:45.210667+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-10T04:51:50.735924+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-10T04:51:51.694963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-10T04:51:55.175151+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ea304499-866a-4f25-b383-9a8ef9d64c2d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6808","nonce":43823},{"type":"v1","addr":"172.21.15.47:6809","nonce":43823}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6810","nonce":43823},{"type":"v1","addr":"172.21.15.47:6811","nonce":43823}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6814","nonce":43823},{"type":"v1","addr":"172.21.15.47:6815","nonce":43823}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6812","nonce":43823},{"type":"v1","addr":"172.21.15.47:6813","nonce":43823}]},"public_addr":"172.21.15.47:6809/43823","cluster_addr":"172.21.15.47:6811/43823","heartbeat_back_addr":"172.21.15.47:6815/43823","heartbeat_front_addr":"172.21.15.47:6813/43823","state":["exists","up"]},{"osd":1,"uuid":"118bd21d-98bf-48a0-be7e-b15d5c881c29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6816","nonce":43821},{"type":"v1","addr":"172.21.15.47:6817","nonce":43821}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6818","nonce":43821},{"type":"v1","addr":"172.21.15.47:6819","nonce":43821}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6822","nonce":43821},{"type":"v1","addr":"172.21.15.47:6823","nonce":43821}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6820","nonce":43821},{"type":"v1","addr":"172.21.15.47:6821","nonce":43821}]},"public_addr":"172.21.15.47:6817/43821","cluster_addr":"172.21.15.47:6819/43821","heartbeat_back_addr":"172.21.15.47:6823/43821","heartbeat_front_addr":"172.21.15.47:6821/43821","state":["exists","up"]},{"osd":2,"uuid":"6c63a1dd-1a77-4b38-bc70-c8bd6e646124","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6800","nonce":43824},{"type":"v1","addr":"172.21.15.47:6801","nonce":43824}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6802","nonce":43824},{"type":"v1","addr":"172.21.15.47:6803","nonce":43824}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6806","nonce":43824},{"type":"v1","addr":"172.21.15.47:6807","nonce":43824}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6804","nonce":43824},{"type":"v1","addr":"172.21.15.47:6805","nonce":43824}]},"public_addr":"172.21.15.47:6801/43824","cluster_addr":"172.21.15.47:6803/43824","heartbeat_back_addr":"172.21.15.47:6807/43824","heartbeat_front_addr":"172.21.15.47:6805/43824","state":["exists","up"]},{"osd":3,"uuid":"9973fadf-e90e-4ba5-bdad-486dae45e099","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6824","nonce":43825},{"type":"v1","addr":"172.21.15.47:6825","nonce":43825}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6826","nonce":43825},{"type":"v1","addr":"172.21.15.47:6827","nonce":43825}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6830","nonce":43825},{"type":"v1","addr":"172.21.15.47:6831","nonce":43825}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.47:6828","nonce":43825},{"type":"v1","addr":"172.21.15.47:6829","nonce":43825}]},"public_addr":"172.21.15.47:6825/43825","cluster_addr":"172.21.15.47:6827/43825","heartbeat_back_addr":"172.21.15.47:6831/43825","heartbeat_front_addr":"172.21.15.47:6829/43825","state":["exists","up"]},{"osd":4,"uuid":"4ef23640-6801-43e1-a3de-15909bbb34c8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6800","nonce":44079},{"type":"v1","addr":"172.21.15.117:6801","nonce":44079}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6802","nonce":44079},{"type":"v1","addr":"172.21.15.117:6803","nonce":44079}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6806","nonce":44079},{"type":"v1","addr":"172.21.15.117:6807","nonce":44079}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6804","nonce":44079},{"type":"v1","addr":"172.21.15.117:6805","nonce":44079}]},"public_addr":"172.21.15.117:6801/44079","cluster_addr":"172.21.15.117:6803/44079","heartbeat_back_addr":"172.21.15.117:6807/44079","heartbeat_front_addr":"172.21.15.117:6805/44079","state":["exists","up"]},{"osd":5,"uuid":"c150d7f7-c885-4771-bbd8-69efcfa0a15d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6808","nonce":44080},{"type":"v1","addr":"172.21.15.117:6809","nonce":44080}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6810","nonce":44080},{"type":"v1","addr":"172.21.15.117:6811","nonce":44080}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6814","nonce":44080},{"type":"v1","addr":"172.21.15.117:6815","nonce":44080}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6812","nonce":44080},{"type":"v1","addr":"172.21.15.117:6813","nonce":44080}]},"public_addr":"172.21.15.117:6809/44080","cluster_addr":"172.21.15.117:6811/44080","heartbeat_back_addr":"172.21.15.117:6815/44080","heartbeat_front_addr":"172.21.15.117:6813/44080","state":["exists","up"]},{"osd":6,"uuid":"b5083688-fdec-454e-80ae-8cb32bf2492e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6816","nonce":44081},{"type":"v1","addr":"172.21.15.117:6817","nonce":44081}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6818","nonce":44081},{"type":"v1","addr":"172.21.15.117:6819","nonce":44081}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6822","nonce":44081},{"type":"v1","addr":"172.21.15.117:6823","nonce":44081}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6820","nonce":44081},{"type":"v1","addr":"172.21.15.117:6821","nonce":44081}]},"public_addr":"172.21.15.117:6817/44081","cluster_addr":"172.21.15.117:6819/44081","heartbeat_back_addr":"172.21.15.117:6823/44081","heartbeat_front_addr":"172.21.15.117:6821/44081","state":["exists","up"]},{"osd":7,"uuid":"2dd51725-60b7-4063-b7a9-6c01dc41c4fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6824","nonce":44082},{"type":"v1","addr":"172.21.15.117:6825","nonce":44082}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6826","nonce":44082},{"type":"v1","addr":"172.21.15.117:6827","nonce":44082}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6830","nonce":44082},{"type":"v1","addr":"172.21.15.117:6831","nonce":44082}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.117:6828","nonce":44082},{"type":"v1","addr":"172.21.15.117:6829","nonce":44082}]},"public_addr":"172.21.15.117:6825/44082","cluster_addr":"172.21.15.117:6827/44082","heartbeat_back_addr":"172.21.15.117:6831/44082","heartbeat_front_addr":"172.21.15.117:6829/44082","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.522849+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.521013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.105343+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.264695+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.117225+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.146065+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.250981+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-05-10T04:51:41.257993+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"4.b","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-10T05:19:41.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b2c06acc0 msgr2=0x7f9b2c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b2c06acc0 0x7f9b2c06d1d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c156030 tx=0x7f9b38007ed0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 msgr2=0x7f9b4c0aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c0aeba0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c08b600 tx=0x7f9b40004750 comp rx=0 tx=0).stop 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 shutdown_connections 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f9b2c06acc0 0x7f9b2c06d1d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f9b4c1588d0 0x7f9b4c1eb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f9b4c0c5a00 0x7f9b4c0aeba0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 --2- 172.21.15.47:0/538617024 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f9b4c0c8ba0 0x7f9b4c1eeb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 >> 172.21.15.47:0/538617024 conn(0x7f9b4c0ca700 msgr2=0x7f9b4c06c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 shutdown_connections 2024-05-10T05:19:41.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.141+0000 7f9b52200700 1 -- 172.21.15.47:0/538617024 wait complete. 2024-05-10T05:19:41.172 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-10T05:19:41.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.441+0000 7f8069200700 1 Processor -- start 2024-05-10T05:19:41.443 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.441+0000 7f8069200700 1 -- start start 2024-05-10T05:19:41.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8069200700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f80640c6cc0 0x7f8064152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:41.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8069200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80640c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:41.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8069200700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f806406d640 con 0x7f80640c92d0 2024-05-10T05:19:41.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8069200700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80640c9800 con 0x7f80640c6cc0 2024-05-10T05:19:41.444 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8069200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80640c8910 con 0x7f80640c5cf0 2024-05-10T05:19:41.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8062800700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f80640c92d0 0x7f806406bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43590/0 (socket says 172.21.15.47:43590) 2024-05-10T05:19:41.445 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.443+0000 7f8062800700 1 -- 172.21.15.47:0/3948142167 learned_addr learned my addr 172.21.15.47:0/3948142167 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:19:41.446 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061e00700 1 --2- 172.21.15.47:0/3948142167 >> v2:172.21.15.117:3300/0 conn(0x7f80640c6cc0 0x7f8064152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f805be00700 1 --2- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80640c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061400700 1 -- 172.21.15.47:0/3948142167 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590295412 0 0) 0x7f806406d640 con 0x7f80640c92d0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061400700 1 -- 172.21.15.47:0/3948142167 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80480035b0 con 0x7f80640c92d0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061e00700 1 -- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 msgr2=0x7f80640c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061e00700 1 --2- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80640c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061e00700 1 -- 172.21.15.47:0/3948142167 >> v1:172.21.15.47:6789/0 conn(0x7f80640c92d0 legacy=0x7f806406bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061400700 1 -- 172.21.15.47:0/3948142167 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3312830355 0 0) 0x7f80480035b0 con 0x7f80640c92d0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061e00700 1 -- 172.21.15.47:0/3948142167 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80640c6100 con 0x7f80640c6cc0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.444+0000 7f8061e00700 1 --2- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f8064152bb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8054009840 tx=0x7f8054009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c03fa4a4a3a91abd server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8061400700 1 -- 172.21.15.47:0/3948142167 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0019f0 con 0x7f80640c6cc0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8061400700 1 -- 172.21.15.47:0/3948142167 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8054004030 con 0x7f80640c6cc0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8061400700 1 -- 172.21.15.47:0/3948142167 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80540043a0 con 0x7f80640c6cc0 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8069200700 1 -- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 msgr2=0x7f8064152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8069200700 1 --2- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f8064152bb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8054009840 tx=0x7f8054009b50 comp rx=0 tx=0).stop 2024-05-10T05:19:41.447 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8069200700 1 -- 172.21.15.47:0/3948142167 shutdown_connections 2024-05-10T05:19:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8069200700 1 --2- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f8064152bb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8069200700 1 --2- 172.21.15.47:0/3948142167 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80640c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.445+0000 7f8069200700 1 -- 172.21.15.47:0/3948142167 >> 172.21.15.47:0/3948142167 conn(0x7f80640ca960 msgr2=0x7f80640cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.446+0000 7f8069200700 1 -- 172.21.15.47:0/3948142167 shutdown_connections 2024-05-10T05:19:41.448 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.446+0000 7f8069200700 1 -- 172.21.15.47:0/3948142167 wait complete. 2024-05-10T05:19:41.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.448+0000 7f8069200700 1 Processor -- start 2024-05-10T05:19:41.449 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.448+0000 7f8069200700 1 -- start start 2024-05-10T05:19:41.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8069200700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80641ec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:41.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8069200700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f80641ee450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:41.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8069200700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 0x7f806414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:41.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8069200700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806414fbc0 con 0x7f80640c92d0 2024-05-10T05:19:41.451 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8069200700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80641ecdc0 con 0x7f80640c6cc0 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8069200700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806414f970 con 0x7f80640c5cf0 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8062800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 0x7f806414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8062800700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 0x7f806414ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58580/0 (socket says 172.21.15.47:58580) 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.449+0000 7f8062800700 1 -- 172.21.15.47:0/3648165543 learned_addr learned my addr 172.21.15.47:0/3648165543 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8061e00700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80641ec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f805be00700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f80641ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8062800700 1 -- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 msgr2=0x7f80641ec1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8062800700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80641ec1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8062800700 1 -- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 msgr2=0x7f80641ee450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8062800700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f80641ee450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8062800700 1 -- 172.21.15.47:0/3648165543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80540094a0 con 0x7f80640c92d0 2024-05-10T05:19:41.452 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f8062800700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 0x7f806414ea90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f805c00cc40 tx=0x7f805c00cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:41.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.450+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c00aa20 con 0x7f80640c92d0 2024-05-10T05:19:41.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.451+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f805c00aba0 con 0x7f80640c92d0 2024-05-10T05:19:41.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.451+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80640c1f50 con 0x7f80640c92d0 2024-05-10T05:19:41.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.451+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805c0070d0 con 0x7f80640c92d0 2024-05-10T05:19:41.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.451+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80641eee60 con 0x7f80640c92d0 2024-05-10T05:19:41.453 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.452+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806406dd10 con 0x7f80640c92d0 2024-05-10T05:19:41.454 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.453+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f805c007230 con 0x7f80640c92d0 2024-05-10T05:19:41.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.454+0000 7f805a000700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f804006ac90 0x7f804006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:41.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.454+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f805c089560 con 0x7f80640c92d0 2024-05-10T05:19:41.455 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.454+0000 7f8061e00700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f804006ac90 0x7f804006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:41.456 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.455+0000 7f8061e00700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f804006ac90 0x7f804006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80540090b0 tx=0x7f8054008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:41.460 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.459+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f805c054250 con 0x7f80640c92d0 2024-05-10T05:19:41.720 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.719+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8064074720 con 0x7f80640c92d0 2024-05-10T05:19:41.740 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.739+0000 7f805a000700 1 -- 172.21.15.47:0/3648165543 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f805c018090 con 0x7f80640c92d0 2024-05-10T05:19:41.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.741+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f804006ac90 msgr2=0x7f804006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.741+0000 7f8069200700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f804006ac90 0x7f804006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f80540090b0 tx=0x7f8054008030 comp rx=0 tx=0).stop 2024-05-10T05:19:41.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.741+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 msgr2=0x7f806414ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:41.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.741+0000 7f8069200700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 0x7f806414ea90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f805c00cc40 tx=0x7f805c00cf50 comp rx=0 tx=0).stop 2024-05-10T05:19:41.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 shutdown_connections 2024-05-10T05:19:41.743 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f80640c92d0 0x7f806414ea90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f804006ac90 0x7f804006d1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f80640c5cf0 0x7f80641ec1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 --2- 172.21.15.47:0/3648165543 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f80640c6cc0 0x7f80641ee450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 >> 172.21.15.47:0/3648165543 conn(0x7f80640ca960 msgr2=0x7f80640aada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 shutdown_connections 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:41.742+0000 7f8069200700 1 -- 172.21.15.47:0/3648165543 wait complete. 2024-05-10T05:19:41.744 INFO:teuthology.orchestra.run.smithi047.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-10T05:19:41.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-10T05:19:41.987 INFO:tasks.ceph.mds.b.smithi117.stdout:starting mds.b at 2024-05-10T05:19:42.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.047+0000 7f2feca00700 1 Processor -- start 2024-05-10T05:19:42.049 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.047+0000 7f2feca00700 1 -- start start 2024-05-10T05:19:42.050 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2feca00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2fe80c8cc0 0x7f2fe80c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:42.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2feca00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe806c7c0 con 0x7f2fe80c5d00 2024-05-10T05:19:42.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2feca00700 1 -- --> v1:172.21.15.117:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fe806dac0 con 0x7f2fe81553f0 2024-05-10T05:19:42.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2feca00700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fe80c5340 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2fdfe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f2fe80c8cc0 0x7f2fe80c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:42.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2fe7e00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f2fe80c5d00 0x7f2fe815fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43598/0 (socket says 172.21.15.47:43598) 2024-05-10T05:19:42.051 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.049+0000 7f2fe7e00700 1 -- 172.21.15.47:0/2800206297 learned_addr learned my addr 172.21.15.47:0/2800206297 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:19:42.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fe6a00700 1 -- 172.21.15.47:0/2800206297 <== mon.1 v1:172.21.15.117:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154549193 0 0) 0x7f2fe806dac0 con 0x7f2fe81553f0 2024-05-10T05:19:42.052 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fe6a00700 1 -- 172.21.15.47:0/2800206297 --> v1:172.21.15.117:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fcc0035b0 con 0x7f2fe81553f0 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fdfe00700 1 -- 172.21.15.47:0/2800206297 >> v1:172.21.15.117:6789/0 conn(0x7f2fe81553f0 legacy=0x7f2fe80c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fdfe00700 1 -- 172.21.15.47:0/2800206297 >> v1:172.21.15.47:6789/0 conn(0x7f2fe80c5d00 legacy=0x7f2fe815fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fe6a00700 1 -- 172.21.15.47:0/2800206297 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454344462 0 0) 0x7f2fe806c7c0 con 0x7f2fe80c5d00 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fdfe00700 1 -- 172.21.15.47:0/2800206297 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe806bbb0 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.050+0000 7f2fdfe00700 1 --2- 172.21.15.47:0/2800206297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe80c57c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009840 tx=0x7f2fd0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=286d319d8ff49ccb server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2fe6a00700 1 -- 172.21.15.47:0/2800206297 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0011830 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2fe6a00700 1 -- 172.21.15.47:0/2800206297 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2fd0011990 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2fe6a00700 1 -- 172.21.15.47:0/2800206297 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0011d40 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 -- 172.21.15.47:0/2800206297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 msgr2=0x7f2fe80c57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 --2- 172.21.15.47:0/2800206297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe80c57c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009840 tx=0x7f2fd0009b50 comp rx=0 tx=0).stop 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 -- 172.21.15.47:0/2800206297 shutdown_connections 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 --2- 172.21.15.47:0/2800206297 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe80c57c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.053 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 -- 172.21.15.47:0/2800206297 >> 172.21.15.47:0/2800206297 conn(0x7f2fe80caf60 msgr2=0x7f2fe80c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:42.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 -- 172.21.15.47:0/2800206297 shutdown_connections 2024-05-10T05:19:42.054 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.051+0000 7f2feca00700 1 -- 172.21.15.47:0/2800206297 wait complete. 2024-05-10T05:19:42.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.054+0000 7f2feca00700 1 Processor -- start 2024-05-10T05:19:42.055 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.054+0000 7f2feca00700 1 -- start start 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2feca00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fe80c5d00 0x7f2fe80ae2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2feca00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe81ef3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2feca00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe81553f0 0x7f2fe80c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2feca00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81ebb90 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2feca00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe8151b20 con 0x7f2fe81553f0 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2feca00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fe81ee990 con 0x7f2fe80c5d00 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2fdfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe81ef3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2fdfe00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe81ef3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58604/0 (socket says 172.21.15.47:58604) 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2fdfe00700 1 -- 172.21.15.47:0/1457650472 learned_addr learned my addr 172.21.15.47:0/1457650472 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2fe7e00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe81553f0 0x7f2fe80c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:42.057 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.055+0000 7f2fe7400700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fe80c5d00 0x7f2fe80ae2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdfe00700 1 -- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fe80c5d00 msgr2=0x7f2fe80ae2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdfe00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fe80c5d00 0x7f2fe80ae2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdfe00700 1 -- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe81553f0 msgr2=0x7f2fe80c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdfe00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe81553f0 0x7f2fe80c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdfe00700 1 -- 172.21.15.47:0/1457650472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd00094a0 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fe7e00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe81553f0 0x7f2fe80c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdfe00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe81ef3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00090b0 tx=0x7f2fd0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd001a9f0 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.056+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f2fd001ab50 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.057+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00243f0 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.057+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fe81eef50 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.059 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.057+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fe80c3010 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.058+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fe8074720 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.060 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.059+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2fd0024550 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.060+0000 7f2fdf400700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2fc406ac90 0x7f2fc406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.060+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f2fd008aad0 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.061 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.060+0000 7f2fe7400700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2fc406ac90 0x7f2fc406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:42.062 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.061+0000 7f2fe7400700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2fc406ac90 0x7f2fc406d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8001220 tx=0x7f2fd8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:42.066 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.065+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f2fd0055890 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.330 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.329+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2fe80b0010 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.786 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.784+0000 7f2fdf400700 1 -- 172.21.15.47:0/1457650472 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2fd00090e0 con 0x7f2fe80c8cc0 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2fc406ac90 msgr2=0x7f2fc406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2fc406ac90 0x7f2fc406d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8001220 tx=0x7f2fd8009040 comp rx=0 tx=0).stop 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 msgr2=0x7f2fe81ef3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe81ef3e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f2fd00090b0 tx=0x7f2fd0004750 comp rx=0 tx=0).stop 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 shutdown_connections 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f2fe81553f0 0x7f2fe80c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.789 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f2fc406ac90 0x7f2fc406d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f2fe80c5d00 0x7f2fe80ae2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 --2- 172.21.15.47:0/1457650472 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f2fe80c8cc0 0x7f2fe81ef3e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.787+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 >> 172.21.15.47:0/1457650472 conn(0x7f2fe80caf60 msgr2=0x7f2fe80ab910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.788+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 shutdown_connections 2024-05-10T05:19:42.790 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:42.788+0000 7f2feca00700 1 -- 172.21.15.47:0/1457650472 wait complete. 2024-05-10T05:19:42.816 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-10T05:19:43.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.129+0000 7fec75c00700 1 Processor -- start 2024-05-10T05:19:43.130 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.129+0000 7fec75c00700 1 -- start start 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.130+0000 7fec75c00700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7fec700a7ed0 0x7fec7014b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.130+0000 7fec75c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec70071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.130+0000 7fec75c00700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec700713c0 con 0x7fec70152e70 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.130+0000 7fec75c00700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec700a82e0 con 0x7fec700a7ed0 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.130+0000 7fec75c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec70072950 con 0x7fec70071850 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.131+0000 7fec6ea00700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7fec70152e70 0x7fec70152400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43612/0 (socket says 172.21.15.47:43612) 2024-05-10T05:19:43.132 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.131+0000 7fec6ea00700 1 -- 172.21.15.47:0/2571836796 learned_addr learned my addr 172.21.15.47:0/2571836796 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:19:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.131+0000 7fec6e000700 1 --2- 172.21.15.47:0/2571836796 >> v2:172.21.15.117:3300/0 conn(0x7fec700a7ed0 0x7fec7014b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.131+0000 7fec6f400700 1 --2- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec70071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.131+0000 7fec6d600700 1 -- 172.21.15.47:0/2571836796 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897059864 0 0) 0x7fec700713c0 con 0x7fec70152e70 2024-05-10T05:19:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.131+0000 7fec6d600700 1 -- 172.21.15.47:0/2571836796 --> v1:172.21.15.47:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec540057c0 con 0x7fec70152e70 2024-05-10T05:19:43.134 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6e000700 1 -- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 msgr2=0x7fec70071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6e000700 1 --2- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec70071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6e000700 1 -- 172.21.15.47:0/2571836796 >> v1:172.21.15.47:6789/0 conn(0x7fec70152e70 legacy=0x7fec70152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6d600700 1 -- 172.21.15.47:0/2571836796 <== mon.0 v1:172.21.15.47:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647268777 0 0) 0x7fec540057c0 con 0x7fec70152e70 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6e000700 1 -- 172.21.15.47:0/2571836796 --> v2:172.21.15.117:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec70072390 con 0x7fec700a7ed0 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6e000700 1 --2- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a7ed0 0x7fec7014b840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00a8e0 tx=0x7fec5c00abf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6554262759de01f server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6d600700 1 -- 172.21.15.47:0/2571836796 <== mon.1 v2:172.21.15.117:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60001670 con 0x7fec700a7ed0 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6d600700 1 -- 172.21.15.47:0/2571836796 <== mon.1 v2:172.21.15.117:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fec5c004030 con 0x7fec700a7ed0 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.132+0000 7fec6d600700 1 -- 172.21.15.47:0/2571836796 <== mon.1 v2:172.21.15.117:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0043a0 con 0x7fec700a7ed0 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 -- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a7ed0 msgr2=0x7fec7014b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 --2- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a7ed0 0x7fec7014b840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00a8e0 tx=0x7fec5c00abf0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 -- 172.21.15.47:0/2571836796 shutdown_connections 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 --2- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec70071c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 --2- 172.21.15.47:0/2571836796 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec700a7ed0 0x7fec7014b840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.135 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 -- 172.21.15.47:0/2571836796 >> 172.21.15.47:0/2571836796 conn(0x7fec7006add0 msgr2=0x7fec7006b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 -- 172.21.15.47:0/2571836796 shutdown_connections 2024-05-10T05:19:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.133+0000 7fec75c00700 1 -- 172.21.15.47:0/2571836796 wait complete. 2024-05-10T05:19:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.135+0000 7fec75c00700 1 Processor -- start 2024-05-10T05:19:43.136 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.135+0000 7fec75c00700 1 -- start start 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec75c00700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec701eee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec75c00700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 0x7fec700c2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec75c00700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70152e70 0x7fec7014e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec75c00700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7014f7f0 con 0x7fec700a7ed0 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec75c00700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec70150b90 con 0x7fec70152e70 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec75c00700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7014f960 con 0x7fec70071850 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 0x7fec700c2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6e000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 0x7fec700c2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58620/0 (socket says 172.21.15.47:58620) 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6e000700 1 -- 172.21.15.47:0/1257104048 learned_addr learned my addr 172.21.15.47:0/1257104048 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:43.140 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6e000700 1 -- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 msgr2=0x7fec701eee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6e000700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec701eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6e000700 1 -- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70152e70 msgr2=0x7fec7014e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.137+0000 7fec6f400700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70152e70 0x7fec7014e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec6e000700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70152e70 0x7fec7014e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec6e000700 1 -- 172.21.15.47:0/1257104048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec5c00a550 con 0x7fec700a7ed0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec6f400700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70152e70 0x7fec7014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec6e000700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 0x7fec700c2170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c01f070 con 0x7fec700a7ed0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fec5c004320 con 0x7fec700a7ed0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7009a120 con 0x7fec700a7ed0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec5c0108f0 con 0x7fec700a7ed0 2024-05-10T05:19:43.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.138+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec701ebdf0 con 0x7fec700a7ed0 2024-05-10T05:19:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.139+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec701ee980 con 0x7fec700a7ed0 2024-05-10T05:19:43.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.140+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec5c010a50 con 0x7fec700a7ed0 2024-05-10T05:19:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.142+0000 7fec66a00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fec5006ac90 0x7fec5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.142+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fec5c08a890 con 0x7fec700a7ed0 2024-05-10T05:19:43.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.142+0000 7fec6ea00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fec5006ac90 0x7fec5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:43.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.143+0000 7fec6ea00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fec5006ac90 0x7fec5006d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec60000c00 tx=0x7fec600010e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:43.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.147+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7fec5c055660 con 0x7fec700a7ed0 2024-05-10T05:19:43.367 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.366+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec7006f080 con 0x7fec700a7ed0 2024-05-10T05:19:43.629 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:19:43.634 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:19:43.788 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.787+0000 7fec66a00700 1 -- 172.21.15.47:0/1257104048 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7fec5c0280d0 con 0x7fec700a7ed0 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fec5006ac90 msgr2=0x7fec5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fec5006ac90 0x7fec5006d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fec60000c00 tx=0x7fec600010e0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 msgr2=0x7fec700c2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 0x7fec700c2170 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c0047c0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 shutdown_connections 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7fec70152e70 0x7fec7014e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7fec5006ac90 0x7fec5006d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7fec70071850 0x7fec701eee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.792 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 --2- 172.21.15.47:0/1257104048 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7fec700a7ed0 0x7fec700c2170 secure :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fec5c000c00 tx=0x7fec5c0047c0 comp rx=0 tx=0).stop 2024-05-10T05:19:43.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 >> 172.21.15.47:0/1257104048 conn(0x7fec7006add0 msgr2=0x7fec700c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:43.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.790+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 shutdown_connections 2024-05-10T05:19:43.793 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:43.791+0000 7fec75c00700 1 -- 172.21.15.47:0/1257104048 wait complete. 2024-05-10T05:19:43.796 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_metadata' removed 2024-05-10T05:19:43.832 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-10T05:19:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.137+0000 7f96aa000700 1 Processor -- start 2024-05-10T05:19:44.138 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.137+0000 7f96aa000700 1 -- start start 2024-05-10T05:19:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96aa000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f96a40ca8e0 0x7f96a40cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96aa000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f96a40c3780 0x7f96a40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96aa000700 1 -- --> v1:172.21.15.47:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a40c62b0 con 0x7f96a4152bc0 2024-05-10T05:19:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96aa000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40c56a0 con 0x7f96a40c3780 2024-05-10T05:19:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96aa000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40c5980 con 0x7f96a40ca8e0 2024-05-10T05:19:44.141 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3e00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f96a40c3780 0x7f96a40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3400700 1 --1- >> v1:172.21.15.47:6789/0 conn(0x7f96a4152bc0 0x7f96a4155e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.47:6789/0 says I am v1:172.21.15.47:43620/0 (socket says 172.21.15.47:43620) 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3400700 1 -- 172.21.15.47:0/3433725783 learned_addr learned my addr 172.21.15.47:0/3433725783 (peer_addr_for_me v1:172.21.15.47:0/0) 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a2a00700 1 --2- 172.21.15.47:0/3433725783 >> v2:172.21.15.117:3300/0 conn(0x7f96a40ca8e0 0x7f96a40cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3e00700 1 -- 172.21.15.47:0/3433725783 >> v2:172.21.15.117:3300/0 conn(0x7f96a40ca8e0 msgr2=0x7f96a40cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3e00700 1 --2- 172.21.15.47:0/3433725783 >> v2:172.21.15.117:3300/0 conn(0x7f96a40ca8e0 0x7f96a40cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3e00700 1 -- 172.21.15.47:0/3433725783 >> v1:172.21.15.47:6789/0 conn(0x7f96a4152bc0 legacy=0x7f96a4155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a3e00700 1 -- 172.21.15.47:0/3433725783 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40c5c60 con 0x7f96a40c3780 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a2000700 1 -- 172.21.15.47:0/3433725783 <== mon.0 v1:172.21.15.47:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574919046 0 0) 0x7f96a40c62b0 con 0x7f96a4152bc0 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.139+0000 7f96a2a00700 1 --2- 172.21.15.47:0/3433725783 >> v2:172.21.15.117:3300/0 conn(0x7f96a40ca8e0 0x7f96a40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.140+0000 7f96a3e00700 1 --2- 172.21.15.47:0/3433725783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a40c3b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f96a40b0ca0 tx=0x7f969c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35898aa6dbb6437d server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.140+0000 7f96a2000700 1 -- 172.21.15.47:0/3433725783 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c011830 con 0x7f96a40c3780 2024-05-10T05:19:44.142 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.140+0000 7f96a2000700 1 -- 172.21.15.47:0/3433725783 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f969c011990 con 0x7f96a40c3780 2024-05-10T05:19:44.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.140+0000 7f96a2000700 1 -- 172.21.15.47:0/3433725783 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c011d40 con 0x7f96a40c3780 2024-05-10T05:19:44.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 -- 172.21.15.47:0/3433725783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 msgr2=0x7f96a40c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:44.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 --2- 172.21.15.47:0/3433725783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a40c3b90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f96a40b0ca0 tx=0x7f969c009b20 comp rx=0 tx=0).stop 2024-05-10T05:19:44.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 -- 172.21.15.47:0/3433725783 shutdown_connections 2024-05-10T05:19:44.143 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 --2- 172.21.15.47:0/3433725783 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a40c3b90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 --2- 172.21.15.47:0/3433725783 >> v2:172.21.15.117:3300/0 conn(0x7f96a40ca8e0 0x7f96a40cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 -- 172.21.15.47:0/3433725783 >> 172.21.15.47:0/3433725783 conn(0x7f96a40c7610 msgr2=0x7f96a40c7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 -- 172.21.15.47:0/3433725783 shutdown_connections 2024-05-10T05:19:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.141+0000 7f96aa000700 1 -- 172.21.15.47:0/3433725783 wait complete. 2024-05-10T05:19:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.143+0000 7f96aa000700 1 Processor -- start 2024-05-10T05:19:44.144 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.143+0000 7f96aa000700 1 -- start start 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96aa000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a4154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96aa000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40ca8e0 0x7f96a414d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96aa000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a4152bc0 0x7f96a41ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96aa000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4153940 con 0x7f96a40c3780 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96aa000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a4155020 con 0x7f96a40ca8e0 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96aa000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a41ebae0 con 0x7f96a4152bc0 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a4154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a4154ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58636/0 (socket says 172.21.15.47:58636) 2024-05-10T05:19:44.147 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 -- 172.21.15.47:0/556258214 learned_addr learned my addr 172.21.15.47:0/556258214 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a2a00700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40ca8e0 0x7f96a414d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3e00700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a4152bc0 0x7f96a41ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 -- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a4152bc0 msgr2=0x7f96a41ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a4152bc0 0x7f96a41ef3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 -- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40ca8e0 msgr2=0x7f96a414d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.145+0000 7f96a3400700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40ca8e0 0x7f96a414d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f96a3400700 1 -- 172.21.15.47:0/556258214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c0094a0 con 0x7f96a40c3780 2024-05-10T05:19:44.148 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f96a3400700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a4154ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f969400cbf0 tx=0x7f969400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969400abc0 con 0x7f96a40c3780 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f969400ad40 con 0x7f96a40c3780 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9694007330 con 0x7f96a40c3780 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a4153d10 con 0x7f96a40c3780 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.146+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a41eef30 con 0x7f96a40c3780 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.147+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a4074720 con 0x7f96a40c3780 2024-05-10T05:19:44.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.148+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9694007490 con 0x7f96a40c3780 2024-05-10T05:19:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.150+0000 7f969b400700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f968406acc0 0x7f968406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.150+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f9694089130 con 0x7f96a40c3780 2024-05-10T05:19:44.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.150+0000 7f96a2a00700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f968406acc0 0x7f968406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:44.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.151+0000 7f96a2a00700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f968406acc0 0x7f968406d1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96a414d140 tx=0x7f9690008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:44.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.155+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f9694054010 con 0x7f96a40c3780 2024-05-10T05:19:44.370 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.369+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f96a41ef0c0 con 0x7f96a40c3780 2024-05-10T05:19:44.802 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.799+0000 7f969b400700 1 -- 172.21.15.47:0/556258214 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9694057630 con 0x7f96a40c3780 2024-05-10T05:19:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.807+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f968406acc0 msgr2=0x7f968406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.807+0000 7f96aa000700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f968406acc0 0x7f968406d1d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f96a414d140 tx=0x7f9690008040 comp rx=0 tx=0).stop 2024-05-10T05:19:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.807+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 msgr2=0x7f96a4154ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:44.808 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.807+0000 7f96aa000700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a4154ae0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f969400cbf0 tx=0x7f969400a060 comp rx=0 tx=0).stop 2024-05-10T05:19:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 shutdown_connections 2024-05-10T05:19:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f968406acc0 0x7f968406d1d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f96a4152bc0 0x7f96a41ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f96a40c3780 0x7f96a4154ae0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.810 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 --2- 172.21.15.47:0/556258214 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f96a40ca8e0 0x7f96a414d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 >> 172.21.15.47:0/556258214 conn(0x7f96a40c7610 msgr2=0x7f96a40c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 shutdown_connections 2024-05-10T05:19:44.811 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:44.809+0000 7f96aa000700 1 -- 172.21.15.47:0/556258214 wait complete. 2024-05-10T05:19:44.816 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data' removed 2024-05-10T05:19:44.860 DEBUG:teuthology.orchestra.run.smithi047:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-10T05:19:45.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.144+0000 7f28e3000700 1 Processor -- start 2024-05-10T05:19:45.146 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.144+0000 7f28e3000700 1 -- start start 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e3000700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28dc0710c0 0x7f28dc0c1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e3000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc14f910 0x7f28dc0717a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e3000700 1 --2- >> v2:172.21.15.117:3300/0 conn(0x7f28dc1557e0 0x7f28dc155bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e3000700 1 -- --> v2:172.21.15.47:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0a9930 con 0x7f28dc0710c0 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e3000700 1 -- --> v2:172.21.15.117:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28dc0c1770 con 0x7f28dc1557e0 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e3000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc152e10 con 0x7f28dc14f910 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28dbe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28dc0710c0 0x7f28dc0c1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28dbe00700 1 --2- >> v2:172.21.15.47:3300/0 conn(0x7f28dc0710c0 0x7f28dc0c1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58642/0 (socket says 172.21.15.47:58642) 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28dbe00700 1 -- 172.21.15.47:0/3608394802 learned_addr learned my addr 172.21.15.47:0/3608394802 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:45.149 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28db400700 1 --2- 172.21.15.47:0/3608394802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc14f910 0x7f28dc0717a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.146+0000 7f28e1000700 1 --2- 172.21.15.47:0/3608394802 >> v2:172.21.15.117:3300/0 conn(0x7f28dc1557e0 0x7f28dc155bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28dbe00700 1 -- 172.21.15.47:0/3608394802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc14f910 msgr2=0x7f28dc0717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28dbe00700 1 --2- 172.21.15.47:0/3608394802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc14f910 0x7f28dc0717a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28dbe00700 1 -- 172.21.15.47:0/3608394802 >> v2:172.21.15.117:3300/0 conn(0x7f28dc1557e0 msgr2=0x7f28dc155bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28dbe00700 1 --2- 172.21.15.47:0/3608394802 >> v2:172.21.15.117:3300/0 conn(0x7f28dc1557e0 0x7f28dc155bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28dbe00700 1 -- 172.21.15.47:0/3608394802 --> v2:172.21.15.47:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28dc0c1120 con 0x7f28dc0710c0 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28dbe00700 1 --2- 172.21.15.47:0/3608394802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc0710c0 0x7f28dc0c1c00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28dc070c80 tx=0x7f28cc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9614c7c2043c6991 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28daa00700 1 -- 172.21.15.47:0/3608394802 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc011830 con 0x7f28dc0710c0 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28daa00700 1 -- 172.21.15.47:0/3608394802 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f28cc011990 con 0x7f28dc0710c0 2024-05-10T05:19:45.150 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.147+0000 7f28daa00700 1 -- 172.21.15.47:0/3608394802 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28cc011d40 con 0x7f28dc0710c0 2024-05-10T05:19:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 -- 172.21.15.47:0/3608394802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc0710c0 msgr2=0x7f28dc0c1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 --2- 172.21.15.47:0/3608394802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc0710c0 0x7f28dc0c1c00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f28dc070c80 tx=0x7f28cc009bd0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 -- 172.21.15.47:0/3608394802 shutdown_connections 2024-05-10T05:19:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 --2- 172.21.15.47:0/3608394802 >> v2:172.21.15.117:3300/0 conn(0x7f28dc1557e0 0x7f28dc155bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.151 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 --2- 172.21.15.47:0/3608394802 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc0710c0 0x7f28dc0c1c00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 --2- 172.21.15.47:0/3608394802 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc14f910 0x7f28dc0717a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 -- 172.21.15.47:0/3608394802 >> 172.21.15.47:0/3608394802 conn(0x7f28dc06add0 msgr2=0x7f28dc06b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 -- 172.21.15.47:0/3608394802 shutdown_connections 2024-05-10T05:19:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.148+0000 7f28e3000700 1 -- 172.21.15.47:0/3608394802 wait complete. 2024-05-10T05:19:45.152 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.150+0000 7f28e3000700 1 Processor -- start 2024-05-10T05:19:45.153 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.151+0000 7f28e3000700 1 -- start start 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e3000700 1 --2- >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0710c0 0x7f28dc1ef1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e3000700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 0x7f28dc1eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e3000700 1 --2- >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1557e0 0x7f28dc15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e3000700 1 -- --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1eb890 con 0x7f28dc14f910 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e3000700 1 -- --> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc154a60 con 0x7f28dc1557e0 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e3000700 1 -- --> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28dc1eed30 con 0x7f28dc0710c0 2024-05-10T05:19:45.154 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28db400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 0x7f28dc1eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28db400700 1 --2- >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 0x7f28dc1eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.47:3300/0 says I am v2:172.21.15.47:58646/0 (socket says 172.21.15.47:58646) 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28db400700 1 -- 172.21.15.47:0/4138739054 learned_addr learned my addr 172.21.15.47:0/4138739054 (peer_addr_for_me v2:172.21.15.47:0/0) 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28dbe00700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0710c0 0x7f28dc1ef1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.152+0000 7f28e1000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1557e0 0x7f28dc15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28db400700 1 -- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0710c0 msgr2=0x7f28dc1ef1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28db400700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0710c0 0x7f28dc1ef1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28db400700 1 -- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1557e0 msgr2=0x7f28dc15b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28db400700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1557e0 0x7f28dc15b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28db400700 1 -- 172.21.15.47:0/4138739054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc009550 con 0x7f28dc14f910 2024-05-10T05:19:45.155 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28db400700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 0x7f28dc1eb0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f28c800e870 tx=0x7f28c800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8013680 con 0x7f28dc14f910 2024-05-10T05:19:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f28c80137e0 con 0x7f28dc14f910 2024-05-10T05:19:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8013bb0 con 0x7f28dc14f910 2024-05-10T05:19:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc154cb0 con 0x7f28dc14f910 2024-05-10T05:19:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.153+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28dc1ee9c0 con 0x7f28dc14f910 2024-05-10T05:19:45.156 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.155+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28dc074720 con 0x7f28dc14f910 2024-05-10T05:19:45.157 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.156+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28c8013d10 con 0x7f28dc14f910 2024-05-10T05:19:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.157+0000 7f28d3e00700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f28bc06ac90 0x7f28bc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-10T05:19:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.157+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f28c8089310 con 0x7f28dc14f910 2024-05-10T05:19:45.158 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.157+0000 7f28dbe00700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f28bc06ac90 0x7f28bc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-10T05:19:45.159 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.158+0000 7f28dbe00700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f28bc06ac90 0x7f28bc06d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28cc014040 tx=0x7f28cc008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-10T05:19:45.162 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.161+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182498 (secure 0 0 0) 0x7f28c80542e0 con 0x7f28dc14f910 2024-05-10T05:19:45.379 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.378+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 --> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28dc1eeea0 con 0x7f28dc14f910 2024-05-10T05:19:45.815 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.814+0000 7f28d3e00700 1 -- 172.21.15.47:0/4138739054 <== mon.0 v2:172.21.15.47:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f28c80170d0 con 0x7f28dc14f910 2024-05-10T05:19:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.820+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f28bc06ac90 msgr2=0x7f28bc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f28bc06ac90 0x7f28bc06d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28cc014040 tx=0x7f28cc008030 comp rx=0 tx=0).stop 2024-05-10T05:19:45.822 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 msgr2=0x7f28dc1eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 0x7f28dc1eb0d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f28c800e870 tx=0x7f28c800eb80 comp rx=0 tx=0).stop 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 shutdown_connections 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3300/0,v1:172.21.15.117:6789/0] conn(0x7f28dc1557e0 0x7f28dc15b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:6832/43361,v1:172.21.15.117:6833/43361] conn(0x7f28bc06ac90 0x7f28bc06d1a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.117:3301/0,v1:172.21.15.117:6790/0] conn(0x7f28dc0710c0 0x7f28dc1ef1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 --2- 172.21.15.47:0/4138739054 >> [v2:172.21.15.47:3300/0,v1:172.21.15.47:6789/0] conn(0x7f28dc14f910 0x7f28dc1eb0d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 >> 172.21.15.47:0/4138739054 conn(0x7f28dc06add0 msgr2=0x7f28dc0c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 shutdown_connections 2024-05-10T05:19:45.823 INFO:teuthology.orchestra.run.smithi047.stderr:2024-05-10T05:19:45.821+0000 7f28e3000700 1 -- 172.21.15.47:0/4138739054 wait complete. 2024-05-10T05:19:45.826 INFO:teuthology.orchestra.run.smithi047.stderr:pool 'cephfs_data_ec' removed 2024-05-10T05:19:45.872 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-10T05:19:45.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-10T05:19:45.872 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:45.909 INFO:tasks.ceph.mds.a:Stopped 2024-05-10T05:19:45.909 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-10T05:19:45.909 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:45.980 INFO:tasks.ceph.mds.c:Stopped 2024-05-10T05:19:45.980 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-10T05:19:45.980 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:46.025 INFO:tasks.ceph.mds.b:Stopped 2024-05-10T05:19:46.025 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-10T05:19:46.025 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:46.058 INFO:tasks.ceph.mds.d:Stopped 2024-05-10T05:19:46.058 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-10T05:19:46.059 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-10T05:19:46.059 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:52.160 INFO:tasks.ceph.osd.0:Stopped 2024-05-10T05:19:52.161 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-10T05:19:52.161 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:52.414 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-05-10T05:19:58.263 INFO:tasks.ceph.osd.1:Stopped 2024-05-10T05:19:58.264 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-10T05:19:58.264 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:19:58.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-10T05:19:58.524 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-05-10T05:20:04.365 INFO:tasks.ceph.osd.2:Stopped 2024-05-10T05:20:04.366 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-10T05:20:04.366 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:04.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-05-10T05:20:04.533 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-10T05:20:10.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-05-10T05:20:10.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-05-10T05:20:10.468 INFO:tasks.ceph.osd.3:Stopped 2024-05-10T05:20:10.468 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-10T05:20:10.468 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:13.738 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:20:13.743 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:20:16.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-05-10T05:20:16.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-05-10T05:20:16.570 INFO:tasks.ceph.osd.4:Stopped 2024-05-10T05:20:16.571 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-10T05:20:16.571 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:21.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-10T05:20:21.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-05-10T05:20:22.672 INFO:tasks.ceph.osd.5:Stopped 2024-05-10T05:20:22.673 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-10T05:20:22.673 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:27.558 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-05-10T05:20:27.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-10T05:20:28.774 INFO:tasks.ceph.osd.6:Stopped 2024-05-10T05:20:28.775 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-10T05:20:28.775 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:33.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-05-10T05:20:33.064 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-05-10T05:20:34.878 INFO:tasks.ceph.osd.7:Stopped 2024-05-10T05:20:34.878 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-10T05:20:34.878 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-10T05:20:34.878 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:34.955 INFO:tasks.ceph.mgr.y:Stopped 2024-05-10T05:20:34.956 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-10T05:20:34.956 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:35.037 INFO:tasks.ceph.mgr.x:Stopped 2024-05-10T05:20:35.037 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-10T05:20:35.037 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-10T05:20:35.037 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:35.068 INFO:tasks.ceph.mon.a:Stopped 2024-05-10T05:20:35.068 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-10T05:20:35.068 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:35.095 INFO:tasks.ceph.mon.b:Stopped 2024-05-10T05:20:35.095 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-10T05:20:35.095 INFO:teuthology.orchestra.run:waiting for 300 2024-05-10T05:20:35.163 INFO:tasks.ceph.mon.c:Stopped 2024-05-10T05:20:35.163 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-10T05:20:35.163 DEBUG:teuthology.orchestra.run.smithi047:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-05-10T05:20:35.278 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T05:20:35.278 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-10T05:20:35.571 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T05:20:35.571 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-10T05:20:35.801 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T05:20:35.802 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-10T05:20:35.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T05:20:35.993 DEBUG:teuthology.orchestra.run.smithi047:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-10T05:20:36.225 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T05:20:36.226 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-10T05:20:36.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T05:20:36.504 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-10T05:20:36.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T05:20:36.667 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-10T05:20:36.836 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T05:20:36.836 DEBUG:teuthology.orchestra.run.smithi117:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-10T05:20:37.012 INFO:tasks.ceph:Archiving mon data... 2024-05-10T05:20:37.013 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/data/mon.a.tgz 2024-05-10T05:20:37.013 DEBUG:teuthology.orchestra.run.smithi047:> mktemp 2024-05-10T05:20:37.074 INFO:teuthology.orchestra.run.smithi047.stdout:/tmp/tmp.q3yfxoNEnC 2024-05-10T05:20:37.074 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.q3yfxoNEnC 2024-05-10T05:20:37.242 DEBUG:teuthology.orchestra.run.smithi047:> sudo chmod 0666 /tmp/tmp.q3yfxoNEnC 2024-05-10T05:20:37.373 DEBUG:teuthology.orchestra.remote:smithi047:/tmp/tmp.q3yfxoNEnC is 355KB 2024-05-10T05:20:37.471 DEBUG:teuthology.orchestra.run.smithi047:> rm -fr /tmp/tmp.q3yfxoNEnC 2024-05-10T05:20:37.514 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/data/mon.b.tgz 2024-05-10T05:20:37.515 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-10T05:20:37.593 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.mBwvMsSR21 2024-05-10T05:20:37.594 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.mBwvMsSR21 2024-05-10T05:20:37.785 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.mBwvMsSR21 2024-05-10T05:20:37.906 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.mBwvMsSR21 is 364KB 2024-05-10T05:20:38.006 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.mBwvMsSR21 2024-05-10T05:20:38.050 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/data/mon.c.tgz 2024-05-10T05:20:38.051 DEBUG:teuthology.orchestra.run.smithi117:> mktemp 2024-05-10T05:20:38.065 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-05-10T05:20:38.134 INFO:teuthology.orchestra.run.smithi117.stdout:/tmp/tmp.WdXjrmzLCh 2024-05-10T05:20:38.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.WdXjrmzLCh 2024-05-10T05:20:38.310 DEBUG:teuthology.orchestra.run.smithi117:> sudo chmod 0666 /tmp/tmp.WdXjrmzLCh 2024-05-10T05:20:38.423 DEBUG:teuthology.orchestra.remote:smithi117:/tmp/tmp.WdXjrmzLCh is 364KB 2024-05-10T05:20:38.523 DEBUG:teuthology.orchestra.run.smithi117:> rm -fr /tmp/tmp.WdXjrmzLCh 2024-05-10T05:20:38.567 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-10T05:20:38.567 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T05:20:38.572 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-10T05:20:38.674 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-05-10T05:20:38.674 DEBUG:teuthology.orchestra.run.smithi047:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-10T05:20:38.679 DEBUG:teuthology.orchestra.run.smithi117:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-05-10T05:20:38.746 INFO:teuthology.orchestra.run.smithi047.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-10T05:20:38.754 INFO:teuthology.orchestra.run.smithi117.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-05-10T05:20:38.769 INFO:tasks.ceph:Archiving crash dumps... 2024-05-10T05:20:38.771 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/remote/smithi047/crash 2024-05-10T05:20:38.772 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T05:20:38.838 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/remote/smithi117/crash 2024-05-10T05:20:38.839 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-10T05:20:38.904 INFO:tasks.ceph:Shutting down logrotate 2024-05-10T05:20:38.905 DEBUG:teuthology.orchestra.run.smithi047:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:20:38.909 DEBUG:teuthology.orchestra.run.smithi117:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-10T05:20:39.047 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T05:20:39.113 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-10T05:20:39.179 INFO:tasks.ceph:Compressing logs... 2024-05-10T05:20:39.179 DEBUG:teuthology.orchestra.run.smithi047:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T05:20:39.184 DEBUG:teuthology.orchestra.run.smithi117:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T05:28:18.701 INFO:tasks.ceph:Archiving logs... 2024-05-10T05:28:18.703 DEBUG:teuthology.misc:Transferring archived files from smithi047:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/remote/smithi047/log 2024-05-10T05:28:18.704 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T05:29:06.405 DEBUG:teuthology.misc:Transferring archived files from smithi117:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/remote/smithi117/log 2024-05-10T05:29:06.406 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-10T05:31:04.844 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-10T05:31:04.979 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-10T05:31:04.980 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T05:31:04.986 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-10T05:31:05.129 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-10T05:31:05.140 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-10T05:31:05.140 DEBUG:teuthology.orchestra.run.smithi047:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T05:31:05.145 DEBUG:teuthology.orchestra.run.smithi117:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-10T05:31:05.184 INFO:teuthology.orchestra.run.smithi047.stderr:bash: ntpq: command not found 2024-05-10T05:31:05.187 INFO:teuthology.orchestra.run.smithi117.stderr:bash: ntpq: command not found 2024-05-10T05:31:05.208 INFO:teuthology.orchestra.run.smithi117.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T05:31:05.209 INFO:teuthology.orchestra.run.smithi117.stdout:=============================================================================== 2024-05-10T05:31:05.209 INFO:teuthology.orchestra.run.smithi117.stdout:^* hv01.front.sepia.ceph.com 3 6 377 60 +2313us[+2293us] +/- 65ms 2024-05-10T05:31:05.209 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -1423us[-1423us] +/- 52ms 2024-05-10T05:31:05.209 INFO:teuthology.orchestra.run.smithi117.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -674us[ -674us] +/- 73ms 2024-05-10T05:31:05.209 INFO:teuthology.orchestra.run.smithi117.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T05:31:05.211 INFO:teuthology.orchestra.run.smithi047.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-10T05:31:05.211 INFO:teuthology.orchestra.run.smithi047.stdout:=============================================================================== 2024-05-10T05:31:05.211 INFO:teuthology.orchestra.run.smithi047.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +2335us[+2312us] +/- 65ms 2024-05-10T05:31:05.211 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 60 -1406us[-1429us] +/- 52ms 2024-05-10T05:31:05.211 INFO:teuthology.orchestra.run.smithi047.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 -655us[ -679us] +/- 73ms 2024-05-10T05:31:05.211 INFO:teuthology.orchestra.run.smithi047.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-10T05:31:05.212 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-10T05:31:05.220 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-10T05:31:05.221 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-10T05:31:05.229 DEBUG:teuthology.orchestra.run.smithi047:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T05:31:05.406 DEBUG:teuthology.orchestra.run.smithi117:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-10T05:31:05.599 DEBUG:teuthology.orchestra.run.smithi047:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T05:31:05.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T05:31:05.671 DEBUG:teuthology.orchestra.run.smithi117:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-10T05:31:05.741 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T05:31:05.742 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-10T05:31:05.752 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-10T05:31:05.792 INFO:teuthology.task.internal:Duration was 3035.300773 seconds 2024-05-10T05:31:05.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-10T05:31:05.801 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-10T05:31:05.801 DEBUG:teuthology.orchestra.run.smithi047:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T05:31:05.806 DEBUG:teuthology.orchestra.run.smithi117:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-10T05:31:05.947 INFO:teuthology.orchestra.run.smithi117.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T05:31:05.963 INFO:teuthology.orchestra.run.smithi047.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-10T05:31:06.250 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-10T05:31:06.250 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi047.front.sepia.ceph.com 2024-05-10T05:31:06.250 DEBUG:teuthology.orchestra.run.smithi047:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T05:31:06.309 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi117.front.sepia.ceph.com 2024-05-10T05:31:06.309 DEBUG:teuthology.orchestra.run.smithi117:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-10T05:31:06.387 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-10T05:31:06.387 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T05:31:06.392 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-10T05:31:06.498 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-10T05:31:06.498 DEBUG:teuthology.orchestra.run.smithi047:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T05:31:06.502 DEBUG:teuthology.orchestra.run.smithi117:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-10T05:31:06.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-10T05:31:06.639 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-10T05:31:06.639 DEBUG:teuthology.orchestra.run.smithi047:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T05:31:06.722 DEBUG:teuthology.orchestra.run.smithi117:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-10T05:31:06.809 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-10T05:31:06.819 DEBUG:teuthology.orchestra.run.smithi047:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T05:31:06.824 DEBUG:teuthology.orchestra.run.smithi117:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-10T05:31:06.909 INFO:teuthology.orchestra.run.smithi047.stdout:kernel.core_pattern = core 2024-05-10T05:31:06.924 INFO:teuthology.orchestra.run.smithi117.stdout:kernel.core_pattern = core 2024-05-10T05:31:06.958 DEBUG:teuthology.orchestra.run.smithi047:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T05:31:07.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T05:31:07.000 DEBUG:teuthology.orchestra.run.smithi117:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-10T05:31:07.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-10T05:31:07.043 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-10T05:31:07.053 INFO:teuthology.task.internal:Transferring archived files... 2024-05-10T05:31:07.055 DEBUG:teuthology.misc:Transferring archived files from smithi047:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/remote/smithi047 2024-05-10T05:31:07.055 DEBUG:teuthology.orchestra.run.smithi047:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T05:31:07.135 DEBUG:teuthology.misc:Transferring archived files from smithi117:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-05-10_02:33:39-fs-wip-pdonnell-testing-20240509.171335-reef-debug-distro-default-smithi/7700570/remote/smithi117 2024-05-10T05:31:07.135 DEBUG:teuthology.orchestra.run.smithi117:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-10T05:31:07.213 INFO:teuthology.task.internal:Removing archive directory... 2024-05-10T05:31:07.213 DEBUG:teuthology.orchestra.run.smithi047:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T05:31:07.217 DEBUG:teuthology.orchestra.run.smithi117:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-10T05:31:07.262 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-10T05:31:07.274 INFO:teuthology.task.internal:Not uploading archives. 2024-05-10T05:31:07.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-10T05:31:07.284 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-10T05:31:07.285 DEBUG:teuthology.orchestra.run.smithi047:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T05:31:07.302 DEBUG:teuthology.orchestra.run.smithi117:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-10T05:31:07.342 INFO:teuthology.orchestra.run.smithi047.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 05:31 /home/ubuntu/cephtest 2024-05-10T05:31:07.346 INFO:teuthology.orchestra.run.smithi117.stdout: 524309 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 10 05:31 /home/ubuntu/cephtest 2024-05-10T05:31:07.350 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-10T05:31:07.360 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-10T05:31:07.385 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 client.1-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs/mixed-clients/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_8} kclient-overrides/{distro/testing/k-testing ms-die-on-skipped} objectstore-ec/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down osd-asserts} tasks/kernel_cfuse_workunits_dbench_iozone} duration: 3035.300772666931 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-05-10T05:31:07.385 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-10T05:31:07.461 INFO:teuthology.run:pass